Building Production AI-Powered Applications with the OpenAI API and Plugins

We recently introduced Chat Completions into the OpenAI API – which currently powers the GPT-4 and ChatGPT APIs. With it, developers now have a powerful new interaction pattern to talk to our models in a similar manner to the ChatGPT experience, as well as the ability to call out to external tools. In this talk, we will be walking through steerability and system prompts, optimizations to improve request latency and throughput with the API, and best practices in deploying production apps on top of our models. Finally, we will also preview how this interface will evolve by covering more recent and nascent capabilities such as plugins and image inputs into our models.


Sherwin Wu

Technical Staff @OpenAI

Sherwin is a Member of Technical Staff at OpenAI. He works on the Developer Platform team, which is responsible for the products that allow developers to build products on top of OpenAI models and capabilities.

Read more


Atty Eleti

Software Engineer @OpenAI

Atty Eleti is a software engineer at OpenAI working on their API and developer platform. Previously, he spent many years building APIs at Stripe. Talk to him about GPT-4, AI, language models, tool use, integrating LLMs into your products, and any feedback on the OpenAI API!

Read more
Find Atty Eleti at:


Wednesday Jun 14 / 02:55PM EDT ( 50 minutes )


Salon D (North Tower)


AI/ML APIs Machine Learning LLMs Agents


From the same track

Session Machine Learning

Improve Feature Freshness in Large Scale ML Data Processing

Wednesday Jun 14 / 11:50AM EDT

In many ML use cases, model performance is highly dependent on the quality of the features they are trained and inference on. One of the important dimensions of feature quality is the freshness of the data.

Zhongliang Liang

Engineering Manager @Facebook AI Infra

Session MLOps

Platform and Features MLEs, a Scalable and Product-Centric Approach for High Performing Data Products

Wednesday Jun 14 / 04:10PM EDT

In this talk, we would go through the lessons learnt in the last couple of years around organising a Data Science Team and the Machine Learning Engineering efforts at Bumble Inc.

Massimo Belloni

Data Science Manager @Bumble

Session ML Infrastructure

Introducing the Hendrix ML Platform: An Evolution of Spotify’s ML Infrastructure

Wednesday Jun 14 / 10:35AM EDT

The rapid advancement of artificial intelligence and machine learning technology has led to exponential growth in the open-source ML ecosystem.

Divita Vohra

Senior Product Manager @Spotify

Mike Seid

Tech Lead for the ML Platform @Spotify


Panel: MLOps - Production & Delivery for ML Platforms

Wednesday Jun 14 / 05:25PM EDT

Details coming soon.


Unconference: MLOps

Wednesday Jun 14 / 01:40PM EDT

What is an unconference? An unconference is a participant-driven meeting. Attendees come together, bringing their challenges and relying on the experience and know-how of their peers for solutions.