OpenAI Audio API
Learn how to turn audio into text or text into audio.
Operations 9
Each operation below carries the questions people ask an LLM about it and the instructions they give an agent to run it. Generated by API Evangelist overlay
Ask an LLM
“How do I convert a paragraph of text into an MP3 voiceover?”
“Can I control the speaking speed and tone of generated speech?”
Tell an agent
Read {input} aloud using voice {voice} with model {model}.
Generate a {response_format} speech file of {input} in voice {voice} using {model}.
Ask an LLM
“What's the way to turn a meeting recording into text in its original language?”
“Can I get word-level timestamps or speaker labels in a transcript?”
Tell an agent
Transcribe audio file {file} with model {model}.
Transcribe {file} using {model}, telling it the speech is in {language}.
Ask an LLM
“Can I take a Spanish audio clip and get an English transcript back?”
“Is there a way to translate foreign-language speech straight into English text?”
Tell an agent
Translate the speech in {file} into English using {model}.
Give me an English translation of recording {file} with model {model} as {response_format}.
Ask an LLM
“What do I need to upload before I'm allowed to create a custom voice?”
“How do I submit a speaker's consent recording for voice cloning?”
Tell an agent
Upload consent recording {recording} named {name} in {language}.
Register a voice consent called {name} from recording {recording}, spoken in {language}.
Ask an LLM
“Which voice consent recordings has my organization uploaded for custom voices?”
“Can I page through all our custom-voice consent recordings?”
Tell an agent
List our voice consent recordings.
Show the first {limit} voice consent recordings.
GET
/audio/voice_consents/{consent_id}
Retrieve a voice consent recording · Retrieve voice consent
#
Ask an LLM
“What metadata is stored for one of our voice consent recordings?”
“Can I look up a single consent recording by its ID?”
Tell an agent
Get voice consent {consent_id}.
Show the metadata of consent recording {consent_id}.
Ask an LLM
“Can I rename a consent recording without re-uploading the audio?”
“Does updating a voice consent replace its audio?”
Tell an agent
Rename voice consent {consent_id} to {name}.
Change the name on consent recording {consent_id} to {name}.
Ask an LLM
“How do I remove a speaker's consent recording if they withdraw permission?”
“Can I delete a voice consent recording we uploaded?”
Tell an agent destructive · confirm first
Delete voice consent {consent_id}.
Remove the consent recording {consent_id} permanently.
Ask an LLM
“How do I create a custom voice to use in text-to-speech?”
“What does a custom voice need besides an audio sample?”
Tell an agent
Create a custom voice named {name} from sample {audio_sample} using consent {consent}.
Build voice {name} from audio sample {audio_sample} backed by consent recording {consent}.
Documentation
Documentation
https://platform.openai.com/docs/assistants/overview
Documentation
https://platform.openai.com/docs/api-reference/assistants
Documentation
https://platform.openai.com/docs/guides/text-to-speech
Documentation
https://platform.openai.com/docs/api-reference/audio
Documentation
https://platform.openai.com/docs/guides/speech-to-text
Documentation
https://developers.openai.com/api/docs/guides/audio/
Documentation
https://developers.openai.com/api/docs/guides/voice-agents/
Documentation
https://platform.openai.com/docs/api-reference/chat
Documentation
https://platform.openai.com/docs/guides/embeddings
Documentation
https://platform.openai.com/docs/api-reference/embeddings
Documentation
https://platform.openai.com/docs/api-reference/files
Documentation
https://platform.openai.com/docs/guides/fine-tuning
Documentation
https://platform.openai.com/docs/api-reference/fine-tuning
Documentation
https://platform.openai.com/docs/guides/images
Documentation
https://platform.openai.com/docs/api-reference/images
Documentation
https://platform.openai.com/docs/guides/image-generation
Documentation
https://platform.openai.com/docs/guides/images-vision
Documentation
https://platform.openai.com/docs/models
Documentation
https://platform.openai.com/docs/api-reference/models
Documentation
https://platform.openai.com/docs/assistants/how-it-works/managing-threads-and-messages
Documentation
https://platform.openai.com/docs/api-reference/threads
Documentation
https://platform.openai.com/docs/api-reference/completions
Specifications
Schemas & Data
JSONSchema
https://artifacts.apis.io/openai/json-schema/openai-chat-completion-schema.json
JSONSchema
https://artifacts.apis.io/openai/json-schema/openai-embedding-schema.json