Implement a GPT-4o Realtime based voice assistant

GenixPRO 36 Reputation points
2024-11-17T09:23:30.35+00:00

Hi Team,

Do we need to implement webRTC or sockets to implement a GPT-4o Realtime based voice assistant in our ios/android hybrid app? We thought it may be enough to enable audio port access via. app and as/when user speaks, the assistant is listening to ambient sound/voice and responds. Is that correct?

If we implement webRTC, how do we deliver/receive audio to/from the assistant? Our understanding was that frontend app will be able to handle this functionality independently without having to talk back to our backend server.

Thanks.

Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,037 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,916 questions
0 comments No comments
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.