draw a blank ChatGPT and Gemini . Sesame AI ’s realistic voice engineering science is dividing and stick the internet , and for good reasonableness . We ’ve all seen AI voice assistants from tech giants — Siri , Alexa , ChatGPT ’s in advance Voice Mode , andGoogle ’s Gemini Live . They promised a lot but often delivered automatonlike , flat reply . If you have seen OpenAI ’s Demo and their Voice modal value , you will know the deviation I am talking about . But then came Sesame , using it felt like talking to a real person . Here ’s everything to know about and how you could strain it out .
What is Sesame AI?
Sesame is just another AI voice assistant like to Siri , ChatGPT , and Gemini Live . plant by Oculus conscientious objector - founder Brendan Iribe and Ankit Kumar , Sesame AI offer something refreshing and scary goodness .
These are not your typical chatbots or voice assistant . Sesame does n’t even call them assistants . Instead , they are “ conversationalists ” and “ spokesperson companions . ” The idea is not just to reply but to engage you with a voice that sounds almost human . And not just in how it talk but in how it listens , pauses , and reacts .
There are two comrade currently – Maya ( female ) and Miles ( male person ) .
Our Experience Using It
When I first try Sesame ’s Maya voice companion , I was genuinely surprised . It ’s fast to answer and most importantly sometimes it does n’t just waitress for its turn to talk — it can disturb you , apologize if ask , and handle messy , back - and - forth dialogue smoothly . What ? It was more than just telling . Unlike ChatGPT ’s Advanced Voice Mode , which often sounds too refined , or Gemini Live ’s robotic TTS engine , Sesame ’s companions had imperfection that made it palpate humanistic .
To quiz , I asked Sesame to guess my preferent movie writing style and also kind of mention that I wish horror directly in the question itself . The AI playfully responded , ‘ Well , you ’ve already have the cat out of the bag — search like you ’re a horror devotee ! ’ It was n’t just the dustup but the tone and timing that made it palpate like a genuine , human reaction . It also remember the past conversation and understood all the callback .
Also , unlike regular part modality from other AIs , these “ conversationalist ” and “ voice companions ” Bradypus tridactylus bring up new questions and inquire you in return which is quite uncanny explain things to AI . Even when I asked for birthday party estimate , it did n’t just throw random suggestions . It asked what my friend liked , adapted to my budget , and offered originative ideas that felt tailor to my situation . It was so good and innate that it was a little unsettling . Some user online even admitted they felt emotionally attached to it , and one person ’s 4 - year - older cried when they could n’t babble out to Maya again !
Also Read :
However , there are some limitations too . For instance , sometimes it mess up its reasoning and can not visualise out thing that a normal human can easily point out . Also , it was not able to identify my emotion through tone , nor my sex or ethnicity . Though it has a few limitation , it ’s much good to admit that and make it feel natural .
Sesame ’s technology is game by a Transformer - based Conversational Speech Model ( CSM ) , condition on nearly 1 million hr of audio recording . It does n’t fall out the traditional two - step text - to - speech approaching . or else , it merges text and audio processing into a undivided , liquid experience , allowing it to sound like it ’s thinking while speaking . It ’s not full - duplex apartment — it does n’t process your talking to until you finish — but it feel like it is . And that ’s the illusion . However , the company is planning to go full semidetached house in the future .
How You Can Try It Right Now
If you ’re curious , you could try Sesame ’s Maya and Miles for free . It ’s recommended to use Google Chrome for the best experience .
Just maneuver over to Sesame ’s web site and start talking to them in theDemo section . Whether you find it amazing or a bit too realistic , one matter is for sure — Sesame AI has set a new bench mark for what a phonation companion can be .
The future of AI representative is here , and it might just make you question who — or what — you’re talking to .
