OpenAI’s ChatGPT can now see, hear and speak : The Tribune India

Join Whatsapp Channel

OpenAI’s ChatGPT can now see, hear and speak

Company said it is rolling out voice and images in ChatGPT to Plus and Enterprise users over the next two weeks

OpenAI’s ChatGPT can now see, hear and speak

Photo used for representational purpose only. iStock



IANS

San Francisco, September 25

Sam Altman-run OpenAI on Monday announced it is rolling out new voice and image capabilities in ChatGPT that can now help the AI chatbot see, hear and speak.

These capabilities offer a new, more intuitive type of interface by allowing you to have a voice conversation or show ChatGPT what you're talking about, the company said in a statement.

“Voice mode and vision for chatGPT! really worth a try,” Altman posted on X.

The company said it is rolling out voice and images in ChatGPT to Plus and Enterprise users over the next two weeks.

“Voice is coming on iOS and Android (opt-in in your settings) and images will be available on all platforms,” said the Microsoft-backed company.

The new voice capability is powered by a new text-to-speech model, capable of generating human-like audio from just text and a few seconds of sample speech.

“We collaborated with professional voice actors to create each of the voices. We also use Whisper, our open-source speech recognition system, to transcribe your spoken words into text,” said OpenAI.

Image understanding is powered by multimodal GPT-3.5 and GPT-4. These models apply their language reasoning skills to a wide range of images, such as photographs, screenshots, and documents containing both text and images.

The new voice technology opens doors to many creative and accessibility-focused applications.

However, “these capabilities also present new risks, such as the potential for malicious actors to impersonate public figures or commit fraud,” the company noted.

“This is why we are using this technology to power a specific use case — voice chat. Voice chat was created with voice actors we have directly worked with,” it added.

Spotify is using the power of this technology for the pilot of their Voice Translation feature, which helps podcasters expand the reach of their storytelling by translating podcasts into additional languages in the podcasters' own voices.

“We've also taken technical measures to significantly limit ChatGPT's ability to analyze and make direct statements about people since ChatGPT is not always accurate and these systems should respect individuals' privacy,” said the company.

#ChatGPT


Top News

Want fair probe, justice in Swati Maliwal assault case as incident has two versions: Arvind Kejriwal

Want fair probe, justice in Swati Maliwal assault case as incident has two versions: Arvind Kejriwal

In an interview to PTI, the chief minister says the matter i...

Rajasthan’s Barmer records 48 degrees; temperatures set to rise further, says IMD

Rajasthan’s Barmer records 48 degrees; temperatures set to rise further, says IMD

Water levels in the Delhi stretch of the Yamuna river drop a...

Calcutta High Court order on OBC quota to Muslims ‘tight slap’ to opposition: Modi

Calcutta High Court order on OBC quota to Muslims ‘tight slap’ to opposition: Modi

The Calcutta High Court, in its verdict on Wednesday, noted ...

Bomb threat email received by North Block, security officers conduct searches

North Block receives bomb threat email, turns out to be hoax

The threat is received through an email around 3.30 pm by a ...

Pune juvenile court cancels bail of teenager involved in car crash, sends him to observation home

Pune juvenile court cancels bail of teenager involved in car crash, sends him to observation home

The board had on Sunday granted bail to him hours after the ...


Cities

View All