Amazon Announces Nova Sonic Sound Model, Claims Performance Surpasses OpenAI and Google

Amazon today introduced Nova Sonic, an advanced speech-to-speech model that enables developers to build applications that can converse with human-like voices in real time. Amazon claims the new acoustic model offers industry-leading price performance and low latency.

Typically, developing a voice-enabled application requires developers to work with multiple models at the same time:

  • Speech recognition model for converting audio to text.
  • Large Language Model (LLM) for understanding and generating responses.
  • Text-to-speech model.

This approach is not only complex, but also often misses important acoustic contexts such as tone, prosody, and speaking style.

Amazon Announces Nova Sonic Sound Model, Claims Performance Surpasses OpenAI and Google

Nova Sonic addresses this challenge by integrating speech understanding and generation into a single model. This unified approach helps the model capture tone, style, and audio input, creating more natural dialogue. It also determines when to respond appropriately and better handles barge-ins.

Nova Sonic supports both male and female voices in a variety of English accents, including American and British. Developers can access the model via Amazon Bedrock using a two-way streaming API, which supports function calling. The model also includes built-in protection features such as content moderation and watermarking.

In this regard, last month OpenAI announced a new generation of speech-to-text models – gpt-4o-transcribe and gpt-4o-mini-transcribe – with significant improvements in word error rate, language recognition, and accuracy over previous Whisper models.

Sign up and earn $1000 a day ⋙

Leave a Comment

Instructions for inserting horizontal and vertical lines in Google Docs

Instructions for inserting horizontal and vertical lines in Google Docs

To add more effect to the document, we can use some lines, such as creating Google Docs paragraph borders, or using lines to separate paragraphs in the document.

Formula for calculating the volume of a truncated pyramid, the lateral area and total area of ​​a truncated pyramid

Formula for calculating the volume of a truncated pyramid, the lateral area and total area of ​​a truncated pyramid

Let's learn what a truncated pyramid is, how to calculate the volume of a truncated pyramid, the lateral area and total area of ​​a truncated pyramid in the article below.

Apple to launch News+ Food in April with iOS/iPadOS 18.4

Apple to launch News+ Food in April with iOS/iPadOS 18.4

Apple News+ will soon be the place to solve the age-old problem of what's for dinner.

TRUNC Function: How to remove decimals and shorten numeric values

TRUNC Function: How to remove decimals and shorten numeric values

There are different ways in Excel to remove decimals and shorten numeric values. In this article, Quantrimang.com will explain how to use the TRUNC function and point out what makes it different from other techniques.

Minimum system requirements to play Welcome to ParadiZe on PC

Minimum system requirements to play Welcome to ParadiZe on PC

Although Welcome to ParadiZe does not require too high gaming configuration, you should still refer to the gaming configuration.

Latest Enigma Of Sepia Code

Latest Enigma Of Sepia Code

Enigma of Sepia offers players a series of attractive rewards through game codes.

Threads tweaks algorithm to combat Blueskys rise

Threads tweaks algorithm to combat Blueskys rise

Threads is making changes to the way its algorithm works, revamping the For You feed to ensure more content from people you follow appears.

Shazam Celebrates 100 Billionth Song Recognized, Along With Other Impressive Records

Shazam Celebrates 100 Billionth Song Recognized, Along With Other Impressive Records

22 years ago, Shazam, the world's most popular and beloved music identification app, was born.

How to present PowerPoint on Zoom

How to present PowerPoint on Zoom

Zoom is the go-to app for virtual meetings and Microsoft PowerPoint is still king for presentations, making it easy to combine the two whether you're teaching a class, pitching a business idea, or hosting a webinar.

3 ways to turn off camera on iPhone lock screen

3 ways to turn off camera on iPhone lock screen

The iPhone offers a camera icon for access right from the lock screen. However, many agree that this shortcut will affect users' privacy.

7 Best Pinterest Alternatives

7 Best Pinterest Alternatives

Maybe Pinterest isn't for you. Don't worry, there are plenty of Pinterest alternatives worth considering!

Apple is changing the way you protect your devices with AppleCare+

Apple is changing the way you protect your devices with AppleCare+

While Apple used to sell prepaid AppleCare+ plans at retail locations, the company is now abandoning that practice in favor of a subscription model.

Which direction does a compass point in space?

Which direction does a compass point in space?

On Earth, a compass always points north—but when you drift outside our planet's magnetosphere, things get more complicated. So which way does a compass point when you're off Earth?

Astronomers discover strange comet with tail up to 560,000km long

Astronomers discover strange comet with tail up to 560,000km long

A team of astronomers using the W.M. Keck Observatory in Hawaii has stumbled upon a surprising discovery: A distant exoplanet hurtling through space with a tail hundreds of thousands of kilometers long.

Summary of the latest Jujutsu Kaisen Phantom Parade codes

Summary of the latest Jujutsu Kaisen Phantom Parade codes

Jujutsu Kaisen Phantom Parade is a mobile game based on the world famous anime series. To make your game even more interesting, you can redeem Jujutsu Kaisen Phantom Parade codes.