JP — ITmedia
Block, led by Jack Dorsey, Unveils Dessa, a Full-Duplex Voice Model Trained Only on Speech: "Feels Like Talking to a Person"
AI1 min read
Block, the company led by Jack Dorsey, has shown a new voice AI called Dessa. It learns only from human speech, not text, and it can talk back in real time, like a person in a conversation.
What happened
On October 23 (US time), Block (formerly Square) announced Dessa as a research preview. Dessa is a speech-to-speech model. It takes voice in and gives voice out. It can listen and talk at the same time, which is called full-duplex. Dorsey said it feels like talking to a real person.
Key facts
- Dessa learned only from recorded human conversation speech, with no text.
- Learning used one NVIDIA GB200 NVL72 system.
- Block says it learned language with a few hundred times fewer words than large language models (LLMs).
- It can run locally on a MacBook Pro with M4 Max or better.
- The demo is in English only. Block has not said which languages it supports.
Some simple terms
Most voice AI first turns your speech into text, then makes a reply, then turns that reply back into speech. Block says this process throws away useful details like tone, sarcasm, and sighs. A full-duplex model can listen and speak at once, so it can interrupt, laugh, or say 'uh-huh' like a friend would.
Why it matters
Dessa shows that AI might learn to speak in a more natural way, with feelings and timing. Block also says that AI that cannot understand emotion in a voice is a safety problem. Dessa is meant to be one step toward fixing that. Still, this is early research, and Block has not said when the public can use it.
What to watch
- When Block releases the link for people to try Dessa.
- When a full public launch date is announced. Block has not given one.
- Results from the small group of AI safety researchers who get early access to find hidden risks.
- How Dessa compares with OpenAI's GPT-Live-1, a full-duplex voice model released in July.
Glossary
- Block
- A US company, formerly called Square, led by Jack Dorsey. It makes payment and financial tools.
- Dessa
- A new voice AI model from Block that learns only from human speech and can talk and listen at the same time.
- speech-to-speech
- A type of AI that takes spoken words in and gives spoken words out, without making text in between.
- GPT-Live-1
- A real-time voice model from OpenAI, released in July, that can also listen and talk at the same time.
- NVIDIA GB200 NVL72
- A large computer system made by NVIDIA, used for AI training. Block used one unit to train Dessa.