This is so cool: A model that lets you have face-to-face conversations with a virtual persona.
The model processes incoming audio and video while it generates speech and facial expressions.
You can talk to the AI persona, and it will use visual cues while listening, making for a much more realistic conversation. For example, you'd see when the AI wants to intervene by looking at it.
The first AI persona you’ll actually want to meet face-to-face. Most AI personas stare blankly while you talk. Emma reacts while you’re still speaking. After 18 months of research at @nuance_ai, this is Emma, built on Nuplex, our full-duplex audiovisual foundation model.
Santiago · x.comPublished · added here
Original title: This is so cool: A model that lets you have face-to-face conversations with a virtual persona.
