Multimodal interaction—versatile AI for situational driving

Go beyond voice with the most intuitive interaction available.

Speak, write or just glance. Your assistant will understand.

Contact us Newsletter

Our industry-leading AI for cars just got smarter.

Nuance sets the bar for voice in cars, building on decades of experience using conversational artificial intelligence and Deep Learning to perfect the way machines speak and listen. But sometimes it’s more convenient to communicate with a scribble or a pointed look—so we’ve evolved Dragon Drive to understand handwriting, gesture, and even the human gaze.

Multimodal interaction optimizes safety and user experience by accommodating whatever kind of communication comes naturally in each driving situation, including speech, handwriting, gaze detection and other non-verbal modalities. Like a friend, your assistant just gets it, shifting seamlessly from one mode of human interaction to the next.

Benefits

Flexible, adaptive, and future-proof

Dragon Drive is ready for future mobility, accommodating drivers with interaction that enhances focus, optimizes productivity, and adapts to their changing needs and responsibilities.

Versatile

On a conference call? Users can write commands or questions in lieu of speaking. If they’re curious about an attraction, shop, or restaurant on the roadside, they can just look at it to launch a targeted dialogue with the assistant.

Safe

By adapting seamlessly to situational human interaction, the multimodal assistant minimizes distraction and frees the driver to focus on the road.

Ready for autonomous driving

Multimodality will be especially vital in cars of the future, when autonomous driving will enable users to transition to a passenger role while staying prepared to take the wheel. Not only will gaze detection allow effortless engagement with the landscape (enhancing the sightseeing that users expect from future mobility, studies show), but multimodal alerting will optimize safety by combining vibration, visual cues, and auditory prompts to tell drivers it’s time to take over.

Gaze detection

Just one look: a new standard for natural human interaction through AI

Dragon Drive is designed to give your assistant the intuition of a human copilot—and now, with gaze detection, the interaction is easier and more natural than ever before. It’s like talking with a friend about passing sights—a friend who happens to have advanced GPS, encyclopedic knowledge, and inexhaustible memory for individual habits and preferences.

Ease for users

A user needs only to look at an object of interest—in or outside the vehicle—and speak casually about it for the assistant to direct its intelligence to the same object.

Whatever is said, from “Who built that?” to “Is there a children’s menu there?” or “What does this red light mean?” the assistant will understand and deliver an accurate, contextual response—without the need for prompts, scripts, or keywords.

More human artificial intelligence

Multimodal interaction combines eye trajectory and head angle with precision car positioning and 3D environmental modeling to track users’ gaze. Thanks to Dragon Drive’s Just Talk feature and contextual reasoning, users can engage conversationally, with no “wake-up” word, and the assistant knows exactly what they’re referring to.

Discover gaze detection, the master of all shortcuts.
Users just, look, speak, and rely on the assistant to provide relevant results.

Handwriting recognition

Noteworthy reading skills

Though it’s best known for advanced speech recognition, Dragon Drive is now equally skilled in its ability to read. Fluent in 50+ languages and infinite writing styles, it applies text-to-speech translation to messages written on a simple pad, mounted on the center console.

Texting, finding a business, adding a stop, changing the station…
Dragon Drive puts the world at your customers’ fingertips. See how handwriting gives users another engaging, intuitive option for communicating with your cars.

Flexibility

No need to write neatly: your assistant reads print or cursive, recognizes single and multi-characters, and can decipher a messy scrawl. Informed by artificial intelligence and Deep Learning based on neural networks, it has the intelligence to save time by predicting what users want to say or ask.

Convenience

When users need to communicate quietly, multitask while speaking, or just jot something down, it’s a relief to have an assistant that understands handwriting. Potential uses include composing messages, selecting contacts, scribbling destinations, and changing the radio station.

Focus

Dragon Drive’s literacy allows drivers to write when it comes naturally—or when speaking and gaze are not possible. To keep drivers’ eyes on the road, feedback and suggestions are provided in direct sight or in audio.

Innovation leadership for future mobility

The age of autonomous driving is just ahead of us—but Nuance accelerates the future in everything we do. Our technologies set the standard for artificial intelligence in cars, allowing OEMs to deliver comprehensive connection within a consistent brand experience. Discover how delightful intelligence can be with the automotive industry’s #1 partner.

Get our latest resources
Test

This is what drivers look for in their digital co-driver

Anticipate users’ needs, now and in the future.

Get it now

What passengers want to do instead of driving

How will UX need to adapt to self-driving cars?

Get it now

Deliver a more versatile, responsive user experience. Contact us.

Engage us