NVIDIA has launched a Halloween project called MonsterHouse, which features a grumpy pirate ship that listens to visitors and responds in a pirate voice. The character is animated using NVIDIA Audio2Face-3D to move the garage door’s mouth.
The project runs on a single workstation using the NVIDIA Nemotron Voice Agent. NVIDIA provided the Nemotron ASR for speech recognition and Nemotron Voice Agent for conversation. The Nemotron 3.5 Bolt E4B 4GB model serves as the brain for the interaction.
MonsterHouse demonstrates the capabilities of Nemotron models for interactive voice agents. The project shows how these tools can be combined to create immersive experiences.