×
NVIDIA’s New AI Model Makes Conversations with Game Characters More Real
Written by
Published on
Join our daily newsletter for breaking news, product launches and deals, research breakdowns, and other industry-leading AI coverage
Join Now

NVIDIA unveils groundbreaking on-device AI model for gaming: NVIDIA has introduced Nemotron-4 4B Instruct, a small language model designed to enhance character interactions in video games, marking a significant advancement in digital human technologies.

  • The new model is part of NVIDIA’s ACE (Avatar Cloud Engine) suite, which aims to improve speech, intelligence, and animation in gaming through generative AI.
  • Nemotron-4 4B Instruct is optimized to run directly on GeForce RTX AI PCs and laptops, offering faster response times and reduced memory usage.
  • This development allows game developers to leverage the power of over 100 million GeForce RTX-powered devices to create more immersive gaming experiences.

Mecha BREAK showcases NVIDIA’s new technology: Amazing Seasun Games, a subsidiary of Kingsoft Corporation, is demonstrating the capabilities of Nemotron-4 4B Instruct in their new multiplayer mech game, Mecha BREAK.

  • The game features an NPC mechanic that utilizes NVIDIA’s ACE-powered game interactions to assist players in customizing their mechs and preparing for battle.
  • NVIDIA’s Audio2Face-3D NIM and OpenAI’s Whisper model provide on-device facial animation and speech recognition, while ElevenLabs handles cloud-based voice generation.
  • Kris Kwok, CEO of Amazing Seasun Games, expressed excitement about the potential of ACE NIM microservices to enhance in-game immersion.

Enhanced role-playing and character interactions: Nemotron-4 4B Instruct is specifically designed to improve the conversational abilities of game characters, leading to more intuitive and natural interactions with players.

  • The model offers improved role-play, retrieval-augmented generation, and function-calling capabilities.
  • These enhancements allow game characters to better understand player instructions and perform more accurate and relevant actions.
  • The technology aims to create a more dynamic and immersive gameplay experience for users of GeForce RTX AI PCs.

Expanding applications in the gaming industry: NVIDIA’s ACE and digital human technologies are gaining traction among game developers and publishers, with Perfect World Games exploring new possibilities.

  • Perfect World Games is advancing its NVIDIA ACE demo, Legends, by incorporating AI-powered vision capabilities.
  • The demo now features a character named Yun Ni, who can identify people and objects in the real world using the computer’s camera, powered by ChatGPT-4o.
  • This augmented reality layer adds a new dimension to PC gaming, potentially increasing immersion and accessibility.

Implications for the future of gaming: The introduction of Nemotron-4 4B Instruct and its integration into games like Mecha BREAK signals a shift towards more intelligent and responsive NPCs in video games.

  • As these technologies become more widespread, players can expect increasingly realistic and engaging interactions with in-game characters.
  • The on-device nature of the model could lead to improved performance and reduced latency in AI-powered game features.
  • The gaming industry may see a surge in games that leverage these advanced AI technologies to create more personalized and immersive experiences.
NVIDIA Announces First Digital Human Technologies On-Device Small Language Model, Improving Conversation for Game Characters

Recent News

Grok stands alone as X restricts AI training on posts in new policy update

X explicitly bans third-party AI companies from using tweets for model training while still preserving access for its own Grok AI.

Coming out of the dark: Shadow AI usage surges in enterprise IT

IT leaders report 90% concern over unauthorized AI tools, with most organizations already suffering negative consequences including data leaks and financial losses.

Anthropic CEO opposes 10-year AI regulation ban in NYT op-ed

As AI capabilities rapidly accelerate, Anthropic's chief executive argues for targeted federal transparency standards rather than blocking state-level regulation for a decade.