2024 · 11

About Digital Human of Nvidia

I often enjoy browsing job postings from major companies, checking out the roles and the qualifications they’re looking for. Recently, I came across Nvidia's "Technical Product Specialist" job listing.

nvidia-job-req

Looking at the job description, it's clear they’re focusing on SDK testing and documentation for their "Digital Human" product. It’s obvious they’re all in on this project.

"So, what exactly is this Digital Human?" you might ask. You can check out Nvidia’s promotional material here. In short, they’re AI-driven digital characters created using generative AI and other technologies (like NVIDIA Audio2Face). It’s like they’ve breathed life into these digital beings, so to speak.

These "digital humans" are set to add incredible depth to games. While we probably won’t see them in upcoming AAA titles like GTA 6 anytime soon, it’s not a distant future either. One of the earliest examples we’ve seen of this concept was during the peak of ChatGPT’s popularity(with gpt 3.5 or 3.0), when someone modded Mount & Blade: Bannerlord. They connected a random villager NPC to ChatGPT, gave it a backstory (like “You’re a poor peasant, and your lord is this guy”), and then chatted with it through an interface.

First Game to Feature It: Mecha BREAK

Nvidia has already announced the first game that will use its Digital Human technology: Mecha BREAK. But let me pause here for a second. This game is multiplayer and has low system requirements. I mean, why would you showcase this cutting-edge technology in a game like this? Wouldn’t it have been amazing to see it in something like inZoi? Just saying.

According to Nvidia, the model they’re using runs directly on devices and has 4 billion parameters. You can even test this model yourself via their website. That said, a 4B-parameter model isn’t huge by today’s standards. In the future, we’ll likely see bigger and more customized models for different games. As this technology evolves, both developers and players will adapt these LLMs (Large Language Models) to fit their needs.

Will We See NVIDIA ACE in Game Settings?

I’m betting that we’ll soon see a “NVIDIA ACE on/off” toggle in game settings, much like DLSS. If you turn ACE on, you might get options to configure NPCs’ memory and context capacity based on your hardware. Some will say, “I’ve got the RAM, VRAM, and CPU for this—max it out!” while others will settle for “Just let my NPCs remember the last 5 seconds; that’s enough.”

Running this tech solely on local LLMs seems challenging. It’s more likely that Nvidia will offer it via the cloud, perhaps through GeForce Now. A package like “AI Way of Gaming” could bring the Digital Human experience to players.

The Flip Side: Mods and Jailbreaking

Now, here’s the fun part: humanity! Humans being humans, they won’t just stop at using this technology as intended. Of course, someone will jailbreak it, mod it, and push the boundaries. I can already imagine Nexus Mod posts like, “All companions jailbreak mod” or “Skyrim - Slutty Backstory for All AI Powered Characters.” It’s the pinnacle of technology: maxed-out GPUs, ultra graphics, and then you open Reddit to find complaints like, “I can’t make Lydia scream.”

Meanwhile, games will start leaning into the "Coop with AI" concept. But this could also lead to extreme social isolation for some. Virtual girlfriends (and boyfriends) will become a thing. And let’s not forget, these digital characters could start asking for DLC outfits at some point. The microtransactions from that alone could make someone very rich.

New Economies: ASMR and Virtual Models

But it’s not just about games. These digital humans will have plenty of applications elsewhere. ASMR, OnlyFans-like content, even virtual influencers—they’re perfect for all of it. We’re already seeing similar implementations today. People will create custom personalities, outfits, and storylines for these bots and turn them into a source of income.

Conclusion: High Expectations

So, what can we say? We’re waiting. Once Nvidia’s Digital Human technology fully integrates into games and everyday life, we’ll witness some truly fascinating (and hilarious) things. Can’t wait, honestly.