Register

    Rise of the Machine Learning: How AI Helps Create Photorealistic Digital Humans

    By SPWUpdated:No Comments7853 Views
    Creating realistic digital humans in film and television is known as the final frontier of visual effects. It typically takes thousands of hours and hundreds of artists to create a virtual human that contains all the physical details of a real-life person. With machine learning, Digital Domain has sped up the process while achieving an unprecedented level of photorealism in their characters.

    Using NVIDIA RTX and Unreal Engine, Digital Domain creates realistic virtual characters that capture emotions and actions in real time.

    Santa Clara, CA -- (SPW) --

    Meet DigiDoug, the first digital human to give a TED talk in real time. 

    DigiDoug is the virtual version of Dr. Doug Roble, senior director of Software R&D at Digital Domain, the award-winning visual effects studio behind the characters and visual effects for movies like The Curious Case of Benjamin Button, Maleficent, Disney’s The Beauty and the Beast and Avengers: Endgame. 

    Roble and Digital Domain’s Digital Human Group have presented DigiDoug at multiple events, showcasing their state-of-the-art digital human technology that’s driven by an inertial motion-capture suit and a single camera capture for facial animation. 

    But to capture and recreate emotions and actions in real time, the Los Angeles-based studio turned to more powerful and advanced technology: machine learning and real-time rendering.

    With NVIDIA RTX technology and Unreal Engine from Epic Games, Digital Domain is bringing photorealistic digital humans to life — all in real time.

    The Machine (Learning) Behind Digital Humans
    Creating realistic digital humans in film and television is known as the final frontier of visual effects. It typically takes thousands of hours and hundreds of artists to create a virtual human that contains all the physical details of a real-life person. 

    With machine learning, Digital Domain can speed up the process while achieving an unprecedented level of photorealism in their characters.

    To create DigiDoug, Digital Domain integrated machine learning into its creative process, but needed enormous amounts of data for the technique to work. So they started by taking thousands of images of Roble’s face using different angles and lighting stages to capture as much data as possible.

    The team built a deep neural network that would take those images and learn all the details about Roble’s face — from the mix of expressions to physical details — so it could compute all the information that would allow DigiDoug to act like a real person. 

    DigiDoug is then rendered in real time using NVIDIA RTX technology and Unreal Engine, the game engine developed by Epic Games. Roble’s movements and expressions are captured using a special motion-capture suit and camera. That data is transferred to the machine learning software, and then translated to the rendered digital human in real time. 

    “Capturing all the details is what makes the digital human realistic,” said Roble. “What’s cool about machine learning is you can teach it to get better. With NVIDIA and Epic Games, Digital Domain is building the technology that allows artists to create the most photorealistic digital humans possible, and it’s all happening in real time.” 

    For more information, watch the recent panel at SIGGRAPH on “Progress Towards Real-Time, Photorealistic Digital Humans,” moderated by Danielle Costa, vice president of visual effects at Marvel Studios. In addition to Roble, the talk features Simon Yuen, director of graphics at NVIDIA, and Vladimir Mastilovic, director of digital humans at Epic Games, who discuss the journey of digital humans and where the technology is headed.

    Learn more about the latest NVIDIA technology by watching on-demand sessions or developer talks from SIGGRAPH.

    company

    Gail Laguna
    Nvidia
    Contact via email
    SPW Category:Filmmaking Products and Services
    Tags:Dr. Doug Robledigital humanDigiDougDigital DomainNVIDIA

    Liz Charky Directs a Playful and Reflective Video For Henry Hall’s “Tiny Door”

    Thursday, November 14, 2024
    Henry Hall - Tiny Door

    Directed by Liz Charky, the music video for Henry Hall’s ‘Tiny Door’ is a playful and profound exploration of the song’s intriguing perspective on love. Silly moments and serious heartbreak are skillfully weaved together in a series of cheeky, dreamy, profound, and sometimes psychedelic scenes. “I am a huge fan of love songs that have an unusual, hyper-specific perspective on love,” says Hall. “That’s what I wanted to do with ‘Tiny Door.’ It’s about loving someone unconditionally while recognizing that love is something that isn’t always straightforward — I think that’s something we all attempt to come to terms with in our lives. I thought it was a unique yet universal detail about love and therefore an intriguing subject matter for a song. Even though the song is a ballad at its core, it still has a lighthearted sense of humor to it — that’s really portrayed well by Liz, and Ellin Aldana, our cinematographer.” Charky explains, “When I first listened to the song, I felt it was a love song full of longing with a kind of wishful melancholy. As I spoke with Henry about his intention behind the lyrics and sound, I was assured that I'd need to explore heartbreak in a nuanced way – with a degree of levity and playfulness. For me, falling in and out of love runs the full course of human expression. Love and heartbreak can be so emotionally intense and sometimes lonely, other times quite goofy or liberating. In developing the concept, I focused on both the literal and figurative ways that falling in and out of love might look like. So, you see Henry and co-star Franny Arnautou falling, flying, dancing, raging, winking, smiling, and... Read More

    MySHOOT Profiles


    Add A Comment