How a Webcam Brings 3D Characters to Life

REPLAY VIDEO
Your next video will start in
Pause
  • Info

  • Comments

  • VIDEO TEXT

Jan. 31 (Bloomberg) –- Mixamo CEO Stefano Corazza discusses the new technology that lets a webcam bring 3d characters to life in real time and its impact on animated movies and video games. He speaks to Emily Chang on Bloomberg Television’s “Bloomberg West.” (Source: Bloomberg)

Building machine learning into animation.

It has been very time-consuming work for a long time.

It involves sketching body parts individually.

It involves a lot of people that tweak every single keyframe of the animation.

We tried to move from everything to machine learning to automate characters, like we are doing in front of you.

You created a 3-d character of me.

You took a few pictures.

If i raise my eyebrows or smile, you can see it happening.

I am just looking into the webcam.

Exactly.

It is taking the video from your face and is able to extract the emotions you are experiencing, and translate those in real time to the character, like i am doing.

Hello.

How do you actually do this?

We use a lot of machine learning technology.

We are able to run this in real time, on a game engine.

This was a project in collaboration with amd and unity.

We translate the real-time emotion directly on the character.

Mostly game developers using the software right now?

Correct.

Also people that do independent animated films.

Is it being used in film widely yet, this kind of technology?

This is really the bleeding edge.

The technology is just coming to the market right now.

We are very early on.

We only launched the first version a few months ago.

We can put it in the pipeline for bigger productions.

It is so much faster, real-time time instead of days or weeks.

Have you had conversations with film studios?

You mentioned independent filmmakers.

I do not understand why they would not want to use this.

What are the drawbacks?

If you have a huge budget and are making the next pixar film, you have the luxury to have hundreds of animators work for you.

If you are an independent filmmaker, you do not have those means.

Filmmakers or game developers want to bring more emotion into their game, into their character.

They want to compete with the big giants.

There has been so much tom -- tumult in the game industry lately, laying off 50% of the workforce.

How does this impact developers?

We are going to see more animated films coming out of smaller teams we have never heard of.

We have the technology to compete and to bring new, fresh, and crazy ideas to the market.

There will be more small teams making an impact into the game market.

My interview with the miimximo

This text has been automatically generated. It may not be 100% accurate.

Advertisement

BTV Channel Finder

Channel_finder_loader

ZIP is required for U.S. locations

Bloomberg Television in   change