MIXED REALITY COMPOSITING
THE PROCESS
There are a couple steps involved with creating mixed reality content. For some scenes the athletes would actually be playing the application, for others, they would just be acting. For both cases, the shot would need to be planned out to make sure any parts of the environment or UI would be captured in the shot when animating in post.
When capturing the raw footage, I would cover the CYC greenscreen wall with tape (tracking points) to recreate a virtual camera in the 3D scene. The athlete would then be rotoscoped and keyed to isolate them from the background. Lastly, the in-game assets (pitchers and UI) were hand animated to match the athletes movements, followed by a color correction pass to blend each athlete with their new virtual environment.
