Vicon Adds Lifelike Movement to Epic Games’ Real-Time Digital Character ‘Siren’

Created for Tencent with Technology from Cubic Motion and 3Lateral to Push the Boundaries of Digital Avatars; GDC Demonstrations Held at Vicon’s Booth, South Hall #241.

OXFORD, UK
March 21, 2018

During its Game Developers Conference (GDC) keynote address, Epic Games today unveiled “Siren,” a high-fidelity, full performance character driven in real-time. Recreating the subtle intricacies of movement can be the difference between a realistic digital recreation and a trip into the uncanny valley, so Epic enlisted the real-time capture abilities of its partner Vicon, the industry leader in motion capture, to bring this project to life.

 

The real-time presentation displayed during Epic’s keynote was previously recorded on Vicon’s capture stage at its headquarters in Oxford, England. To create the video, actress Alexa Lee wore a full body motion capture suit with a head-mounted camera. Using Vicon’s new Shōgun 1.2 software, her body and finger movements were captured on one screen while the data was streamed into Unreal Engine using Vicon’s new Live Link plugin. On a second screen, the Siren character – created using the likeness of Chinese actress Bingjie Jiang – moved in sync, driven in-engine at 60 frames per second.

To ensure the highest possible fidelity, Vicon solved directly onto the Siren custom skeleton, removing the complex targeting step. It also developed a new algorithm to help realistically animate the fingers.

 

“When we began working on Siren, we knew from the beginning that it was going to push several boundaries. To make this possible we needed the best motion capture hardware and software,” said Kim Liberi, Epic Games’ CTO. “We use Vicon systems on our own stage, so we knew right away that they were the best choice for this project.”

 

The Siren project began as a collaboration between Epic and Tencent, with the goal of creating a proof-of-concept demonstration to show both the capabilities of Unreal Engine 4, and what the next generation of digital characters will look like. To handle the performance capture for the character, Epic and Tencent utilized Vicon’s Vantage optical motion capture system, Shōgun and VUE video cameras to capture precise and authentic movement and to add the character animations over the reference footage in real time.

Along with Vicon, Epic and Tencent turned to Cubic Motion to provide the facial performance capture, tracking, solving and animation. Cubic Motion also provided a live solver, taking the video feeds of the actress’ performance to drive the CG in real time. The character’s facial rig and underlying controls were both provided by 3Lateral, which also handled all of the 3D and 4D scans of the actress.

 

“To create a realistic digital character requires more than just tracking movements, you need to be able to isolate and mimic everything down to the most minute details,” said Tim Doubleday, Vicon VFX Product Manager. “There have been some incredible attempts to create realistic digital avatars recently, and so when Epic approached us, we were eager to get involved and help push the field even further.”

 

The Siren project will be on display throughout GDC at Vicon’s booth, located in the South Hall booth #241. Demonstrations featuring Alexis Lee will be held on Wednesday, March 21 and Thursday, March 22 from 10 a.m. to 1:30 p.m.

About Vicon

Academy Award®-winning Vicon is the world’s largest supplier of precision motion capture and tracking systems. It serves customers in the CG animation, object tracking, virtual and augmented realities, engineering, broadcast, biomechanics, sports and clinical sciences arenas.

Vicon is a subsidiary of Oxford Metrics (LSE: OMG), the international software company servicing government, life sciences, entertainment and engineering markets. Other holdings include: Yotta, a provider of software and services for infrastructure asset management.

Amongst many others, Vicon global clients include:

Entertainment: Framestore, Audiomotion, The Imaginarium, Quantic Dream, Ninja Theory, Konami, Activision, Sony, Dreamworks, ILM, USC, EA, Capture Lab, 2K Games, CD Projekt, Digic Pictures, IO Interactive, Creative Assembly, Plarium Games, Mocap Lab, Seasun

VR: Artanim, VR Tech, Dreamscape VR, Canon, Samsung

Broadcast: Vizrt, hunan TV

For more information about Oxford Metrics and its subsidiaries, visit: www.oxfordmetrics.com, www.vicon.com or www.yotta.co.uk.