MoCap Solutions & DI4D team up to deliver high-resolution 3D facial image capture and 4D facial performance capture systems, software, and services.
Dimensional Imaging (DI4D) is a world leading facial performance capture company established in 2003. Providing high fidelity facial data for triple A video games, movie and TV projects, and research work within the facial surgery, psychology, and orthodontics sectors, customers return time and again for high-quality facial performance capture.
DI4D Pro System – Markerless High-Fidelity Facial Motion Capture
The DI4D PRO System captures sequences of high resolution, color 3D facial performance data using digital video cameras. DI4D PRO Systems use only standard video lighting and do not require any markers, makeup or structured light projection.
DI4D PRO Systems are supplied with one or more “pods” of three cameras: two monochrome and one color. Typical systems employ 2 pods (6 cameras) or 3 pods (9 cameras) using synchronized cameras with resolutions of either 1600 x 1200 pixels or 2048 x 1536 pixels, capturing at up to 60 fps. By using “stream-to-disk” technology, the sequence length is virtually unlimited.
Captured video sequence data is post processed using DI4D dense passive stereo photogrammetry software and then a fixed topology mesh can be tracked through the sequence using DI4D optical flow tracking software. The result is the capture of incredibly realistic, extremely dense, facial animation, with much more of the subtlety and nuance of facial performance than alternative approaches.
Customers such as Electronic Arts, Sony Computer Entertainment, Remedy Entertainment, University of Glasgow and University of Texas Southwestern Medical Center, use DI4D PRO Systems to produce high fidelity facial data for triple A video games, movie and TV projects, and research work within the facial surgery, psychology, and orthodontics sectors.
“By using DI4D’s facial performance capture solution combined with Remedy’s Northlight storytelling technology, we can ensure that every nuance of the actors’ performances are captured on screen.” – Sam Lake, Creative Director, Remedy Entertainment
DI4D High Definition Facial Motion Capture – HMC (Head Mounted Camera System)
The DI4D HMC (Head Mounted Camera) System is the world’s first commercial head mounted camera system to use passive stereo photogrammetry. It is designed to deliver similar fidelity of data as the DI4D PRO System, but using a mobile capture system that moves with the performer.
The DI4D HMC System consists of a lightweight, easily adjustable head rig fitted with two small synchronized high-resolution digital video cameras, four small LED lights, a compact video recording system, and battery pack. By using “on-the-fly” per frame JPEG compression and “stream-to-disk” technology, high-quality stereo video sequences of virtually unlimited length can be captured at up to 60fps.
A remote PC provides a live preview of the video streams from the cameras and allows recording to be started and stopped remotely.
Captured video sequence data is post processed using DI4D dense passive stereo photogrammetry software and then a fixed topology mesh can be tracked through the sequence using DI4D optical flow tracking software. The DI4D HMC System is, therefore, able to combine the high fidelity of DI4D facial performance capture with the freedom of movement and convenience of untethered capture. The result is the capture of incredibly realistic, extremely dense, facial animation, combined with the efficiency, cost effectiveness and acting benefits of full performance capture.
DI3D System – High Fidelity 3D Facial Image Capture
Di4D’s facial image capture system is a passive stereo photogrammetry based solution for the creation of accurate, ultra-high resolution, full color 3D surface images using standard digital stills cameras.
Used by companies across the entertainment sector such as EA Games and Valve Corporation, the DI3D system is also used to capture a highly accurate 3D facial likeness of athletes on the FIFA series of video games.
The System is also used on numerous research projects within the facial surgery, orthodontics, psychology, cosmetics and facial recognition sectors.
Their software will not only enable you to capture and view the data but also provide specialist analysis, re-meshing and texturing – the result provides a simple, fast and efficient workflow.
DI4D Processing Software
The facial performance capture solution is based upon proprietary world leading passive stereo photogrammetry software.
This allows a stereo pair of images captured with a calibrated pair of cameras to be processed automatically to derive a dense 3D model, with a 3D point calculated for every foreground pixel. This process does not require any markers, makeup, structured light or random dot projection. Synchronized video cameras are used to capture sequences of stereo pairs of images at up to 60 fps (and even up to 1,000 fps with a custom camera system), which can then be processed to recover automatically a sequence of 3D models.
DI4D Tracking Software
DI4D Tracking Software allows a discrete set of landmarks or a fixed topology mesh to be tracked through a sequence of data previously processed using the DI4D Processing Software.
A discrete set of landmarks or a fixed topology mesh can be applied to one reference frame in the sequence, usually with a neutral facial expression, and then tracked through the sequence using the pre-computed optical flow maps. Tools are provided to allow drift in the optical flow tracking process to be corrected. A tracked set of discrete landmarks can be output in standard motion capture C3D format, while a tracked mesh can be output as a vertex cache compatible with third party software tools such as 3DS Max, Maya and Lightwave.