Man Vs Baby
After meticulously crafting the fully CG co-star in Man Vs Bee, Framestore is excited to return with Rowan Atkinson to bring new chaos to the screen in Man Vs Baby, directed by David Kerr.
Man Vs Baby is the highly anticipated follow-up Netflix series to Man Vs Bee, reuniting us with Trevor Bingley (Rowan Atkinson). This season required Framestore to achieve unfaltering, photorealistic integration of a baby - unlike the fully-controlled CG bee from the first series, the VFX task this time round was exponentially harder because the CG baby had to intercut with real-life twin babies.
As a creative partner, Framestore, led by Ashlee Turner (Overall VFX Producer) and Rob Duncan (Overall VFX Supervisor), established an integrated and highly collaborative relationship with the production team. Their communication extended beyond mere technical fulfillment, involving weekly reviews and meetings with the showrunners, director, and writers. This unique position allowed Framestore to offer creative solutions designed to enhance the edit and maximize the comedy. "We were offering up solutions creatively that would make the VFX better,” Ashlee Turner noted: “It's rare that we get a say in the action, but we were able to make suggestions to make the edit better or funnier." This high degree of creative trust was fundamental to the success of the series' visual gags.
The core challenge was the shift from a pure CG asset (the bee) to a hybrid digital double workflow, necessitated by the unpredictability of the infant actors. This involved replacing one of the hero twins with the other for consistency within a scene, and implementing a head-replacement pipeline for 'stunt babies' when demanding physical action like crawling was required. To overcome the Uncanny Valley curse and ensure the baby's digital likeness was consistently photorealistic, Framestore used a proprietary Machine Learning (ML) system known as Façade, Framestore's ML umbrella platform specifically focused on digital human work. This ML-driven approach ensured that the digital head seamlessly matched the plate photography allowing the artists to focus on the subtle, non-intentional movements that define a baby's realism.
A second sub-tool called Façade Re-age was used solely on the character Trevor Bingley for some subtle de-aging work in the opening flashback scene. Theo Jones, Framestore’s Creative Director: “Man Vs Baby became the first production to utilise Façade's sub-tool called Façade Swap: this allowed the team to do a number of things including changing the baby’s in-camera performance to whatever was required for the scene, swapping one twin’s likeness for the other twin for scene continuity and replacing the face of the ‘stunt baby’ with the hero baby during complex action sequences like climbing stairs.” Facade Swap and Facade Re-age are both trained on-premises inside Framstore’s secure environment using proprietary code and datasets that have been cleaned and legally cleared for use. Models are restricted to the actors they were trained on and not reused for other projects, therefore maintaining full GDPR standards.
VFX Supervisor Rob Duncan highlights the cognitive challenge: "Human beings are really good at recognising faces, even of people they’ve only seen once. So, it's a lot more objective than it is subjective. It's not, "Oh, I think that field should be a little less green and the sky a little more blue. It’s, does that look like the baby I just saw in the shot before?” The successful delivery of the photorealistic baby in Man Vs Baby demonstrates the synergy between cutting-edge technology and human artistry. While the Façade tools were a breakthrough, they served as a crucial accelerator, not a replacement for the team. Rob Duncan explains, "The technology is not a magic bullet as it still needs careful input from the same group of people who know what the end goal needs to be. But it did mean that we got our likeness a lot faster, and it made a huge difference in terms of locking in that likeness early enough in the process so we could concentrate on other aspects of the shots." The effective, production-first deployment of the Façade platform established a powerful, reusable pipeline for high-fidelity face work, allowing Framestore's artists to more easily achieve an essential photorealistic foundation and therefore dedicate more of their time to the subtle, final nuances of performance and integration.
A major theme carried over from the first series is Trevor Bingley's chaotic interaction with high-end architecture, but the setting has drastically changed, presenting a new level of environmental complexity. For Man Vs Baby, the location is a large central London penthouse apartment overlooking St. James's Park. This required Framestore to manage the dynamic, high-fidelity light and reflections of a real cityscape view across different times of day and weather conditions - something that a Translight is not really designed to achieve.
To solve the environmental integration and lighting challenges, a Virtual Production approach was undertaken, a marked departure from the previous season's problematic Translight with its inherent limitations.
A massive, custom-designed, hockey-stick-shaped LED screen (approximately 27m x 7m) was built to wrap around part of the set, displaying the view of St. James's Park. This approach offered a huge saving on the backend in post-production because the views were already baked into the footage. It's estimated that a traditional bluescreen setup would have resulted in roughly 230 additional compositing shots. With the LED wall, the on-set team achieved about 85% in-camera success rate, with only about 15% of shots needing touch-up or replacement. Crucially, the LED screen doubled as a light source, allowing the Director of Photography to use it as part of the lighting scheme. Its use immediately solved the compositing nightmare of reflections in the apartment's numerous shiny surfaces and mirrors, delivering realistic, interactive lighting and reflections that would have been cost-prohibitive to fake in post. The system allowed for dynamic elements, such as on-screen snow layers for the end scene, and provided the actors with a realistic environment, enhancing their performances.
The opening of the series, which takes place at Christmas time presented a contrasting environmental challenge requiring extensive environment extension work including adding Christmas decorations across various shots to enhance the feeling of the holiday. While SFX snow was used on set for areas where actors interacted with the ground, Framestore was responsible for creating the vast, realistic winter vista.
"As Trevor lives in the countryside we had to do a lot of environment work," said Rob Duncan. “There was enough practical SFX snow to cover the foreground, but to create a wide vista looking over the fields, meant creating it all in post."
This involved extensive digital matte painting and 3D environment extension to ensure seamless integration of the practical snow effects on the ground with the vast, realistic digital winter landscape in the background.
Framestore's visual effects successfully complemented the comedy not by imposing performance, but by prioritising subtlety and naturalism, focusing on consistency rather than creating the joke itself.
Rob Duncan commented: "An unnatural performance could be the joke killer, so we've tried to keep it as tamped down and believable as we can get away with, but still serve the story."
The success of the on-set babies, who often delivered spontaneous, natural reactions that entirely matched the ongoing narrative, meant Framestore's primary task was to ensure unbroken continuity when the CG baby was inserted. This focus on seamless realism ensured the audience's disbelief remained suspended, allowing them to focus entirely on the comedic setup.
The VFX team only departed from strict realism for specific, high-slapstick moments required by the script: "In one scene the baby gets ejected out of the chute, added Rob Duncan: “You have to suspend your disbelief for that moment, because we know that the audience knows we would never do that to a real baby!”
Man Vs Baby successfully delivered the high-stakes comedy of a Rowan Atkinson show while simultaneously setting a new benchmark for photorealistic digital human work in episodic television. The complex, reactive workflow driven by the need for consistency across infant actors and the integration of 'stunt babies' was made possible by Framestore's technological investment. The successful, production-first deployment of the Façade ML toolset established a powerful, reusable pipeline for high-fidelity face work showcasing the integration of high-end Machine Learning (ML) into the traditional VFX pipeline.
CREDITS
