Sony – XYN Spatial capture solution
By combining the Disguise virtual production platform with Sony – XYN Spatial capture solution, you can bring high-quality 3DCG assets from real-world spaces into your virtual production workflow. These assets can then be displayed reliably on an LED wall with consistent, high-quality results.
This solution uses Sony’s proprietary 3DCG generation technology. Its 3D Gaussian Splatting-based rendering algorithm reproduces the texture and depth of real environments. Even with transparent objects or complex scenes rich in information about distance and lighting conditions, it can generate and render highly realistic 3DCG assets. This makes it well-suited for the high-quality background rendering required in virtual production.
 |  |
|---|---|
| Capture the real world and generate 3DCG assets | High-quality projection onto the LED wall |
Using with Disguise
Section titled “Using with Disguise”Supported Disguise Solutions
- Director: GX 3, GX 3+, VX 3, or VX 4+
Note: While any VX or GX server is compatible, complex scenes may encounter bandwidth limitations due to the 25 Gb network interface card. - Renderer: RX III
- Disguise Designer: r32.3.3 or later
Supported Unreal Engine Versions: 5.4, 5.5, 5.6
For instructions on how to use the XYN Spatial Renderer Plugin, please refer to the XYN support page.
For instructions on how to configure and use RenderStream, please refer to our RenderStream - Unreal Engine documentation.
Benefits of Integration
Section titled “Benefits of Integration”Efficient 3DCG Content Production
Section titled “Efficient 3DCG Content Production”XYN Spatial capture solution streamlines the process of converting real-world spaces into 3DCG assets, reducing the workload required to create background content for XR and virtual production. Capturing an existing location makes it possible to create assets much faster than traditional workflows that require extensive 3D modeling and texture work. This improves production efficiency and shortens content creation time. When used together with Disguise, the created assets can be deployed more smoothly into actual virtual production environments, helping establish a workflow designed for practical use on set.
Expanded Use of Real-Location Content
Section titled “Expanded Use of Real-Location Content”Because real urban spaces, buildings, and indoor environments can be incorporated as background assets, the use of real-location content in XR stages and large-scale LED productions can be significantly expanded. This makes it easier to bring a wider variety of spatial expressions into productions, including environments that were previously difficult to prepare because of cost constraints.
More Realistic XR Production
Section titled “More Realistic XR Production”The real-world 3DCG assets generated with XYN reproduce fine shapes and details with high fidelity and a natural appearance, enhancing the realism of visual expression in XR stages and virtual production. This enables more immersive experiences for audiences and viewers and improves the overall expressive quality of live events and video production.
What is XYN Spatial capture solution?
Section titled “What is XYN Spatial capture solution?”XYN Spatial capture solution is designed to create high-quality 3DCG assets from real-world objects and spaces. It improves the efficiency of 3DCG production workflows for applications such as movie and game props, metaverse content, and background assets for virtual production. It currently provides functions mainly for virtual production, including In-Camera VFX and green screen workflows, enabling efficient use of production-quality 3DCG assets.
The XYN Spatial capture solution consists of the following applications:
1. XYN Spatial Scan Navi
Section titled “1. XYN Spatial Scan Navi”XYN Spatial Scan Navi is a smartphone application that supports the capture of spatial content using a mirrorless camera.
2. XYN Spatial Scan
Section titled “2. XYN Spatial Scan”XYN Spatial Scan is a cloud application that converts real-world spaces into high-quality 3DCG assets. After captured data is uploaded, Sony’s proprietary algorithms generate 3DCG assets with high resolution, accurate colour reproduction, and HDR expression.
3. XYN Spatial Renderer Plugin
Section titled “3. XYN Spatial Renderer Plugin”XYN Spatial Renderer Plugin is a renderer plugin that enables stable, high-quality display. When used together with the Disguise solution, it allows production-grade 3DCG assets created with XYN to be displayed and captured on an LED wall as intended, with stable, high-quality results.
By combining these applications, you can manage the entire workflow consistently, from generating high-quality 3DCG assets for production use to reviewing and using them in the production environment.
For more information, see here.
“Sony”, “SONY” logo and any other product names, service names or logo marks used in this Web Site are registered trademarks or trademarks of Sony Group Corporation or its affiliates. Other product names, service names, company names or logo marks are trademarked and copyrighted properties of their respective owners and/or licensors.