Sony Corporation Announces Development of Spatial Content Creation System, Equipped with High-Quality XR Head-Mounted Display and Controllers Dedicated to Interaction with 3D Objects

    Published on:

    – Metaverse technology and hardware that supports 3D content creators –



    January 8, 2024

    /PRNewswire/ — Sony Corporation announced the development of an immersive spatial content creation system that includes an XR head-mounted display with high quality and high resolution.


    OLED micro display


    Video see-through capability and a pair of controllers optimized for intuitive interaction and precise pointing with 3D objects. This is a system that supports creators in creating advanced 3D content. Sony plans to collaborate with a variety of 3D production software developers, including those in the entertainment and industrial design fields. For the launch, Sony will partner exclusively with industrial technology leader Siemens to introduce new solutions for immersive design and collaborative product engineering using the Siemens Xcelerator open digital business platform software.

    The system is expected to be available in late 2024. Sony and its partners are expected to announce details such as specifications, release date and regions, pricing, sales channels, and software compatibility.

    A spatial content production system equipped with an XR head-mounted display.


    Using an OLED microdisplay and Sony's unique rendering technology, 3D object textures and human facial expressions can be rendered in real time in high definition and realistically. In addition to the video see-through function and spatial recognition using a total of six cameras and sensors, the creator's head-mounted display is equipped with a ring controller that allows you to intuitively manipulate objects in virtual space, and a pointing controller that allows accurate pointing. You can craft in virtual space using the controller and keyboard while wearing the . Creators can not only see a life-size 3D model of him in an augmented reality (XR) environment with a high-definition display, but also create and modify her 3D model within it. Integration with third-party 3D creation applications also supports remote real-time review between locations, making it an intuitive and immersive tool for the entire spatial content creation process.

    The device is powered by Snapdragon


    The XR2+ Gen 2 platform is Qualcomm Technologies, Inc.'s latest XR processor. This processor is


    OLED microdisplays not only deliver stunning image quality, but also provide user and spatial tracking for a seamless XR experience, giving creators a high-performance platform for their creative workflows.

    Sony has announced technologies that support the workflow and quality of spatial content production and promote the use of 3DCG in various creative fields. “mocopi™” is a mobile motion capture system equipped with a small, lightweight sensor and a dedicated smartphone app.


    , Sony's proprietary technology enables full-body motion tracking. Spatial reality displays provide highly realistic three-dimensional content for the spatial content creation and review process without the use of special glasses or virtual reality (VR) headsets.


    . By introducing this system and collaborating with 3D creation software developers, Sony aims to enable spatial content creators to transcend the boundaries between the physical and virtual realms and achieve more immersive creative experiences. I am.

    System used for video production using 3D technology

    “Siemens is partnering with Sony to enable immersive engineering, a critical component of the industrial metaverse. Together, we will work with no time limit to significantly improve our customers' methods. We're building an environment where you can experience the reality of physics.'' Work and collaborate.''

    Cedric Neike

    Member of the Board of Management of Siemens AG and CEO of Siemens Digital Industries.

    “Our Snapdragon XR2+ Gen 2 is


    “Display resolution, cutting-edge graphics, and unparalleled performance enable creators to build innovative spatial content that transforms every industry for the better,” said Saeed Bakadir, Senior Director of Product Management, Qualcomm Technologies. says Mr. Enter the enterprise space with a spatial content creation system that leverages Snapdragon Let's move forward. ”

    Major features

    High-quality XR experiences for creative applications

    The head-mounted display is equipped with a large, high-definition 1.3-inch organic EL microdisplay.


    Up to 96% DCI-P3 resolution and wide color gamut


    . Detailed and realistic rendering of 3D object textures and human character facial expressions allows creators to see the entire modeling process while wearing a head-mounted display.

    By supporting split rendering


    A system that distributes the drawing load between the computer and the head-mounted display enables stable, high-definition drawing of large 3D models.

    Through collaboration with Qualcomm Technologies, Inc., Sony was an early adopter of the latest Snapdragon XR2+ Gen 2 platform. Processor releases power.


    OLED microdisplays deliver stunning image quality, and on-chip AI enables enhanced user and space tracking for a seamless XR experience, blending physical and digital spaces to create images within your XR creative space. provides easy navigation and intuitive interaction.

    A controller that provides an intuitive spatial content creation experience

    Equipped with a ring controller that allows you to intuitively manipulate objects in virtual space. It also comes with a pointing controller that enables stable and accurate pointing in virtual space, and the shape and button placement have been optimized to achieve efficient and accurate operation. By holding a pointing controller in his dominant hand and attaching his controller to the fingers of his other hand, the creator can model his 3D objects using both the controller and keyboard while wearing his head-mounted display. can.

    Intuitively operate objects with the ring controller

    Designed for comfort for a seamless XR creative experience

    Head-mounted displays achieve the comfort and stability required for long-term creative use by fine-tuning the balance of the device's center of gravity and the design and material of the pad that comes in direct contact with the head. In addition, the flip-up display mechanism allows creators to easily and seamlessly move between physical and virtual spaces without having to readjust the device when removing and putting on the entire device.

    Immersive creative experience with integration with 3D creation software

    Sony aims to collaborate with various 3D production software developers in both the entertainment and industrial design fields. For the launch, Sony has partnered exclusively with Siemens to bring innovative immersive engineering capabilities to the manufacturing industry through integration with the new NX™ Immersive Designer software, a product engineering solution from the Siemens Xcelerator portfolio of industry software. Offers. Powerful hardware and software integration provides more immersive design, review, and collaboration tools to empower creators in industrial design and product engineering. A video of the immersive spatial content creation experience through this partnership can be viewed on the following webpage. The link will take you to the official Siemens Digital Industries Software Youtube channel.

    *1: The images shown are for illustration purposes only and may differ from the actual product.

    *2: As the capacity of the device. Actual resolution will vary depending on application and usage.

    *3: Please download the app from Google Play or App Store. Network services, content, operating systems and software are subject to terms of use, may be modified, suspended or discontinued at any time, and may require fees, registration and credit card information. Your use of third-party services or apps may require registration with and/or acceptance of license agreements, privacy policies, and other terms and conditions. Sony is not responsible for any third party websites, services or apps. Features and specifications are subject to change without notice.

    *4: A computer equipped with the recommended CPU of Intel Core i7 is required.


    @3.60 GHz or higher. NVIDIA GeForce RTX 2070 SUPER or higher graphics card. Only Windows 10 (64-bit) is supported. We recommend using “high resolution, high quality images” created with Unity or Unreal software

    *5: DCI-P3: RGB color space standard developed by Digital Cinema Initiatives, an American consortium working to standardize digital cinema systems.

    *6 The actual color space that can be used varies depending on the application and usage type.

    *7: When used in tethering mode, it only works with compatible applications. (Wired/Wireless) Resolution, refresh rate, and color space may vary depending on the application.

    * “Sony”, the “SONY” logo, and other product names, service names, and logo marks used in this press release are registered trademarks or trademarks of Sony Group Corporation or its affiliated companies. All other product, service, company, or logo marks are trademarks and copyrighted properties of their respective owners and/or licensors.

    View original content and download multimedia. Controller dedicated to interacting with 3D objects – 302029127.html

    Source Sony Electronics Corporation


    Leave a Reply

    Please enter your comment!
    Please enter your name here