Meta has updated its VR framework to add tracking of avatar tongue movements. This development is part of the company's efforts to enhance facial recognition capabilities within virtual reality, with the aim of delivering more lifelike avatars through accurate voice and facial expressions.
The latest update to Meta's virtual reality (VR) technology introduces tongue tracking to Meta Quest Pro's existing facial recognition capabilities. This change represents a technological development in VR and aims to reflect more aspects of real-world interactions within the virtual environment.
The concept of tracking facial movements in VR is not new. However, according to his X post on Upload VR, the addition of tongue movement is a new development. This feature aims to enrich the expressiveness and communication of VR avatars, potentially making virtual experiences more immersive by closely replicating a wider range of human facial expressions.
Quest Pro now has tongue tracking.https://t.co/NomzECo2tJ
— UploadVR (@UploadVR) December 19, 2023
Combination of advanced features and user practicality
With the latest updates, the headset faced the unique challenge of balancing functionality with practical ease of use. The addition of tongue tracking raises questions about the readiness and usefulness of such advanced features for everyday VR use. Current limitations in integration, especially within Meta's own Avatar SDK, further complicate this situation and suggest the need for broader application and developer support.
The introduction of advanced facial tracking, including tongue movements, is a call to action for the broader VR community. It emphasizes the importance of software development that can effectively utilize these functions. As a TechRadar report suggest, the potential of this technology can only be fully realized if it is supported by a variety of applications beyond its initial showcase. This puts the onus on both meta and third-party developers to take advantage of these new features and make VR experiences more than just technical showcases.
Microsoft's role in VR productivity
In parallel development, Microsoft and Meta collaborate to bring Office 365 applications to the Quest platform.this move This indicates a shift in the scope of VR applications from primarily entertainment-oriented to productivity-oriented. Integrating applications such as Word, Excel, and PowerPoint into virtual reality platforms adds features such as hand tracking and virtual keyboard input, reflecting a perspective on the usefulness of VR in professional and office environments.
This development signals a shift in the way we view VR technology in terms of its applicability beyond entertainment and gaming, and explores its potential role in more traditional productivity-oriented environments. Suggests.
Expected integration microsoft team Its introduction to the Quest platform further demonstrates the potential of VR in collaborative and remote workspaces. This points to a future where VR technology will play a role in workplace collaboration and communication when combined with existing and upcoming features such as Horizon Workrooms and Microsoft Mesh.
Abhijit Srikanth, Partner Engineer, Reality Labs at Meta, emphasizes:
“The addition of these apps to Quest opens up a wide range of possibilities for on-the-go productivity, with features like 2D screens on panels scaled in infinite space, all in virtual or mixed reality. Quest provides easy multitasking options and supports input from Bluetooth mice and keyboards. We look forward to even more productivity improvements with Quest and further collaboration with Microsoft.”
While Meta's introduction of tongue tracking to VR avatars is a technological milestone, it also highlights the challenges in widespread adoption and commercialization of advanced VR features. As VR continues to evolve, there will likely be an increased focus on creating experiences that are not only technically superior, but also broadly applicable and user-friendly.