What's Happening?
Meta has advanced its Codec Avatars technology, enabling the rendering of three full-body avatars in real-time on the Quest 3 headset. This development marks a significant step in virtual reality, aiming to enhance social presence by creating photorealistic digital representations of humans. The technology leverages Gaussian splatting for realistic volumetric rendering, similar to how large language models have improved chatbot interactions. Despite the progress, the avatars are generated using a traditional capture array and lack dynamic relighting, which limits their integration into VR environments. Meta's research is a response to public pressure to deliver on its decade-long promise of realistic avatars, especially as competitors like Apple introduce similar technologies.
AD
Why It's Important?
The advancement of Codec Avatars by Meta could revolutionize virtual reality experiences by providing users with a heightened sense of social presence. This technology has the potential to transform how people interact in virtual spaces, making digital meetings and social interactions more immersive. The ability to render full-body avatars on a mobile chipset like the Quest 3 could democratize access to high-quality VR experiences, previously limited to powerful PC setups. As Meta continues to refine this technology, it could set new standards in the VR industry, influencing how other companies approach avatar realism and social presence.
What's Next?
Meta is expected to share more details about its progress on Codec Avatars at the upcoming Meta Connect 2025 event. The company might explore launching a flatscreen version of Codec Avatars with AI-simulated face tracking, allowing users to join video calls with realistic avatars. However, the current Quest 3 lacks eye and face tracking capabilities, which may delay the full implementation of this technology. Meta's ongoing research and development efforts will likely focus on overcoming these limitations and integrating dynamic relighting to enhance avatar realism in mixed reality environments.
