The Apple research team has collaborated with the University of Hong Kong to release a new rendering framework called LGTM. The full name of this framework is "Less Gaussians, Texture More," aiming to break through the rendering bottlenecks of 4K ultra-high-definition quality.
The core innovation of the LGTM framework lies in decoupling the geometric structure and surface texture of 3D scenes, thus simplifying the complexity of geometric shapes while achieving high-quality visual effects through layered texture overlay. Traditional "feedforward 3D Gaussian splatting" technology can quickly convert 2D images into 3D scenes, but when processing high-resolution images, the computational demand increases exponentially as the number of pixels grows, making it difficult for devices to handle.
To address this issue, LGTM adopts a two-step strategy. First, the model learns the scene structure from low-resolution images, ensuring a perfect geometric framework during 2K or 4K rendering. Then, the second network focuses on detail processing, precisely mapping high-resolution textures onto the geometric structure. This division effectively avoids the full-chain consumption of high computing power.
For ordinary users, this technology will significantly enhance the user experience of the Apple Vision Pro headset. The Vision Pro's dual-screen display has approximately 23 million pixels in total, with more than 4K TV resolution per eye. Existing rendering technologies are prone to performance bottlenecks at such high resolutions, leading to lag or blur in the image. The launch of LGTM is expected to solve this computing power bottleneck, providing a smoother and more immersive experience.
In practical demonstrations, 3D scenes generated after integrating the LGTM framework show significant improvements in texture details and text clarity, with image quality approaching reality. This means that in the future, users will enjoy a more realistic and clear visual experience when viewing virtual environments through headsets.
Key Points:
🌟 Apple and the University of Hong Kong jointly launched the LGTM rendering framework, aiming to improve 4K picture quality.
🚀 LGTM optimizes rendering efficiency and reduces computing power requirements by decoupling geometric structures and surface textures.
👓 This technology will enhance the user experience of Apple Vision Pro, achieving smoother and more immersive visual effects.
