Wednesday, December 13, 2023

SMERF: Streamable Memory Efficient Radiance Fields

SMERF: Streamable Memory Efficient Radiance Fields
431 by duckworthd | 104 comments on Hacker News.
We built SMERF, a new way for exploring NeRFs in real-time in your web browser. Try it out yourself! Over the last few months, my collaborators and I have put together a new, real-time method that makes NeRF models accessible from smartphones, laptops, and low-power desktops, and we think we’ve done a pretty stellar job! SMERF, as we like to call it, distills a large, high quality NeRF into a real-time, streaming-ready representation that’s easily deployed to devices as small as a smartphone via the web browser. On top of that, our models look great! Compared to other real-time methods, SMERF has higher accuracy than ever before. On large multi-room scenes, SMERF renders are nearly indistinguishable from state-of-the-art offline models like Zip-NeRF and a solid leap ahead of other approaches. The best part: you can try it out yourself! Check out our project website for demos and more. If you have any questions or feedback, don’t hesitate to reach out by email (smerf@google.com) or Twitter (@duck).