Niantic 8th Wall improves WebAR with powerful GenAI modules
Niantique 8th wall enhances its WebAR platform with Generative AI (GenAI) modules to revolutionize augmented reality experiences.
The fusion of technologies promises to offer developers, brands and agencies greater creative potential and improve users’ augmented reality experiences.
Over the past few months, 8th Wall developers have harnessed the power of GenAI, integrating various cutting-edge GenAI technologies into the WebAR platform.
Current integrations include DALL·E and Stable Diffusion for text-to-image input, Blockade Labs for embedding 360-degree images, Inworld AI for realistic interactive characters, Hugging Face and ControlNet for adding depth to facial expressions , as well as Move.ai and Wonder. Dynamic for realistic movement simulation.
To facilitate the adoption of GenAI modules for WebAR experiences, Niantic demonstrated sample projects for Inworld and OpenAI.
The sample projects aim to demonstrate how GenAI modules streamline the incorporation of GenAI technology into WebAR projects, eliminating the complexities that often deter developers. With these modules, developers can easily imbue their projects with the magic of GenAI.
This GenAI-WebAR synergy transcends static content creation, paving the way for dynamic, interactive experiences that respond to user input. Users are no longer passive consumers but active participants, engaged in immersive encounters that evolve according to their interactions.
Inworld AI: a big step towards realistic interactions
Inworld AI introduces a revolutionary character engine, giving AI-driven characters realistic qualities. These characters possess learning abilities, emotional intelligence, memory and autonomy, making interactions truly engaging.
In collaboration with 8th Wall, Inworld AI launched the Inworld AI Integration Module and Rainbow Crunchies sample project. This module seamlessly blends Inworld’s realistic characters with 8th Wall’s tools, enabling immersive experiences where characters come to life with natural conversations and realistic expressions.
By simplifying server provisioning and authentication, the Inworld integration module allows developers to integrate realistic characters into their WebAR experiences without technical obstacles. The Rainbow Crunchies sample project illustrates how developers can create dynamic, interactive brand encounters with characters like Rainbow Ray.
OpenAI: unleashing text and image generation
8th Wall also introduces a new suite of development tools that leverage the power of OpenAI’s DALL·E and ChatGPT for image generation and interactive text chat.
DALL·E generates complex images based on text prompts, giving users creative control over their WebAR experiences. ChatGPT requires little introduction but enables real-time, personalized interactions within WebAR, allowing developers to create dynamic, user-focused content.
Like the Inworld Integration Module, the 8th Wall Integration Module for OpenAI simplifies server configuration and token management, allowing developers to focus on creating compelling WebAR experiences.
The GenAI sample project powered by OpenAI demonstrates the ease of integrating these technologies into WebAR, showcasing DALL·E’s ability to generate 3D textures in real-time and ChatGPT’s role in facilitating user interactions .
Ian Curtis, XR Developer at 8th Wall, said: “What excites me most about integrating generative AI into augmented reality is that it allows each user to become an architect of their world digital.
“They no longer passively consume content but actively create it, shaping their experiences with the power of their imagination.”
Improve WebAR experiences with GenAI modules
The potential of GenAI to revolutionize AR is undeniable. With these new developer tools, GenAI seamlessly merges with 8th Wall’s most impactful features, including Image Targets, Face Effects, World Effects, Sky Effects, Lightship VPS, and AR Tools shared.
To get started, explore the Inworld AI Rainbow Crunchies example project and the GenAI sample project powered by OpenAI. Import the Inworld AI Integration Module or the 8th Wall Integration module for OpenAI in your project.
Developers new to 8th Wall can to access a 14-day free trial, allowing you to harness the power of GenAI in your next AR experience.
(Image credit: Niantic 8th Wall)
See also: Inworld and its AI NPCs are now valued at $500 million
Looking to revamp your digital transformation strategy? Learn more about Digital Transformation Week taking place in Amsterdam, California and London.
Check out more upcoming enterprise technology events and webinars from TechForge here.
