Back

Accelerate VR Development with AI & the Immersive Web SDK

TL;DR: Meta's open-source Immersive Web SDK (IWSDK) now ships with a fully integrated agentic AI workflow. An AI coding assistant writes code, tests interactions, and fixes bugs autonomously—rebuilding a complete VR experience like Project Flowerbed in just 15 hours. For VRSites.com creators, this means you can go from idea to published, shareable WebXR experience without writing code yourself. Describe what you want, let the AI build it, and share it with a link.

What Is the Immersive Web SDK?

The Immersive Web SDK (IWSDK) is Meta's open-source framework for building VR on the web. It handles the heavy lifting—physics, hand tracking, grab interactions, movement, and spatial UI—so you can focus on your creative vision. Built on Three.js with a high-performance Entity Component System (ELICS), Vite-based hot-reload, and Havok physics out of the box, IWSDK gives you everything needed to build professional-grade WebXR experiences.
For anyone building immersive sites on VRSites.com, IWSDK is a game-changer: it means you can create rich, interactive VR content that runs in any browser and on any headset—exactly the kind of content that makes web-based VR compelling.

The AI Agentic Workflow: What Changed

The new agentic integration goes far beyond code generation. The AI operates in a closed loop: it writes code, reloads the scene, visually inspects the result, interacts with the world, and fixes issues—all without your input. This is the difference between "generate a snippet" and "build and test an entire VR experience."
Capability What the AI Does What It Means for VR Sites Creators
Knowledgeable code generation Traverses full IWSDK docs and codebase; generates code that follows framework patterns No need to learn the SDK internals—describe your idea and the AI writes idiomatic code
Scene understanding Takes screenshots, queries the 3D scene hierarchy, understands every object's position and components The AI "sees" your VR world and can make informed design decisions on your behalf
Interaction testing Moves around, picks up objects, presses buttons, simulates hand gestures in the live scene Your VR experience is tested automatically—no headset required during development
Self-healing validation Detects bugs, makes fixes, retests in a loop until resolved Fewer broken builds; faster iteration from concept to polished result
Natural-language refinement Understands feedback like "that feels too fast" or "move those closer together" Fine-tune your VR Sites experience by talking to it, not editing code

Project Flowerbed: Proof It Works

To prove the agentic workflow, Meta revisited Project Flowerbed—an immersive VR gardening experience that originally required tens of thousands of lines of custom code. Using the new AI workflow, they leveraged the existing creative assets and rebuilt the entire codebase from the ground up in just 15 hours. This isn't generating boilerplate. It's a full, interactive VR experience for the web, rebuilt by AI using IWSDK.
For VR Sites creators, the implication is clear: experiences that once required a dedicated development team can now be prototyped and built by a single person with a good idea and an AI coding assistant.

Why This Matters for VRSites.com

Lower the barrier to VR creation. The biggest challenge for VRSites.com has always been that building great WebXR content requires specialised skills. IWSDK's agentic workflow removes that barrier—designers, artists, and non-developers can now create compelling VR experiences and publish them on VR Sites.
More content, better discovery. As creation gets easier, the volume and quality of WebXR experiences will surge. VR Sites is perfectly positioned to be the discovery hub where users find, explore, and share these new AI-assisted VR creations.
Instant sharing via the web. IWSDK builds for WebXR—no app stores, no downloads. Creators deploy to any hosting provider and share a URL. Users click a link and enter VR. This is exactly how content on VRSites.com works: browser-first, accessible everywhere.
Works on all VR hardware. WebXR runs on Meta Quest, Steam Frame, Samsung Galaxy XR, Apple Vision Pro, and desktop browsers. Every VR experience built with IWSDK and listed on VR Sites reaches the widest possible audience.

How It Works Under the Hood

Layer Technology What It Enables
Framework Three.js + ELICS (ECS) + Vite hot-reload High-performance rendering with instant iteration—no compile step
Built-in features Havok physics, hand tracking, grab interactions, teleport/smooth locomotion, spatial UI, 3D audio Production-ready VR mechanics without writing low-level code
AI bridge MCP server inside Vite dev server, WebSocket to browser, 40+ specialised tools AI can see the scene, control XR input, debug the ECS, and search real API docs
XR emulation IWER (browser-based XR emulator) Full VR testing without a headset—the AI uses this to test autonomously
Knowledge base Local RAG server with 3,000+ indexed code chunks from IWSDK AI references real function signatures and patterns, not hallucinated ones

Getting Started: Build Your First VR Site Experience

IWSDK works with your favourite AI coding assistant, including Claude Code, Cursor, GitHub Copilot, and Codex. Here's how to go from zero to a shareable VR experience:
1. Create your project. Run npm create @iwsdk in a terminal and pick your AI tool. Everything is automatically configured.

2. Describe what you want. Open the project in your AI tool and prompt: "Build me an RPG-style VR game with neon blocks and a laser sword."

3. Watch it build. The AI writes the code, loads the scene, tests interactions, finds and fixes bugs—all without you touching anything.

4. Refine by prompting. Say: "The blocks feel too fast." The AI adjusts, confirms the change, and saves.

5. Share with a link. Deploy to GitHub Pages, Vercel, or Netlify and send the URL. Anyone can open it in VR—or submit it to VRSites.com for others to discover.

What You Need

Requirement Details
Node.js Version 20 or higher
Browser Chrome or Edge
AI coding tool Claude Code, Cursor, GitHub Copilot, or Codex
VR headset (optional) Meta Quest 3/3S/Pro, Steam Frame, or any WebXR-capable device—not required to get started
The Bottom Line: AI-assisted VR development is here, and it runs on the web. The Immersive Web SDK's agentic workflow means anyone—developers, designers, artists, hobbyists—can build and publish interactive VR experiences by describing what they want. For VRSites.com, this unlocks a flood of new WebXR content and makes the platform more valuable than ever as the place to discover, share, and explore browser-based VR.
Built something with IWSDK? Share your WebXR creation with us at VRSites.com—we're cataloguing the best AI-built VR experiences on the web.