Google's Genie World Model Can Now Simulate Real Streets with Street View
Overview
Google DeepMind has integrated Street View with Project Genie, its general-purpose world model that generates interactive, diverse environments. Announced at Google I/O 2026, this feature allows users to simulate real-world streets in an immersive, interactive way—adjusting weather, scenarios, and perspectives beyond traditional Street View.
Key Capabilities
Interactive World Simulation
- Real-world data integration: Leverages 20 years of Street View data (280 billion images across 110 countries)
- Environmental adjustments: Simulate weather changes, rare scenarios (e.g., snow in NYC, sun in London)
- Multiple perspectives: Shift viewpoints from cars to humans or robots
Applications
- Robotics training: Prepare robots for rare events (e.g., sun glare in London) by simulating edge cases
- Gaming & education: Create interactive game worlds and educational experiences
- Autonomous driving: Already powering one of Waymo's simulators to train on "exceedingly rare events" like tornadoes or elephant encounters
- Travel preview: Explore destinations in different seasons or conditions before visiting
Technical Details
Current State
- Quality: Video game-level visuals, not yet photorealistic
- Physics awareness: Not yet physics-aware—models don't fully understand cause and effect (e.g., objects pass through obstacles)
- Spatial continuity: AI correctly remembers and simulates 360-degree environments
- Timeline: Physics understanding is "6 to 12 months behind" other Google models like Veo (video) and Nano Banana (image)
Rollout
- Available to Google AI Ultra subscribers in the U.S. starting today
- Global Ultra access rolling out over the next few weeks
- Still an experiment with room for accuracy improvements
Expert Insights
Jack Parker-Holder (Research Scientist, DeepMind):
"It's really powerful for both the agent [and robotics] use case and for humans to play with, and that's always been the thesis of Genie."
Diego Rivas (Product Manager, DeepMind):
Cautioned that Street View in Genie is "still an experiment" with much to improve in terms of accuracy.
Jonathan Herbert (Director, Google Maps):
"The real breakthrough is the AI's spatial continuity. If you turn 360 degrees, the AI correctly remembers and simulates the environment behind you."
Background: Project Genie
- Genie 3: Released for research preview in August 2025
- Allows customers to create interactive game worlds from text prompts or images
- Already used by Waymo to simulate rare driving scenarios
- Goal: Educational experiences, gaming, and robotics training
Key Takeaways
- Google is merging 20 years of Street View data with its Genie world model to create interactive, real-world simulations
- Use cases span robotics training, autonomous driving, gaming, and travel planning
- Current limitations: Not photorealistic, lacks physics awareness, but improving rapidly
- This positions Google at the intersection of AI simulation, real-world data, and autonomous systems