Massive World Model Release & AI Agent Action! Marble & Google's SIMA 2!

Your video will begin in 10
Skip ad (5)
The new system to launch an online business

Thanks! Share it with your friends!

You disliked this video. Thanks for the feedback!

Added by admin
14 Views
Two Game Changers in Gen AI! Today I've got a hands-on deep dive into World Labs’ Marble (Gaussian-splat virtual sets you can edit, expand, and animate—now widely available with new features and surprising pricing) and a breakdown of Google Deepmind's SimA-2 research—an agent learning inside generated worlds via Genie 3 and guided by Gemini. I show how I used Marble to build a virtual set for my short “Alarm,” demo multi-image world bashing, keyframed camera moves, video export/enhance, canvas/node edits, and practical limits. Then we unpack SimA-2 vs SimA-1, success rates, consistency/hallucination issues, and why spatial intelligence matters for the future of AI video, games, and robotics.

Thanks to Design Arena For Sponsoring Today's Video: https://www.designarena.ai/?utm_source=theoreticallymedia

LINKS:
Marble (World Labs): https://marble.worldlabs.ai/
Marble case study on “Alarm”: https://www.worldlabs.ai/case-studies/creative-film
My Marble walkthrough video: https://youtu.be/86RXkvfxW70
Fei-Fei Li essay on spatial intelligence: https://drfeifei.substack.com/p/from-words-to-worlds-spatial-intelligence
SimA-2 research: https://deepmind.google/blog/sima-2-an-agent-that-plays-reasons-and-learns-with-you-in-virtual-3d-worlds/

Chapters

00:00 – Touching the future: Marble + SimA-2
00:07 – Marble overview, availability, pricing tease
00:38 – “Alarm” recap: Marble-built virtual set
01:39 – Screenshot → character inpaint workflow + case study
02:27 – Why splats: spatial consistency & limits
02:45 – The “why” of Marble: spatial intelligence context
03:26 – New features: multi-image, edits, primitives, expand, export
04:34 – Expanding worlds & video export/enhance
05:05 – Text-to-Environment: Advanced mode (panorama → world)
05:34 – Panorama edits (banana statue), generate world
06:07 – Splat limits + workarounds
06:34 – Multi-image world bashing demo
07:07 – Record footage: timeline + keyframes
07:52 – Longer moves (20s) & enhance cap (10s)
08:23 – Export to Blender/Unreal; Canvas/node basics
09:34 – Why non-3D folks should dabble in nodes
09:53 – Who Marble’s for; pricing (free credits, $1 Pro month)
10:24 – Bridge: adding life…
10:40 – Sponsor: Design Arena (Firefly Boards + external video models)
11:40 – Back to topic (segue to research)
13:41 – SimA-2: what’s new vs SimA-1
14:16 – Beyond games: goals, planning with Gemini
14:46 – Success rates, progress since 2024
15:31 – Genie 3 + SimA-2: learning unfamiliar worlds
16:11 – Hallucinations, memory horizons, consistency notes
17:04 – Genie 3 long-horizon vs SimA-2 task memory
17:55 – Why this matters: spatial intelligence and real-world rules
18:07 – Where it’s heading (holodeck vibes) & wrap
Category
Artificial Intelligence
Tags
World Labs Marble, SIMA-2, Google Deepmind

Post your comment

Comments

Be the first to comment