Lucida: Turn Indoor Video into Editable 3D Scenes

Rebuild a real room as a collection of complete 3D objects. Lucida combines multi-view observations, object generation, and visual alignment to recover a scene you can edit object by object.

Lucida official preview of a reconstructed apartment with separate object assets
Apartment reconstruction with separate, editable furniture meshes. Lucida

Lucida is a ByteDance Seed scene-modeling system. Instead of stopping at a fused point cloud, it recovers separate object assets and places them in the observed arrangement. The useful distinction is not just a different camera view: chairs, tables, and other objects remain individually editable.

What the scene reconstruction looks like

The official demonstration follows an indoor capture into a reconstructed scene. Objects are represented as separate meshes, rather than one inseparable scene surface. This makes the result relevant to digital twins, simulation, and scene editing.

Official Lucida demonstration: real observations to an object-based 3D scene. Lucida

From observed fragments to complete objects

Lucida first selects informative views and associates the same object across them. Reference images, masks, partial point clouds, 3D boxes, and language cues form an evidence bundle for each instance.

The generation stage creates an unobstructed object image, then turns it into a complete 3D asset with occluded regions filled in.

Lucida pipeline: multi-view evidence, complete object generation, and scene placement.
Lucida pipeline: multi-view evidence, complete object generation, and scene placement. Lucida

GizmoAct: align the assets with the room

A plausible model can still be misplaced or rotated incorrectly. GizmoAct uses a vision-language model to inspect rendered views, point-cloud overlays, and local-axis observations, then issue executable pose edits.

The loop checks the new result against the captured scene. It separates creating an object from finding its correct placement, instead of relying on perfect geometry from every earlier stage.

GizmoAct observes rendered views and applies local-axis pose edits.
GizmoAct observes rendered views and applies local-axis pose edits. Lucida

When to use a scene workflow instead of an asset generator

For a room layout or real-to-sim environment, object identity, scale, and placement matter together. Separate assets let you inspect, replace, or reposition an object without rebuilding the entire scene.

For one product, prop, or character, image-to-3D is the shorter path. Start with a clear image of the subject; a full scene reconstruction pipeline adds little when the rest of the room is not needed.

Object-based scenes vs point-cloud reconstruction

NeedPoint-cloud reconstructionLucida
RepresentationObserved surface samplesSeparate, complete object assets
Occluded regionsLimited by captured observationsInferred during object generation
EditingWork on scene geometry or segmentationEdit individual object meshes
AlignmentCamera and geometric registrationClosed-loop visual pose refinement

Frequently asked questions

Is Lucida the same as Seed3D 2.0?

No. Lucida focuses on composing a real indoor scene from multiple observations. Seed3D 2.0 focuses on generating 3D assets. A scene workflow also needs object association, scale, and placement.

Are objects behind furniture recovered exactly?

Unseen geometry is generated from the available evidence. It can complete an asset, but it is not a measurement of surfaces that the camera never saw.

What input does Lucida use?

Lucida combines multiple posed observations of the same indoor scene. It associates objects across views, then builds per-object evidence from reference images, masks, partial point clouds, and 3D boxes.

Official sources

Start with a single 3D asset

Turn a reference image of a product, prop, or character into a 3D model in your browser.

Generate a 3D Asset