<< Click to return to Index
Ablation Study on Motion Modeling
Methods | OptimizesCamera Poses | DeformationField | Non-RigidObjects | Root-BodyMotion |
Ours | $$\checkmark$$ | NBS | $$\checkmark$$ | $$\checkmark$$ |
w/o cam. opt. | ✗ | NBS | $$\checkmark$$ | $$\checkmark$$ |
w/ SE(3)-field | $$\checkmark$$ | SE(3)-field | $$\checkmark$$ | $$\checkmark$$ |
w/o deform. field | $$\checkmark$$ | None | $$\checkmark$$ | $$\checkmark$$ |
w/o root-body | ✗ | NBS | $$\checkmark$$ | ✗ |
w/o root-body (SE3) | ✗ | SE(3)-field | $$\checkmark$$ | ✗ |
- (w/o cam. opt.) Ablating camera-pose optimization does not qualitatively change the scene reconstruction.
- (w/ SE(3)-field) Changing the deformation field from Total-Recon's NBS (neural blend skinning) function to an SE(3)-field results in minor artifacts in the foreground reconstruction.
- (w/o deform. field) Removing the deformation field entirely produces coarse object reconstructions that fail to model moving body parts such as limbs.
- (w/o root-body) We do not visualize our method without root-body poses as this ablation does not converge.
- (w/o root-body (SE3)) We perform another ablation that replaces the NBS function with the more flexible SE(3)-field, which does converge but breaks foreground reconstruction entirely, as evidenced by the ghosting artifacts.
These experiments justify our method's hierarchical motion representation, where object motion is decomposed into global root-body motion and local articulations.
(GT) |
cam. opt. |
SE(3)-field |
field |
body (SE3) |
||
Cat 1 |
||||||
Dog 1 |
||||||