Skip to content

dim_slam: one module wrapping the merged cuVSLAM+fusion binary - #3595

Draft
jeff-hykin wants to merge 5 commits into
jeff/feat/cuvslamfrom
jeff/feat/dim_slam
Draft

dim_slam: one module wrapping the merged cuVSLAM+fusion binary#3595
jeff-hykin wants to merge 5 commits into
jeff/feat/cuvslamfrom
jeff/feat/dim_slam

Conversation

@jeff-hykin

Copy link
Copy Markdown
Member

Stacked on #3391 (jeff/feat/cuvslam).

  • dimSLAM merged its two binaries into one dim_slam executable (dimensionalOS/dimSLAM jeff/feat/dim_slam); the CuvslamOdometry + OdometryFusion wrappers collapse into one DimSlam module with the flat union of both configs
  • dimos/mapping/cuvslam -> dimos/mapping/dim_slam; odometry_fusion.py deleted
  • pin DIMSLAM_REV = 3f32754 (jeff/feat/dim_slam tip; tag on merge)
  • internal visual-odometry stream stays in-process; external sources arrive on sources, split by header.frame_id
  • registry: dim-slam replaces cuvslam-odometry + odometry-fusion
  • demo-cuvslam-realsense runs DimSlam with use_imu=False (no IMU streaming; filter seeds level off the first tracked pose)
  • 36/36 config field parity with the rust struct checked programmatically

…d off

The C++ module was replaced upstream by a Rust one, which moved the pose graph
and loop closure downstream into the fusion filter, so enable_slam and the
corrected_odometry port no longer have anything behind them.

publish_tf exists because the filter publishes odom->base_link too. Two
publishers on that edge race, and giving this module its own root instead
leaves base_link with two parents, which is a malformed tree rather than a
redundant one. Off, this publishes odometry alone and the filter owns the edge.
The Rust filter shipped in the same derivation as cuvslam_odometry but had no
Python side, so nothing in dimos could run it. Every source publishes onto one
sources port and is told apart by header.frame_id, which makes adding a source
a config change rather than a port change.

imu_init_samples carries the weight here: on a 517 s Alfred drive, leaving the
raw gyro bias in costs 19.8 m of final error against 1.6 m with it removed,
which is worse than fusing no IMU at all.
The Rust filter gained a use_imu switch so it can be seeded level from the first
source message and coast between measurements rather than propagating on IMU.
`#[native_config]` supplies no defaults and rejects unknown keys, so the Python
config has to carry the field for the module to start at all.

Off is worth having on Alfred: measured against point-lio over the 517 s drive,
wheel and cuVSLAM fused without the IMU lands at 3.53 m, while the same pair with
the IMU added lands at 71.32 m.
The native module publishes a range-gated depth_cloud and takes the gate from two
config fields. `#[native_config]` supplies no defaults and rejects unknown keys, and
the runtime rejects a module whose declared ports do not match the binary's, so
without both the field pair and the port the process died on startup every run:

    failed to deserialize config: missing field `depth_cloud_min_range`
    topics do not match module ports: missing ["depth_cloud"]

That killed CuvslamOdometry silently in alfred-mls-nav — the stack came up, the
remaining modules ran, and the fusion filter simply never saw a visual source. With
both in place cuvslam publishes odometry at 30 Hz on Alfred.
dimSLAM merged its two binaries into one dim_slam executable that feeds
the tracker's pose into the fusion filter in-process, so the two wrapper
modules collapse into one DimSlam module with the flat union of both
configs. The internal visual odometry stream no longer crosses the wire;
external sources still arrive on the sources input, told apart by
header.frame_id.
@codecov

codecov Bot commented Aug 21, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 97.43590% with 1 line in your changes missing coverage. Please review.
✅ All tests successful. No failed tests found.

Files with missing lines Patch % Lines
dimos/mapping/dim_slam/dim_slam.py 97.36% 1 Missing ⚠️
@@                 Coverage Diff                  @@
##             jeff/feat/cuvslam    #3595   +/-   ##
====================================================
  Coverage                     ?   75.74%           
====================================================
  Files                        ?     1268           
  Lines                        ?   122239           
  Branches                     ?    11255           
====================================================
  Hits                         ?    92591           
  Misses                       ?    26580           
  Partials                     ?     3068           
Flag Coverage Δ
OS-ubuntu-24.04-arm 70.79% <97.43%> (?)
OS-ubuntu-latest 72.52% <97.43%> (?)
Py-3.10 72.51% <97.43%> (?)
Py-3.11 72.51% <97.43%> (?)
Py-3.12 72.51% <97.43%> (?)
Py-3.13 72.51% <97.43%> (?)
Py-3.14 72.51% <97.43%> (?)
Py-3.14t 72.51% <97.43%> (?)
SelfHosted-Large 29.88% <ø> (?)
SelfHosted-Linux 35.35% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines Coverage Δ
dimos/mapping/dim_slam/demo_cuvslam_realsense.py 75.00% <100.00%> (ø)
dimos/robot/all_blueprints.py 100.00% <ø> (ø)
dimos/mapping/dim_slam/dim_slam.py 63.23% <97.36%> (ø)
🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant