SeA-RVINS

SeA-RVINS: Semantic-Aware Tightly Coupled RTK-Visual-Inertial System with Correlation-Preserving Robust Estimation for Urban Navigation

Reliable urban pose estimation through semantic-aware visual tracking, correlation-preserving GNSS robust estimation, and verified ambiguity continuity.

100%
Solution availability
0.39 m
Horizontal RMSE
1.60 m
Maximum horizontal error
99.90%
Epochs below 1.5 m

SeA-RVINS (latent) · TEX-CUP · approximately 20 km · 4,040 evaluation epochs · approximately 50% deep-urban driving

Robust estimation in urban canyons

GNSS multipath, unreliable visual associations, and broken carrier-phase continuity can introduce errors that persist in tightly coupled estimators. SeA-RVINS addresses these sources of error in a fixed-lag factor graph that combines raw RTK GNSS, inertial measurements, and stereo vision.

A semantic-aware learned frontend screens tracks before they enter the graph. Three configurable robust formulations retain the shared-pivot correlation of double-differenced GNSS measurements. A hybrid ambiguity-continuation strategy shares ambiguity states over short, verified arcs and softly links successive arcs.

Reliable visual tracks

Semantic screening and geometric verification reject unreliable associations before they become persistent landmark factors.

Correlation-preserving robustness

Batch, scalar, and latent-pivot formulations apply Dynamic Covariance Scaling to double-differenced code and phase observations.

Verified ambiguity continuity

Bounded, continuity-verified arcs and random-walk links retain temporal information; broken or unverifiable continuity starts independent states.

Visualization example

Tracking and Localization in a 3D Map

Recorded visualization of SeA-RVINS (Scalar) results, showing semantic masking and visual feature tracking alongside the estimated pose and trajectory in a 3D map.

SeA-RVINS (Scalar). Synchronized visual tracking and 3D pose visualization. The visualized car is overlaid on the map's ground surface. The 30-second video plays automatically and loops. Open video.

Interactive trajectories

Inspect the saved antenna-position estimates over the evaluated route. Toggle methods to compare tracks; gaps indicate unavailable solutions. Ground truth and SeA-RVINS (latent) are shown initially.

Loading trajectories…

Two-finger scroll or pinch to zoom. Drag to pan; right-drag to rotate and tilt, or use the sliders above.

OpenFreeMap streams OSM buildings as you navigate. Building heights provide visual context; trajectories show horizontal positions on the map, without estimated altitude.

Benchmark results

Benchmark repository
TEX-CUP · May 9, 201918:09:40–19:16:59 UTC4,040 epochs at 1 Hz
Horizontal positioning performance · Table I
MethodRMSE
(m) ↓
Maximum
(m) ↓
Below 1.0 m
(%) ↑
Below 1.5 m
(%) ↑
P95
(m) ↓
Availability
(%) ↑
RTKLIB-EX4.9558.5646.1459.238.41100.0
GICI-RTK4.69177.0077.6087.435.7096.7
GICI-RRR92.441122.5948.5455.97140.5796.3
VINS-Fusion5.1035.8644.2657.829.6899.9
IC-GVINS (partial)7.6830.479.1614.3121.9537.2
GVINS436.70>10,00022.4839.3328.7690.7
InGVIO>1,000>40,0005.006.58161.7798.4
OKVIS2-X19.2969.4431.2944.9850.17100.0
SeA-RVINS (batch)0.382.9197.1599.630.90100.0
SeA-RVINS (scalar)0.391.6397.0099.980.86100.0
SeA-RVINS (latent)0.391.6096.1699.900.90100.0

Reading the results. Availability and threshold percentages use all 4,040 epochs; missing solutions count as unsuccessful. RMSE, maximum, and P95 use valid solutions only. Green bold values indicate the best value in each column. Arrows indicate the preferred direction.

IC-GVINS partial run. Only estimates before 18:35:00 UTC are retained (1,502 solved epochs); later epochs count as unavailable. This is a conservative pre-divergence reporting boundary, not an exact failure instant.

Comparison scope. Methods use the sensor configurations they support. Loosely coupled methods share RTKLIB-EX position inputs; GVINS and InGVIO use rover-only GNSS and serve as system-level references. See the manuscript for sensor configurations and 3D metrics.

Integer ambiguity resolution · Table II
MethodUsed-fix
epochs
Fix rate
(%)
Below 0.5 m
(% of used fixes)
At least 0.5 m
(epochs)
Horizontal RMSE
(m)
Horizontal max.
(m)
SeA-RVINS (batch)1,38334.2397.54340.170.98
SeA-RVINS (scalar)1,91547.4093.991150.200.85
SeA-RVINS (latent)1,84245.5999.35120.150.55

A used-fix epoch applies an accepted integer solution. Fix rates use all 4,040 evaluation epochs; the remaining error statistics are conditional on used-fix epochs.

Benchmark methods & reproduction

The public TEX-CUP Urban-Navigation Benchmark provides data preparation, calibration, baseline run guides, and evaluation scripts, together with saved baseline and SeA-RVINS results.

System architecture

GNSS, IMU, and stereo observations enter a 6-second fixed-lag factor graph. Integer ambiguity hypotheses are validated before accepted fixes are applied.

SeA-RVINS architecture: GNSS preprocessing, inertial preintegration, and semantic-aware vision feed a factor graph with persistent landmarks, ambiguity continuation, and validated integer ambiguity resolution.
System overview. The graph jointly estimates navigation states, landmarks, and float ambiguities, with optional pivot-error and stationary-anchor variables. Validated integer priors feed back into the graph. Select either figure to inspect it at full resolution.

Semantic-aware learned stereo frontend

Semantic masking, learned feature matching, and geometric checks screen stereo and temporal tracks before landmark admission.

Semantic-aware stereo frontend showing semantic masks, learned feature extraction and matching, and geometric screening before visual factors are added.
Visual measurement admission. SegFormer semantic masks, SuperPoint features, and LightGlue matching are combined with stereo, temporal, and frame-level geometric checks to reduce unreliable visual constraints.