Select your language

Publications

Robust Fusion of Object-Level V2X for Learned 3D Object Detection

IEEE VTC 2026-Spring, 2026/5/1
Lukas Ostendorf, Institute for Automotive Engineering (ika)
Lennart Reiher, Institute for Automotive Engineering (ika)
Onn Haran,
Lutz Eckstein, Institute for Automotive Engineering (ika)

Perception for automated driving is largely based on onboard environmental sensors, such as cameras and radar, which are cost-effective but limited by line-of-sight and field-of-view constraints. These inherent limitations may cause onboard perception to fail under occlusions or poor visibility conditions. In parallel, cooperative awareness via vehicle-to-everything (V2X) communication is becoming increasingly available, enabling vehicles and infrastructure to share their own state as object-level information that complements onboard perception. In this work, we study how such V2X information can be integrated into 3D object detection and how robust the resulting system is to realistic V2X imperfections. Using the nuScenes dataset, we emulate object-level cooperative awareness messages from ground truth, injecting controlled noise and object dropout to mimic real-world conditions such as latency, localization errors, and low V2X penetration rates. We convert these messages into a dedicated bird's-eye view (BEV) input and fuse them into a BEVFusion-style detector. Our results demonstrate that while object-level cooperative information can substantially improve detection performance, achieving an NDS of 0.80 under favorable conditions, models trained on idealized data become fragile and over-reliant on V2X. Conversely, our proposed noise-aware training strategy, coupled with explicit confidence encoding, enhances robustness, maintaining performance gains even under severe noise and reduced V2X penetration.

 

Address

Institute for Automotive Engineering (ika)
RWTH Aachen University
Steinbachstraße 7
52074 Aachen · Germany

This email address is being protected from spambots. You need JavaScript enabled to view it.
+49 241 80 25600

Select your language