Bandwidth-Adaptive Spatiotemporal Correspondence Identification for Collaborative Perception

Peng Gao, Williard Joshua Jose, Hao Zhang

Abstract

Correspondence identification (CoID) is an essential capability for multi-robot collaborative perception, which allows a group of robots to consistently refer to the same objects in their own fields of view. In real-world applications, such as connected autonomous driving, connected vehicles cannot directly share their raw observations due to the limited communication bandwidth. To address this challenge, we propose a novel approach of bandwidth-adaptive spatiotemporal CoID for collaborative perception, where robots interactively select partial spatiotemporal observations to share with others, while adapting to the communication constraint that dynamically changes over time. We evaluate our approach over various scenarios in connected autonomous driving simulations. Experimental results have demonstrated that our approach enables CoID and adapts to the dynamic change of bandwidth constraints. In addition, our approach achieves $8\%$-$56\%$ overall improvements in terms of covisible object retrieval for CoID and data sharing efficiency, which outperforms the previous techniques and achieves the state-of-the-art performance.

A motivating example of CoID under the communication bandwidth constraint for collaborative perception in connected autonomous driving. In order to enable connected vehicles to refer to the same street objects, they must efficiently share spatiotemporal information to identify object correspondences, while satisfying the communication bandwidth.
Figure 1: A motivating example of CoID under the communication bandwidth constraint for collaborative perception in connected autonomous driving. In order to enable connected vehicles to refer to the same street objects, they must efficiently share spatiotemporal information to identify object correspondences, while satisfying the communication bandwidth constraint.