SBEL contributes a simulation-in-robotics paper on arxiv which provides a simulation methodology to rank the success of control policies deployed in reality

SBEL members Harry Zhang, Stefan Caldararu, Aaron Young, Alexis Ruiz, Huzaifa Unjhawala, Ishaan Mahajan, Sriram Ashokkumar, Nevindu Batagoda, Zhenhao Zhou, Luning Bakke, and Dan Negrut posted a new simulation-in-robotics paper on arxiv titled “A Study on the Use of Simulation in Synthesizing Path-Following Control Policies for Autonomous Ground Robots“.

The paper makes this point: Given several control policies, say A, B, C, and D, that aim to guide an autonomous vehicle through predefined waypoints, we can determine in simulation which control policy will perform better when deployed in the real world, prior to running any real-world experiments.

Details are as follows:

  • A” was Model Predictive Control
  • B” was PID control
  • C” was a neural-net based controller, trained using controller “A
  • D” was the same neural-net architecture as “C“, trained by Harry Zhang (the paper’s main author) by using a driving simulator

The ranking obtained in a Chrono simulation was that A > C >= B > D. The same four control policies were deployed on an actual autonomous vehicle and tested for performance in the real world. After running 60 outdoor experiments, it was observed that the same ranking, A > C >= B > D, is experienced in the real world. In other words, there was no sim2real gap, despite a zero-shot transfer from simulation to reality.

The paper is linked here: