A Low-Cost, Open Platform for End-to-End Autonomous Driving on a Miniature Ackermann Vehicle

• Gustavo Claudio Karl Couto UFSC
• Eric Aislan Antonelo UFSC
• Gabriel George Zipperer UFSC

DOI: https://doi.org/10.5753/eniac.2026.30083

Resumo

This paper presents a low-cost, open experimental platform for research in end-to-end autonomous driving with miniature Ackermann vehicles. The platform combines a physical vehicle, a printed urban track, data collection tools, trajectory registration, and a Webots digital twin, enabling controlled experiments that connect simulation-based autonomous-driving methods to real-world execution. As a first baseline, we implement command-conditioned behavior cloning, in which a neural policy receives an on-board camera image and a high-level navigation command and outputs steering and speed. The system is evaluated both on the physical vehicle and in simulation. In real closed-loop experiments, the learned policy follows lanes and executes commanded turns, reaching a mean cross-track error of 6.1 cm with respect to the reference route, close to the 4.7 cm observed in human demonstrations. In the digital twin, camera field of view has a strong effect on performance, reducing the mean cross-track error from 35.6 to 3.3 cm when widened from 58^◦ to 120^◦. Using the digital twin to generate synthetic driving data and a learned sim-to-real image translator to reduce the appearance gap, we further show that a higher-capacity policy trained on this synthetic data combined with real demonstrations is the only configuration that completes all four track routes in closed loop, whereas the compact baseline and the same network trained on real data alone complete fewer. These results establish the open platform as a practical testbed for simto-real studies and provide an initial command-conditioned imitation-learning baseline; we release it to support reproducible research.

Referências

Bechtel, M. G., McEllhiney, E., Kim, M., and Yun, H. (2018). Deeppicar: A low-cost deep neural network-based autonomous car. In IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA).

Belsare, K., Rodriguez, A. C., Sanchez, P. G., Hierro, J., Kołcon, T., Lange, R., Lütkebohle, I., Malki, A., Losa, J. M., Melendez, F., et al. (2023). Micro-ROS. In Robot Operating System (ROS): The Complete Reference (Volume 7), pages 3–55. Springer.

Chen, D., Zhou, B., Koltun, V., and Krähenbühl, P. (2019). Learning by cheating. In Conference on Robot Learning (CoRL).

Codevilla, F., Müller, M., López, A., Koltun, V., and Dosovitskiy, A. (2018). End-to-end driving via conditional imitation learning. In IEEE International Conference on Robotics and Automation (ICRA).

Codevilla, F., Santana, E., López, A. M., and Gaidon, A. (2019). Exploring the limitations of behavior cloning for autonomous driving. In IEEE/CVF International Conference on Computer Vision (ICCV), pages 9329–9338.

Dosovitskiy, A., Ros, G., Codevilla, F., López, A., and Koltun, V. (2017). CARLA: An open urban driving simulator. In Conference on Robot Learning (CoRL), pages 1–16.

Florence, P., Lynch, C., Zeng, A., Ramirez, O., Wahid, A., Downs, L., Wong, A., Lee, J., Mordatch, I., and Tompson, J. (2022). Implicit behavioral cloning. In Conference on Robot Learning (CoRL), pages 158–168.

Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F. J., and Marín-Jiménez, M. J. (2014). Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognition, 47(6):2280–2292.

Hyldmar, N., He, Y., and Prorok, A. (2019). A fleet of miniature cars for experiments in cooperative driving. In IEEE International Conference on Robotics and Automation (ICRA).

Isola, P., Zhu, J.-Y., Zhou, T., and Efros, A. A. (2017). Image-to-image translation with conditional adversarial networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1125–1134.

Macenski, S., Foote, T., Gerkey, B., Lalancette, C., and Woodall, W. (2022). Robot operating system 2: Design, architecture, and uses in the wild. Science Robotics, 7(66).

Michel, O. (2004). Cyberbotics ltd. webots: Professional mobile robot simulation. International Journal of Advanced Robotic Systems, 1(1):39–42.

Moore, T. and Stouch, D. (2016). A generalized extended kalman filter implementation for the robot operating system. In Intelligent Autonomous Systems 13 (IAS-13), volume 302 of Advances in Intelligent Systems and Computing, pages 335–348. Springer.

O’Kelly, M., Zheng, H., Karthik, D., and Mangharam, R. (2020). F1tenth: An open-source evaluation environment for continuous control and reinforcement learning. In NeurIPS 2019 Competition and Demonstration Track.

Paden, B., Čáp, M., Yong, S. Z., Yershov, D., and Frazzoli, E. (2016). A survey of motion planning and control techniques for self-driving urban vehicles. IEEE Transactions on Intelligent Vehicles, 1(1):33–55.

Pomerleau, D. A. (1991). Efficient training of artificial neural networks for autonomous navigation. Neural Computation, 3(1):88–97.

Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention (MICCAI), pages 234–241.

Shrivastava, A., Pfister, T., Tuzel, O., Susskind, J., Wang, W., and Webb, R. (2017). Learning from simulated and unsupervised images through adversarial training. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2107–2116.

Tobin, J., Fong, R., Ray, A., Schneider, J., Zaremba, W., and Abbeel, P. (2017). Domain randomization for transferring deep neural networks from simulation to the real world. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 23–30.

Zhang, Z. (2000). A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(11):1330–1334.