Skip to main content

An Auto-tuning Framework for Autonomous Vehicles

Penelitian - Researchers at Chinese multinational tech company Baidu have recently developed a data-driven auto-tuning framework for self-driving vehicles based on the Apollo autonomous driving platform.

The framework, presented in a paper pre-published on arXiv, consists of a new reinforcement learning algorithm and an offline training strategy, as well as an automatic method of collecting and labelling data.

Penelitian An Auto-tuning Framework for Autonomous Vehicles

A motion planner for autonomous driving is a system designed to generate a safe and comfortable trajectory to reach a desired destination. Designing and tuning these systems to ensure that they perform well under different driving conditions is a difficult task that several companies and researchers worldwide are currently trying to tackle.

"Motion planning for autonomous driving cars has a lot of challenging issues. One main challenge is that it has to deal with thousands of difference scenarios. Typically, we define a reward/cost functional tuning that can adapt those differences in scenarios. However, we find it is a difficult task," said Fan Haoyang, one of the researchers who carried out the study.

Typically, reward-cost functional tuning requires extensive work on behalf of researchers, as well as resources and time spent on both simulations and road tests. In addition, the environment can change dramatically over time and as driving conditions become more complicated, tuning the performance of the motion planner becomes increasingly difficult.

"To systematically solve this issue, we developed a data-driven auto-tuning framework based on the Apollo autonomous driving framework. The idea of auto-tuning is to learn parameters from human demonstrated driving data," Fan said.

"For example, we would like to understand from data how human drivers balance speed and driving convenience with obstacle distances. But in more complicated scenarios, for example, a crowded city, what can we learn from human drivers?" said Fan.

The auto-tuning framework developed at Baidu includes a new reinforcement learning algorithm, which can learn from data and improve its performance over time. Compared to most inverse reinforcement learning algorithms, it can be effectively applied to different driving scenarios.

The framework also includes an offline training strategy, offering a safe way for researchers to adjust parameters before an autonomous vehicle is tested on public roads. It also collects data from expert drivers and information about the environment, automatically labeling these so they can be analyzed by the reinforcement learning algorithm.

"I think we developed a safe pipeline to make a machine learning scalable system by using human demonstration data. The open loop human demo data are collected and do not need extra labeling. Since the training process is also offline, our method is suitable for autonomous driving motion planning, keeping public road test safety," Fan said.

The researchers evaluated a motion planner tuned using their framework both on simulations and public road testing. Compared to existing approaches, their data-driven method was better able to adapt to different driving scenarios, performing consistently well under a variety of conditions.

"Our research is based on Baidu Apollo Open Source Autonomous Driving platform. We hope more and more people from academia and industry can contribute to the autonomous driving ecosystem through Apollo," said Fan.

"In future, we plan to improve the current framework of Baidu Apollo to a machine learning scalable system that can systematically improve the scenario coverage of autonomous driving cars," Fan said.

Journal : Haoyang Fan et al. An Auto-tuning Framework for Autonomous Vehicles, arXiv, Submitted on 14 Aug 2018, arXiv:1808.04913

Comments

Popular

Mathematician Michael Atiyah Claims a Simple Proof for Riemann Hypothesis

New Insight for Surface Chemistries in Ultra-thin Self-assembled Monolayers Modified High-voltage Spinel Cathodes

Humanitarians see surge in climate-related disasters

Canada Makes Final Preparations Before Cannabis Becomes Legal

FDA advisors endorse Celltrion’s Rituxan biosimilar