Deep Reinforcement Learning based Optimization of Autonomous Vehicle Traffic

This image shows the density of taxi GPS tracks in San Francisco collected as part of the Mobile Millennium project. The project successfully used location information of taxis to produce travel time data for commuters. Now, the team is expanding the effort to use cohorts of cars to directly improve traffic in a scalable manner.


At a glance

The aim of this research is to use state of the art (and practice) microsimulation methods in conjunction with recent breakthroughs in deep reinforcement learning in order to offer a generic urban traffic optimization solution. The project thus aims at leveraging the heterogeneous data streams produced by smart cars and smart cities (i.e. GPS based measurements of speeds and delays, static flow measurements with magnetic loops, Bluetooth re-identification, odometry data, raw video feed) in order to improve the dynamics of arterial traffic using a stochastic modeling framework.
This project will rely on two recent major breakthroughs in Artificial Intelligence. Trust Region Policy Optimization in Reinforcement Learning enables the learning of more complex policies and specifically Neural Network. In spite of the complexity of the problem, this technique guarantees our AI learns from previous experience. Another cutting edge technology will be used in the form of recurrent neural networks which enable attention learning in complex tasks. This automates focusing on an aspect of the problem prior to moving on to another sub-problem in a way that is very similar to how a human organizes a complicated task.
Principal InvestigatorsResearchersThemes

Alexandre M. Bayen

Francois BellettiReinforcement Learning
Stochastic Modeling


BAIR/CPAR/BDD Internal Weekly Seminar

Event Location: 
250 Sutardja Dai Hall

The Berkeley Artificial Intelligence Research Lab co-hosts a weekly internal seminar series with the CITRIS People and Robots Initiative and the Berkeley Deep Drive Consortium. The seminars are every Friday afternoon in room 250 Sutardja Dai Hall from 3:10-4:10 PM, and are open to BAIR/BDD faculty, students, and sponsors. Seminars will be webcast live and recorded talks will be available online following the seminar.