Система обхода препятствий для роботов-внедорожников, обученная по принципу «от края до края» (end-to-end). Этот ИИ-проект 2005 года научил машины сопоставлять визуальные данные с углом поворота руля, имитируя поведение реального водителя в любых погодных условиях.
We describe a vision-based obstacle avoidance system for off-road mobile robots. The system is trained from end to end to map raw input images to steering angles. It is trained in supervised mode to predict the steering angles provided by a human driver during training runs collected in a wide variety of terrains, weather conditions, lighting conditions, and obstacle types. The robot is a 50cm off-road truck, with two forwardpointing wireless color cameras. A remote computer processes the video and controls the robot via radio. The learning system is a large 6-layer convolutional network whose input is a single left/right pair of unprocessed low-resolution images. The robot exhibits an excellent ability to detect obstacles and navigate around them in real time at speeds of 2 m/s.