Autonomy: The Quest to Build the Driverless Car - And How It Will Reshape Our World. Lawrence Burns
in ten hours. The route amounted to a flat oval, about two miles around. While they prepared Sandstorm, Urmson and Peterson tinkered with a new part of the software: a component of the speed-setting module designed to slow down the robot when it approached a curve. The new code was designed to allow Sandstorm to drive more quickly on straightaways.
The code worked wonderfully. During a few warm-up laps, Sandstorm managed to get up to 49 mph along the straightaways and then the new algorithm slowed it down as the robot headed into the curves. In fact, as Urmson and Peterson watched the robot, they wondered whether it slowed Sandstorm too much. An adjustment to the algorithm during a refueling break seemed to improve things. On the first lap they watched as Sandstorm cruised into a curve, slowed a little bit and then accelerated through the curve’s exit. At the end of the second lap, Sandstorm was heading fast into what Urmson would later describe in his field test report as a “soft S-curve” to the left. The right-side tires drifted off the road into deep sand, and when Sandstorm tried to correct things, to get back on the track’s packed-down dirt, it steered too hard to the left. The right-side tires bit into the soft sand. The left-side tires came up off the road. Behind, in the chase car, Urmson watched, horrified, as Sandstorm tipped up and over, and came to rest upside down—right on top of the e-box and the gimbal housing all the vehicle’s most sensitive equipment.
The robot had been designed to insulate the box’s components from being damaged in all sorts of accidents. Front-end collisions, rear-end collisions—pretty much any collision that happened on the ground plane, Sandstorm would be able to withstand just fine. But the robot had one fatal weakness: a rollover. Because Humvees sat comparatively low and flat, their geometry made rollover accidents almost impossible.
Unless you were testing a robot Humvee in the Mojave Desert, apparently.
A History Channel crew had come out to film the test run. They rushed out onto the track with their cameras and shoved one into Urmson’s face, asking him to list the damage. Urmson looked at the wrecked robot the team had spent the better part of a year engineering: at the crushed gimbal, the compacted GPS antennae, the flattened e-box and the connecting rods bent out of shape. And he let fly with the expletives that made him one of the few people to ever have to have been bleeped by the History Channel. “Shock and disbelief,” Urmson says when asked to describe his reaction, more than ten years later. “But mostly disbelief.”
Disbelief, because they had felt like they’d been making such great progress. Disbelief because they were just days from the qualifiers. Disbelief because this had happened on the second lap of a two-mile track that Sandstorm was supposed to drive for seventy-three more laps.
Most of the crew figured Red Team was over. That they’d never be able to repair the robot in time. Somebody called Pittsburgh to inform everyone else about the accident. Red’s assistant Michele Gittleman took the call. She recalls sobbing when she processed the news.
Maybe a crew led by someone other than Red Whittaker would have given up. But Whittaker didn’t even consider it.
At the Nevada Automotive Test Center, Urmson, Peterson, Spiker and the rest of the team attached the four-by-four chase vehicle to Sandstorm with the help of some nylon webbing and managed to flip over the robot. Spiker, the most mechanically minded among them, went over the engine to look for problems. The engine was flooded with diesel fuel but aside from that, everything looked okay.
The other guys assessed the electronics equipment. The GPS units were toast. The gimbal suffered the worst impact and would need to be completely rebuilt. The main LIDAR unit was irreparable. Luckily, an extra gimbal and LIDAR sat in storage back in Pittsburgh. They towed Sandstorm to the mechanics shop and for three nearly sleepless days and nights they worked to fix everything they could. And they nearly did it.
The race was March 13, 2004. Heading into the qualifiers the week before, at the California speedway in Fontana, the GPS system worked, which meant the robot could locate itself in the world. The sensors were active, which enabled Sandstorm to perceive obstacles. The computers could calculate the trajectories required to follow the path set out by the Red Team mapping crew. The only problem? “We had no time to calibrate,” recalls Whittaker. Which meant Sandstorm viewed the world through a distorted lens.
Think of each sensor as its own individual eyeball. You are able to see one version of reality because your brain is able to amalgamate the view from your two eyes into a single picture of the world. Sandstorm amalgamated the information from four different LIDAR units plus the stereo-camera system. Ensuring that the robot’s sense of the world resembled the actual world required calibrating the individual sensors—a time-intensive process of trial and error. “Think of calibration as alignment,” Whittaker explains. “Even in the car shops they align your headlights, right? And when there are multiple sensors that will fuse data into a common model, it’s important that they’re all aligned. If you just bolt it back together you’re creating a kind of Frankenstein, and maybe it’s a little cross-eyed.”
And so the cross-eyed Frankenstein’s monster limped into race week, belching diesel exhaust, dented and scratched, but otherwise intact. Red Team would compete against twenty other entries from across the United States. In the qualifiers each of the twenty-one robots would have to navigate a mile-long obstacle course to progress to the main event.
Soon after his arrival at the California Speedway, Urmson wandered around to see what he could learn about his competition. He saw Doom Buggy, created by the only high school admitted to the competition, Palos Verdes, near Los Angeles. An undergraduate from UC Berkeley, Anthony Levandowski, led the team behind the only two-wheeled entry, a robot motorcycle that was able to balance itself with the help of a gyroscope. UCLA’s entry, the Golem Group, was led by a guy named Richard Mason, who had seeded his project with $28,000 he’d won on Jeopardy!
On the other end of the spectrum were the professional teams, which were affiliated with various engineering-focused corporations. An inventor named Dave Hall had created an autonomous Toyota Tundra pickup truck that was notable for driving smoothly with a stereoscopic camera setup—it didn’t use any LIDAR at all. From Wisconsin, the makers of Oshkosh Trucks entered a six-wheel-drive, 32,000-pound fluorescent yellow behemoth with the imposing name of TerraMax. Louisiana’s Team CajunBot also used a six-wheeled vehicle. A fraction the size of the Oshkosh entry, it was based on an all-terrain vehicle more commonly used by the state’s hunters to navigate the bayou.
Urmson, Peterson, Whittaker—all of them wandered the event, talking to people just as technically minded as they were. It quickly became apparent that Red Team was among the biggest of the teams. Popular Mechanics gave them seven-to-one odds to win, highest of all their competitors’. The front-runner status positioned Red Team as the entry everyone else wanted to beat. Urmson had posted on the Red Team website a photo of Sandstorm after the rollover. Now, as he wandered the raceway, talking to the leaders of other teams, Urmson spied the photo on numerous computer monitors. Some other teams had made it their wallpaper—as motivation.
Adding to the excitement was the fact that DARPA’s public relations team had arranged for reporters and television producers from across the nation to visit the raceway. Urmson and his teammates had toiled for months in obscurity. The accolades they received at the Intel event had been nice, but the more common reaction to their work was incredulity. “A car that drives itself?” people would scoff. To many, it sounded ridiculous. The presence of the reporters going around interviewing anyone available reminded the competitors that their work was important. Important enough for the U.S. government to put up a million-dollar prize. Important enough, possibly, that it might save the lives of U.S. soldiers fighting in distant theaters of war.
On the morning of March 13, 2004, the start of the race was one of the most exciting moments Chris Urmson had ever experienced. The robots were lined up in their starting chutes. Media and military helicopters hovered in the sky. Grandstands supported hundreds of spectators, each of them getting whipped by the desert sand, and over it all, Tony Tether’s