Two New Papers Tackle the Same Problem: Making Autonomous Vehicles Less Confident and More Safe
Researchers are finally addressing the gap between what self-driving systems predict and what they actually do about it.
Crédito de imagen: Lottie animation by Centre Robotics (LottieFiles Free, used with credit). · source
Autonomous vehicles have a confidence problem, and I don't mean they lack it. Two papers published this week on arXiv attack the same fundamental issue from different angles: current self-driving systems are often too certain about uncertain futures, and that overconfidence can kill people.
The disconnect between prediction and planning has been a known bottleneck for years. From my time in hardware, I learned that the most dangerous systems aren't the ones that fail obviously. They're the ones that fail while reporting everything is fine. These papers suggest the AV industry is finally taking that lesson seriously.
What's actually broken in current systems?
Most autonomous driving stacks work in stages. First, a perception module identifies objects. Then a prediction module guesses where those objects will go. Finally, a planning module decides what the vehicle should do. The problem is the handoff between prediction and planning.
Current approaches typically do one of two things, and both have issues. Some systems compress all their predictions into a single "most likely" future and plan around that. Others use black-box end-to-end neural networks that skip the interpretable planning step entirely. The first approach ignores uncertainty. The second hides it.
Look, if your prediction module says there's a 60% chance the pedestrian walks forward, a 30% chance they stop, and a 10% chance they dart into traffic, you need a planner that actually reasons about all three scenarios. Most don't.
How does the diffusion-based approach work?
The first paper, from a team whose affiliations aren't specified in the abstract, proposes what they call "sample-conditioned differentiable planning." The core idea is to use a conditional diffusion model (the same family of models behind image generators like Stable Diffusion) to generate multiple plausible futures rather than picking one.
Cobertura relacionada
More in Autonomy
European driving data and a novel 'negative space' approach from MIT suggest we've been thinking about city navigation wrong.
James Chen · 7 hours ago · 5 min
New research tackles the boring-but-critical problems of indoor navigation, and I'm quietly impressed.
Robert "Bob" Macintosh · 7 hours ago · 3 min
A library quadruped and a budget LiDAR system both tackle the same problem: knowing when to trust your sensors and when to admit you're lost.
James Chen · 8 hours ago · 5 min
Musk is squeezing bankers on fees, but when you're raising this much money, even crumbs add up to $500 million.
