The real world discovers the bugs; the simulation amplifies the cure. Here is where the blog post gets deep.
This creates a terrifying feedback loop. The AI gets better not by being told what to do, but by being shown a million ways to die. google driving simulator
How do you train for the "once in a lifetime" event, when that event is the only one that matters? The Google Driving Simulator is a digital twin of reality. But unlike a video game like Grand Theft Auto , which is built to be fun, this simulator is built to be miserable . It is a machine designed to generate infinite anxiety for a piece of software. The real world discovers the bugs; the simulation
What happens to the AI when it has driven 100 billion miles in the simulator and never been punished for speeding? What happens when it has run 10 million red lights in the safety of the cloud? The AI gets better not by being told