GPT-4 does almost everything, right? Now it can play Minecraft pretty well too.
From my story at Forbes:
A team of researchers from Caltech, Stanford, the University of Texas, and NVIDIA have built and shared a software agent named Voyager that plays Minecraft with insights and intelligence provided by GPT-4. Voyager learns, remembers, and exhibits what the team calls “exceptional proficiency in playing Minecraft,” obtaining 3X as many items, traveling 2X farther, and unlocking milestones 15X faster than previous state of the art software agents.
It’s also pretty good at innovating.
“Voyager is able to utilize the learned skill library in a new Minecraft world to solve novel tasks from scratch, while other techniques struggle to generalize,” the researchers report.