NVIDIA used GPT-4 to create a autonomous AI agent that goes around Minecraft, explores and advances the tech tree.
The incredible thing here is that the bot writes scripts for itself that makes it better at playing the game. So if it meets a spider, it writes a script for how to kill that spider. Once that script is working, it adds that "skill" to it's "skill library". Over time it keeps advancing and developing better abilities.
It's skill library is also transferable to other AI agents like AutoGPT.
This seems like it has a lot of implications for the future of software development. This is able to generate code and keep making it better without human help. Everything is automated.
Here's a video overview:
https://youtu.be/7yI4yfYftfM
GPT-4 here is used as a sort of "reasoning engine". It decides on what to do in the game, but also it creates the code to make itself better and add new skills for it to use.
Another thing is GPT-4 doesn't have vision. All the data is fed into it through a text prompt.
It's told "you have a fishing rod, you are standing next to a river, and around you are blocks of sand, and a pig. What do you want to do?".
What does this mean for software developers?
It seems like GPT-4 can now autonomously create, test and optimize code. It decides on what it needs to do like:
"Craft 1 Stone Ax"
Then it writes the JavaScript code to make that happen, tests to make sure it's working and then adds it to a library that it can use later.
It works like a developer, thinking through the task, developing and testing code and continuously optimizing the entire application to make sure it's working well and getting updated.
It seems like this would rapidly replace developers. You still need some sort of a person that sets up the environment for the AI to start and then also maybe "babysits" it to make sure it's not going off the rails, but overall it seems like it will largely do it's own work.