Playing Minecraft with ChatGPT | Mindcraft

The Mindcraft project combines ChatGPT with the Mineflayer framework to create “Andy,” a Minecraft bot that is both a conversational assistant and an in-world agent capable of acting in the game.

Both Andy (the ChatGPT-controlled bot) and the human player use the same textual command interface, treating actions as callable functions with arguments and return values.

When Andy is asked to perform tasks not covered by predefined commands—such as building a custom house or digging a complex tunnel—Mindcraft gives ChatGPT access to a special new_action command.

Andy is tested in a real survival session on a private server, cooperating with the human player and a collaborator (Kobe) to gather resources, craft tools, and survive hostile mobs.