Codex Minecraft Gameplay

All projects

Agents / Skills

Codex Minecraft Gameplay

A toolkit for exploring, gathering, crafting, and building in Minecraft with GPT-6 Astra

byWuyang Zhou

Minecraft challengeOpen source

Codex Minecraft Gameplay media is blocked

Allow external media to connect to the provider and play this content.

Description

A Python-based toolkit that enables computer-use agents to play Minecraft via Windows keyboard, mouse, and screenshot events. It allows models to observe the game interface, perform multi-step actions like gathering materials or crafting, and verify outcomes through visual feedback.

Descriptions, tags, and model credits may be AI-generated or inferred from public sources and can be incomplete or wrong. Learn more.

Details

Why this is interesting: Demonstrates complex agentic gameplay in a 3D environment using frontier computer-use capabilities to mine diamonds…
Attributed to: @wuyang_zhou
Built with: GPT-6 Astra GPT Image 2
Links: View tweet
Tags: #minecraft #computer-use #automation #python

Discovered: X
First posted: X · Sep 6, 2026
Listed: Added 9d ago
Build: Strong
Models: Strong

Prompt

mine a diamond in Minecraft using computer use

Source