I want it! I want it! Automation scripts for Minecraft/Palworld—the more complex, the better. I need the kind that controls the game by simulating inputs!
Then… that’s it, just for AFK video recording to feed an AI, hehe. (If you think what you wrote is good, send me a video; if it’s really good, we can arrange payment upon delivery!)
If you’re talking about MC, you can try out the Mineflayer API, which is for Node.js.
Or if you want to stay in-game, you could also try modifying the Baritone mod.
You could also try NVIDIA’s Voyager.
It’s a heavily modified version of Mineflayer.
If they had deep enough pockets, openai/video-pretraining could also be used to create
this kind of neural network model that directly reads screen pixels and outputs keyboard/mouse actions.
Palworld
Player AI Automation Tool Example
AetherisAI Automation Toolkit: This is a typical solution for implementing “AI-controlled player” capabilities.
- Core Principle: It does not modify game memory or code. Instead, it works by capturing the screen and using a local YOLO neural network to perform real-time object recognition (such as identifying Pokémon, bosses, or resource points), then simulates player actions in response.
- Main Features: Includes auto farming/looting (automatically picks up Palworld Ore, coal, etc.), auto egg hatching (skips hatching countdowns), and a rare target radar (scans for shiny Pals and legendary bosses within a 500-meter radius).
- Safety Mechanism: Claims to rely solely on screen capture and local GPU processing without injecting into the process, making it theoretically harder for anti-cheat systems to detect.
Risk Notice
Please note that the official developer Pocketpair has explicitly stated they refuse to use generative AI technology in game development. While the official policy mainly targets the use of AI for generating art or text assets, these third-party automation scripts or plugins usually fall into a regulatory gray area and could result in account suspension or bans. Make sure you fully understand the risks before using them.
It’s the kind of script that needs to control the game by simulating clicks.
openai/video-pretraining, exactly.
There are several AIs on the market—how about combining them into one, fine-tuning it a bit, and then letting your AI try it out as a test run? What do you think?
Actually, it’s them who have to submit it, and it also needs to get approved. You need both keyboard & mouse and video for it to work, plus they only pay if you have enough keyboard & mouse time logged.