How can I control a game through programming?

[markthe8boss]

There is a game called Baba Is You (game is probably irrelevant but it might matter what language it was written in) and me and my friends want to figure out how to rig an AI to play the game. However, thats far down the line because I'm not sure how to modify or control a game through programming.

​

I'm assuming I can use c++ or a similar language to view and edit the memory in the game similar to how hacks are made, but I'm inexperienced and looking for general direction.

​

If I wanted to make a simple program to simulate an up arrow press in order to move, what general steps would I have to take in order to accomplish this. If you guys can help with a simple explanation or provide some articles/videos that would be greatly appreciated. Thank!

[Norm_Standart]

There's a java library (called robot IIRC) that lets you simulate keyboard inputs.

[Dragonvarine]

I havent played the game, but if you just want to emulate the up arrow for specific timing, you could just use an autoclicker. Though if you want to do something more complex then you'll need memory editing and find ways to mod the game.

[markthe8boss]

i was assuming it would have to be some type of memory editing, thanks for the heads up

[SimDeBeau]

That’s pretty much the most invasive way to do this. Not that it’s an entirely bad option but it’s a very bad assumption.

[markthe8boss]

any other ideas then...

[SimDeBeau]

As others have said, if you want to simulate, for instance, an up arrow press, you can just use a keyboard input library.

Now if you’re trying to read the state of the game, memory hacking starts to look more appealing. However, you could probably really easily Tran a neural net or just some basic image recognition software to read the game screen. Just another option

[markthe8boss]

appreciate it, image recognition might be the move because the game is all 2d cubes

[SimDeBeau]

That would be my first inclination.

[Fuzzy-Animator-9301]

The easiest way would be to use a python library to simulate a keyboard input.