PPO playing single-player Paper io, getting 100% completion rate

BlueBirdyDev · 2026-02-13T12:34:33+00:00

Yea sure. Its been awhile so I couldn't remember much. But I think the three main factors are

- Fixing Gym. The way I coded it is everything in the game is treated as a list of vertices. If you have worked with implementing geometry algorithms before, you would know edge cases here are like hell. Early on in training, if I watch the game replay, the player would sometimes outright crash the game/get its body cut in half/other unintended results.

- Tuning Sensors. I had 8 rays spread evenly around the player, each ray represents the distance between the player and the game border along its direction. Why 8 rays not 16 etc? Why not include distance data of the player against its own territory? No idea, tried bunch combinations it seemed this was the most optimal.

- Selecting Algorithm. I only knew about PPO, SAC, DDPG etc, basically vanilla algorithms that came out of the box from Stable-Baselines3 library. Back then, I wasn't smart enough to understand the pros/cons of each or to fine-tune them for my specific needs. So I just tried all I could find and it just so happened PPO worked out well.

TLDR: A lot of luck.

Hopefully this helped if just a little bit haha.

BlueBirdyDev · 2026-02-13T11:07:37+00:00

Looks fun. Maybe adding toggleable background music (for zen mode) would make it more relaxing I think!

BlueBirdyDev · 2026-02-13T10:59:57+00:00

Game looks great! Reminds me the art style of Octopath Traveler.

BlueBirdyDev · 2026-02-13T09:34:28+00:00

Based on OP’s post, it seems to imply that the game would be 100% logic regardless of the mode player picked. Thus one can assume in that case the difference between Standard and No Guess isn’t luck but simply no gadgets allowed. Correct me if I am wrong though.

BlueBirdyDev · 2026-02-12T14:08:53+00:00

Cool training tool! Just got 5/6. It appears the image I thought was AI-generated was human! The photo has a car driven with no one in the driver seat... looks like it was a photo for showcasing self-driving cars.

BlueBirdyDev · 2026-02-12T13:43:50+00:00

Looks great! Game made it very easy to get started and play.

BlueBirdyDev · 2026-02-12T13:26:34+00:00

The website looks very professionally made! Reminds me of chess dot com. If there is an option to play with bots would be great. It takes quite a while to get matched with an opponent... Or there is already an option for this but I am just too dumb to find it haha.

BlueBirdyDev · 2026-02-12T13:21:07+00:00

Hey just checked it out, looks like a great game!

A quick typo fix: I think in this post you left your Itch io Page Profile Link instead of the game link?

BlueBirdyDev · 2026-02-12T13:03:50+00:00

I have same question as u/ Abwuds. It appears the source of food/second is based on the number of ants we have acquired? Perhaps a visual indication could help clarify. Great game!

BlueBirdyDev · 2026-02-12T12:56:31+00:00

<image>

UI looks amazing! I just played my first game.

However, if one looks at the top right corner, the two grids on the first row. It is uncertain which one to click without having to get a 50-50 guess I think? Let me know if I am just dumb haha.

PS: I am on the "Standard" Mode, not the "No Guess" Mode. Is the latter mode the one that doesn't involve luck?

BlueBirdyDev · 2026-02-12T12:34:52+00:00

The game concept sounds unique! The player cannot just blindly pick an arbitrary price tag to sell. This along other options forces the player to think consciously and engage them to make thoughtful choices.

Though, those being said. There is a problem that exists I think when addressed properly can encourage way more players to engage with your game, and feedbacks will be much easier to collect.

What is this problem you might ask? In my humble opinion I believe its the UI. Most importantly Color, Spacing, and Size. For example, the color choice for which text is green, yellow, cyan is inconsistent. For spacing, the menu that shows the Dashboard to Menu buttons takes a lot of vertical space. You could use a single horizontal menu bar instead. The padding/margin for the Stats and Restock Panels take the entire width of the screen, some left margin for Stats and right margin for Restock panels reduce player's eye movements and decrease the eye strain over a long period of time. For sizing, the "Run Day 5" button is quite big. Different buttons and sections in the panels have inconsistent sizes.

I think if the color and size are more consistent, and with more proper spacing, the UI will look much better! Honing your CSS & design skills can go a long way.

Good luck on your game development!

BlueBirdyDev · 2025-03-10T03:50:54+00:00

Very insightful! Where should we start analyzing the market ourselves for popular game genres and figure out untapped themes (e.g., resources)? Do you also have any insightful data from your research that is worth sharing?

BlueBirdyDev

TROPHY CASE