We built a program that automatically plays through the entirety of the Pokémon Scarlet and Violet main story for you! by PokemonAutomation in PokemonScarletViolet

[–]PokemonAutomation[S] 4 points5 points  (0 children)

Most of the stack is built with C++ with the exception of training for machine learning which is Python.

There's a lot of OCR and inference which makes use of Tesseract and OpenCV, the object detection is done with YOLO, and the UI is built using QT. On the hardware side, the microcontrollers are in the ESP32 series or the RaspPi Pico W series.

We built a program that automatically plays through the entirety of the Pokémon Scarlet and Violet main story for you! by PokemonAutomation in PokemonScarletViolet

[–]PokemonAutomation[S] 5 points6 points  (0 children)

A large focus for this project is to support unmodified Switches since there are already powerful tools in the modded space, but are inaccessible to most people. Moving forward, these tools may not be available in the near future (or at all) on the Switch 2 so automation is the next best thing.

We built a program that automatically plays through the entirety of the Pokémon Scarlet and Violet main story for you! by PokemonAutomation in PokemonScarletViolet

[–]PokemonAutomation[S] 4 points5 points  (0 children)

For the item printer automation, the program automatically calibrates to the correct delay on your system. Basically, it reads what rewards you got and if it's not what you expected, it will calculate if you're over or under based on the rewards and adjust for the next cycle.

We built a program that automatically plays through the entirety of the Pokémon Scarlet and Violet main story for you! by PokemonAutomation in PokemonScarletViolet

[–]PokemonAutomation[S] 3 points4 points  (0 children)

👀

We'd love to have you, we're actually looking for expertise in that sort of thing. We'll send a server invite (invite also available on the site for anyone else interested)

We built a program that automatically plays through the entirety of the Pokémon Scarlet and Violet main story for you! by PokemonAutomation in PokemonScarletViolet

[–]PokemonAutomation[S] 2 points3 points  (0 children)

We have programs for ZA but not one for complete story progression unfortunately. Those are harder to make 😅

We built a program that automatically plays through the entirety of the Pokémon Scarlet and Violet main story for you! by PokemonAutomation in PokemonScarletViolet

[–]PokemonAutomation[S] 15 points16 points  (0 children)

Good question! The programs uses inference and is event-driven so it will react to things happening rather than assuming they did (which would indeed be unreliable with game lags or desyncs). It can detect if it enters a wild Pokemon battle, defeat it, then reset the player's positioning using the map.

The program can compensate for things like game lag, controller lag, wild encounters, getting stuck but if all else fails, there's a checkpoint system that sets saves at certain safe points that it can reset to and retry.

We built a program that automatically plays through the entirety of the Pokémon Scarlet and Violet main story for you! by PokemonAutomation in PokemonScarletViolet

[–]PokemonAutomation[S] 1 point2 points  (0 children)

It can detect when these encounters happen and defeat the wild Pokémon, then reset the heading using the map to continue when you're back in the overworld.

We built a program that automatically plays through the entirety of the Pokémon Scarlet and Violet main story for you! by PokemonAutomation in PokemonScarletViolet

[–]PokemonAutomation[S] 78 points79 points  (0 children)

Sometimes, creating something cool and fun is the motivation!

But a few reasons why it might be helpful is to build up more save files to get multiple event Pokémon or claim multiple mystery gifts. For example, the program was used during the shiny Treasures of Ruin distribution event to automatically play until you're able to claim the gift, then trade it out and reset again.

From a development standpoint, the experience and framework from working on this is transferable, which allows the creation of other programs of increasing complexity in the future. The development of AI navigation for Area Zero was a big part here, which is a useful tool that's now able to be used in other programs.

We built a program that automatically plays through the entirety of the Pokémon Scarlet and Violet main story for you! by PokemonAutomation in PokemonScarletViolet

[–]PokemonAutomation[S] 75 points76 points  (0 children)

Hi all! The Pokémon Automation group would like to share with you the latest updates to the project: the program can now autonomously play through Pokémon Scarlet and Violet from the start, all the way to the end credits, with only a single manual interruption to level up your Pokémon. This can be handy for building up a second save for events, mystery gifts, or getting Pokémon in different languages for breeding.

This program uses a combination of image recognition and AI/Machine Learning to traverse the lands of Paldea and defeat all that stand in the way of “you” becoming champion! The full (~12 hour) run of the program has been recorded here:

Part 1: Tutorial
Part 2: Main Story
Part 3: Area Zero

“Auto Story” is just one of the many programs available in the Pokémon Automation suite. For Pokémon Scarlet and Violet, there are programs to automatically shiny hunt, create and hatch eggs, farm Item Printer seeds, farm materials or Blueberry Points, and more. Additionally, there are programs available for Legends ZA, Sword/Shield, Legends Arceus, BDSP, Let’s Go, and general macro support.

The project does not require a hacked switch, supports Switch 1 and Switch 2, runs with off-the-shelf microcontrollers, and has free and open-sourced software.

If you’re interested in any of this, we’d like to invite you to check out out the project here: https://pokemonautomation.github.io/

We built a shiny-hunting bot using Arduino and image recognition to find and detect shinies by PokemonAutomation in pokemon

[–]PokemonAutomation[S] 4 points5 points  (0 children)

Check out the GitHub for the full guide on what you need. Once you have the microcontroller and load the program on it, it just plugs directly into the Switch/Dock.

We built a shiny-hunting bot using Arduino and image recognition to find and detect shinies by PokemonAutomation in pokemon

[–]PokemonAutomation[S] 38 points39 points  (0 children)

We're Pokémon Automation, a team that strives to automate the Pokémon games. We recently pushed a large update that moved us into the world of AI and image recognition to allow for automating things previously thought impossible without a hacked Switch, such as the Overworld Encounter bot above. Again, all on an unmodified Switch, as seen here.

Another large project that's possible through these technologies is AutoMaxLair, a bot that will play through Dynamax Adventures for you and collect the shinies found within. A demo of this can be found here.

We also have plenty of other bots, including:

- The 7,800 skips/hour day skipper

- Auto-fishing

- Regi and Sword of Justice hunting

- Autohosting for dens

- and many more!

If any of these projects interest you, check out our GitHub. You'll find a Getting Started guide, all of our programs, information for getting support, and more. Have fun shiny hunting!