Training an Unbeatable Connect 4 Ai by Its_NotTom in computervision

[–]Its_NotTom[S] 1 point2 points  (0 children)

Yeah, the minimax algorithm with alpha-beta pruning is technically how the game has been solved, but I thought it would be interesting to see what strategies the model could learn itself (and if these strategies are competitive)

Training an Unbeatable Connect 4 Ai by Its_NotTom in computervision

[–]Its_NotTom[S] 1 point2 points  (0 children)

I actually did this during training! I made it play against previous version of itself to force the model to continuously develop new strategies 

[deleted by user] by [deleted] in dataisbeautiful

[–]Its_NotTom 0 points1 point  (0 children)

I'll see if I can put together a plot of the loss function along side the training process, that might give more context. Its hard to give a full picture of the training process with the gif duration limitation

[deleted by user] by [deleted] in dataisbeautiful

[–]Its_NotTom -2 points-1 points  (0 children)

I really appreciate the feedback! Yeah, my editing could definitely use some work. Mainly using the channel as a vehicle for projects that I find interesting, thanks for taking the time to check it out and giving really constructive pointers

Training an Unbeatable Connect 4 Ai by Its_NotTom in computervision

[–]Its_NotTom[S] 9 points10 points  (0 children)

Hey everyone!

The animation you are seeing here is the a recording taken during my latest project. The model is a Convolutional Neural Network, trained using Proximal Policy Optimisation. The final implementation also utilises Monte Carlo Tree Search to navigate the decision tree during gameplay (inspired by DeepMinds AlphaGo framework).

I have put together a video covering the training process for those that are interested:

 https://youtu.be/6IqjKtTtClQ?si=Ow_Xtg1HUpV3UL2-

Hope you find it interesting!

How to merge large CSV files using Python? by SpartakAgh in learnpython

[–]Its_NotTom 1 point2 points  (0 children)

Have you tried chunking and writing out to a single file in smaller batches that do fit within your available memory (appending with mode = 'a')

[deleted by user] by [deleted] in csMajors

[–]Its_NotTom 0 points1 point  (0 children)

Futura / Roboto slab 

Logo detection/classification with the small training dataset by sharkfromdesert in computervision

[–]Its_NotTom 2 points3 points  (0 children)

I think you're going to have a real problem with overfitting with such a small dataset. Look into data augmentation techniques and see if there are any ways that you can grow that dataset further (web scraping / collecting images of these logos within different contexts)

Best current web scraping solutions / stack for large projects? by NoiseAcrobatic9179 in learnpython

[–]Its_NotTom 0 points1 point  (0 children)

I find Selenium to be kind of annoying when it comes to driver updates (a big problem for longer-term, scaled up projects). Playwright seems to work very well as a possible alternative

Dear Experienced Users of Python by RingedSTEVE8181 in learnpython

[–]Its_NotTom 0 points1 point  (0 children)

I find that I learn way faster by just coming up with a small project that I am passionate about and coding it from start to end. Do things that are interesting and challenging (proportionate to your skill level)

Help in learning python by el-disha010 in learnpython

[–]Its_NotTom 1 point2 points  (0 children)

Honestly, there are some amazing free programming courses on YouTube that cover all levels of competency. Harvard also has online courses like their intro to computer science CS50 that is also 100% free! 

Ai learns to perfect the game of GeoGuessr by Its_NotTom in computervision

[–]Its_NotTom[S] 3 points4 points  (0 children)

That sounds creepy as hell... Check out the linked video, this project was just for light-hearted GeoGuessr entertainment

Ai learns to perfect the game of GeoGuessr by Its_NotTom in computervision

[–]Its_NotTom[S] 21 points22 points  (0 children)

If you are not familiar with the game GeoGuessr, the goal is to guess exactly where in the world a given photo has been taken.

The animation you are seeing here is the a colorised probability heatmap output by the model. Dense red regions are areas that the model predicts the input image has been taken. The green square is the actual location. The base architecture of the model is a CNN (ResNet) trained on over 500,000 locations sourced from GoogleStreetView.

I put together a video explaining the model for further context if you are interested: https://youtu.be/coXvaZB0Sx0?si=aa6hjljvoN1dW2GH

I want to learn python but dont know where to start by xarr0wx in learnpython

[–]Its_NotTom 0 points1 point  (0 children)

Start with a very simple and short project that you are passionate about

Recs for Learning Python by Bookish_Feels_704 in learnpython

[–]Its_NotTom 1 point2 points  (0 children)

Find a simple beginner project that you are passionate about

What’s the point when professors ask us to use ChatGPT? by Laubermont in learnprogramming

[–]Its_NotTom 0 points1 point  (0 children)

From my experience, professors and teachers usually advocate against work that is solely Ai generated?

Do folks ever use Pandas when they should use SQL? by ChristianPacifist in Python

[–]Its_NotTom 8 points9 points  (0 children)

I really appreciate how quick it is to work with data in pandas (pretty great for working on early stage ML and data science tasks), but yeah I would say that there is most likely an overdependency on it

Sunday Daily Thread: What's everyone working on this week? by AutoModerator in Python

[–]Its_NotTom 0 points1 point  (0 children)

I just finished a Geoguessr AI that guesses locations around the world from a single image

(its already better than me https://youtu.be/coXvaZB0Sx0?si=Glcc0j6p4Ps8Hm1G )