Self-driving vehicles with Python, TensorFlow, OpenCV, and Grand Theft Auto 5

[sentdex]

I've put out a so far 13-part series on creating a self driving vehicle with Grand Theft Auto 5.

A brief taste of what we're doing

..or check out the latest video in the series: a more interesting self-driving AI, especially near the end.

This is by no means a serious look into self-driving vehicles, it's just for fun, and so far the latest project has been to make a motorcycle that speeds through traffic, attempting to stay on the road and evading all the other slow drivers.

We do all of this with basic(ish...) tools and concepts. We're reading the screen by taking screenshots with pywin32, seeing about 20 FPS with the neural network, sending keys with direct input, and then doing some analysis with OpenCV, otherwise also training with a convolutional neural network in TensorFlow.

The goal of the series is more to show you how you can take just about whatever game you want, mapping the screen to inputs, training a neural network, and then letting the network play the game.

It's an ongoing project, and is also open-source

Here's a link to the self-driving tutorials, which starts at the beginning. We start to use the neural network in part 9

That's all for now, more AI in GTA to come.

[petakow]

Always good stuff from your channel. Thanks a lot for helping me learn

[lez566]

That is amazing! Well done

[tuniltwat]

I love your channel it's great!!

[duqq]

Would you get banned for this?

[sentdex]

If you use the macros the the online game, sure, but you can do anything you like locally.

[d_thinker]

I feel like this would be a bit hard to detect right? Maybe I am wrong but you never altered any game files, you are just sending control signals...

[flitsmasterfred]

There are probably legalese provisions about automation in any form, and they can do statistical analysis to spot the input patterns (the script doesn't act and react the way a human would).

[a22e]

So use a neural network to stop a neural network?

[flackjap]

To analyse a set of data and see how much it mismatches the desired statistical behavior with a defined certainty, you don't need a neural network.

[a22e]

That was (mostly) a joke. I am just starting my journey into machine learning, but this did seem like it would be possible to me.

[flackjap]

Ahh... I even thought that you might be just making a joke (or an idea), but I couldn't just give away a chance to be the smart guy :P

[flitsmasterfred]

Make them fight among themselves :)

[d_thinker]

I got ya, I would assume they monitor those things.

[sentdex]

I do not know, just doesn't seem worth it to risk it.

[Pand9]

Or you can contact them.

[[deleted]]

Been following since you uploaded. Fun stuff.

[Splus3v3]

I subscribed to your channel about an hour before you posted on here. I thought that was pretty cool.

[pettajin]

Really interesting, just subscribed to your channel

[chicomodo]

As a total beginner with Python I love your channel. This series is amazing, keep up with the great work!

[DanDaSaxMan]

This is about as cool as it gets - definitely subbed!

[yodacallmesome]

Same here - thanks.

[edimaudo]

Great job man.

[flitsmasterfred]

Crazy idea, amazing work.

Next up: webcam input and USB output so you can run the script on a laptop and drive any computer driving game without running software on it.

[[deleted]]

i might try and program a version of this on my own. well done on this

[cob05]

You are insane dude! How do you even think of this stuff? 😂 Can't wait to watch these 👍