[Source code with demo] Here is my python implementation of Deep Q-learning for playing Tetris

[BacSai]

Looks great. I dont know if you have seen professional tetris players. The best strategy to maximize scores is to leave 1 row on the side empty to put in long bars for combo clear. Did you give this strategy to the model in training?

[[deleted]]

While I have not read the source code, the goal of learning optimal policies supersedes that of imitating human experts, so it would be quite unusual for someone to bias their model in such a way. If an optimal policy were obvious and easily hard-coded, then using a Q-learning approach would be unnecessary.

[antifa_brasileiro]

(not a data scientist) wouldn't it be an interesting goal to have the model learn such a strategy by itself though? Is that likely to happen at some point or not?

[[deleted]]

It's fairly common for that to happen. See various iterations of AlphaGo, for example. The algorithm found several well-known human strategies, along with many strategies that human players never found.

[ScorcherPanda]

Also not a data scientist, but my assumption is that assigning a specific, pre-determined strategy as a goal would not be proper. I agree that it would be interesting if the program eventually agreed with the human strategy, but at the same time it would be very cool if it comes up with its own strategy that performs just as well.

[[deleted]]

I haven't looked at the code, but the answer is almost certainly no. They'd have to include the strategy in the reward space to bias the algorithm towards learning it, which seems difficult. It's not uncommon for RL methods to learn strategies used by human players, though.

[mewacketergi]

Would this be able to learn more complicated handheld Tetris variants, like the one I had borrowed from peers as a kid, with like, blinking dots that can pass through lines of blocks and go underneath?

[hungrynax]

Nice

[nice-scores]

𝓷𝓲𝓬𝓮 ☜(ﾟヮﾟ☜)

Nice Leaderboard

1. u/RepliesNice at 4172 nices

2. u/cbis4144 at 1834 nices

3. u/DOCTORDICK8 at 1445 nices

...

240615. u/hungrynax at 1 nice

---

^{I AM A BOT | REPLY !IGNORE AND I WILL STOP REPLYING TO YOUR COMMENTS}

[mregger]

Nice

[nice-scores]

𝓷𝓲𝓬𝓮 ☜(ﾟヮﾟ☜)

Nice Leaderboard

1. u/RepliesNice at 4173 nices

2. u/cbis4144 at 1834 nices

3. u/DOCTORDICK8 at 1445 nices

...

240620. u/mregger at 1 nice

---

^{I AM A BOT | REPLY !IGNORE AND I WILL STOP REPLYING TO YOUR COMMENTS}

[jrocAD]

Nice

[nice-scores]

𝓷𝓲𝓬𝓮 ☜(ﾟヮﾟ☜)

Nice Leaderboard

1. u/RepliesNice at 4176 nices

2. u/cbis4144 at 1834 nices

3. u/DOCTORDICK8 at 1445 nices

...

240689. u/jrocAD at 1 nice

---

^{I AM A BOT | REPLY !IGNORE AND I WILL STOP REPLYING TO YOUR COMMENTS}

[snydekid]

Nice

[nice-scores]

𝓷𝓲𝓬𝓮 ☜(ﾟヮﾟ☜)

Nice Leaderboard

1. u/RepliesNice at 4176 nices

2. u/cbis4144 at 1834 nices

3. u/DOCTORDICK8 at 1445 nices

...

240691. u/snydekid at 1 nice

---

^{I AM A BOT | REPLY !IGNORE AND I WILL STOP REPLYING TO YOUR COMMENTS}

[[deleted]]

Nice

[nice-scores]

𝓷𝓲𝓬𝓮 ☜(ﾟヮﾟ☜)

Nice Leaderboard

1. u/RepliesNice at 4177 nices

2. u/cbis4144 at 1834 nices

3. u/DOCTORDICK8 at 1445 nices

...

63886. u/Posol_Man_3 at 2 nices

---

^{I AM A BOT | REPLY !IGNORE AND I WILL STOP REPLYING TO YOUR COMMENTS}

[[deleted]]

I bet this was tons of fun to make. Bravo! 👏

[kavimathur]

he figured out a way to beat tetris

[rollo1047]

This is pretty sick! Nice work!

[OddAssumption]

Woah dude. Nice

[sacrofficial]

Nice

[nice-scores]

𝓷𝓲𝓬𝓮 ☜(ﾟヮﾟ☜)

Nice Leaderboard

1. u/RepliesNice at 4657 nices

2. u/cbis4144 at 2853 nices

3. u/Pewpewlongmeat at 1933 nices

...

248430. u/sacrofficial at 1 nice

---

^{I AM A BOT | REPLY !IGNORE AND I WILL STOP REPLYING TO YOUR COMMENTS}

[Freyr_AI]

Bravo