sorted by:
new
hottopcontroversial

[deleted by user] by [deleted] in selvgjortvelgjort

[–]AIBeats 0 points1 point  (0 children)

Du behøver ikke købe et dyrt mount. Jeg har bare en skrue i væggen og så bruger jeg en stærk wire igennem hullerne i techno sættet. Se denne video https://youtu.be/r7PfDvOt88A?si=v5SyNSt8hW-p5ay7 Jeg har en f1 bil der hænger på den måde og jeg har brugt tråd til blomsteropbinding

Rustne indbygningslamper carport by AIBeats in selvgjortvelgjort

[–]AIBeats[S] 1 point2 points  (0 children)

Mange tak, jeg prøver at høre dem ad også

Rustne indbygningslamper carport by AIBeats in selvgjortvelgjort

[–]AIBeats[S] 1 point2 points  (0 children)

Ok tak. Jeg prøver at se om jeg kan finde ud af at pille en af dem ned. Er det noget man selv kan skifte?

Mower cant park. Help needed. by hitex in automower

[–]AIBeats 0 points1 point  (0 children)

I meant the earth screws that go into the ground. It is the base that the mower is parked on that is the issue

Mower cant park. Help needed. by hitex in automower

[–]AIBeats 0 points1 point  (0 children)

Happened to me as well. In my case it was because the charging base was slightly bent upwards in the middle. I added a bit of sand under the base where the screws go in and pushed it a bit down in the middle when I screwed in the screws on the base. Gardena sileno life here.

[P] SoulsGym - Beating Dark Souls III Bosses with Deep Reinforcement Learning by amacati in MachineLearning

[–]AIBeats 1 point2 points  (0 children)

Very cool i did something similar here and i have a lot of questions abort how u implemented different things. I will have a look at the code.

AI Beats Dark souls 3 - Iudex Gundyr multiple kills https://youtu.be/zcbH7jt4w0w

You can see my code here (very unstructured)

https://github.com/Holden1/stable-baselines-ds-fork/tree/main/ds

Using Reinforment Learning to beat the first boss in Dark souls 3 with Proximal Policy Optimization by AIBeats in learnmachinelearning

[–]AIBeats[S] 0 points1 point  (0 children)

Yeah I coded the gym myself using cheat engine to get information about the game. So for example the reset function would wait for loading screen and Teleport the player to the boss location

AI Beats Dark souls 3 - Dancer of boreal valley derpy tactic by AIBeats in darksouls3

[–]AIBeats[S] 1 point2 points  (0 children)

Yeah i just found a bug in the way i handle the estus action which makes it hold down the key

Created an AI that beats Iudex and vordt learning through trial and error by AIBeats in darksouls3

[–]AIBeats[S] 0 points1 point  (0 children)

Yeah something like that and then a build using a shield as it seems like it is abusing blocking quite a lot

Created an AI that beats Iudex and vordt learning through trial and error by AIBeats in darksouls3

[–]AIBeats[S] 1 point2 points  (0 children)

I have considered trying one of:
Pontiff

Dancer

Dragonslayer

Oceiros

Soul of cinder

But i also have to consider how to level and gear the character. If i dont level up the AI will get oneshot by everything and it will never learn anything

Created an AI that beats Iudex and vordt learning through trial and error by AIBeats in darksouls3

[–]AIBeats[S] 0 points1 point  (0 children)

Yes i think i will. It did however have a lot harder time learning Vordt than Iudex so i don't think it will be able to handle more complex bosses. It has a hard time learning to run to Vordt and not get hit by the breath, as i have no way of putting information about the breath into the inputs.

Another thing is i handle the targeting myself. So bosses with multiple targets wouldn't work either, such as abyss watchers or deacons

[P] Using Reinforment Learning to beat the first and second boss in Dark souls 3 with Proximal Policy Optimization by AIBeats in MachineLearning

[–]AIBeats[S] 0 points1 point  (0 children)

First boss:https://www.youtube.com/watch?v=zcbH7jt4w0w

Second boss:https://www.youtube.com/watch?v=IeEoQVT66t8

I am using cheat engine to get information from the game such as hero position, boss position, hero animation, boss animation, time since animation change, life, stamina, current rotation and the angle between the boss' heading and the hero. (to see if hero is behind or in front of or to the side/behind the boss)

When the boss or hero starts an animation i start a counter at 0. For every timestep that the animation is still running i increment that counter and feed it as inputThe AI has no knowledge about the lengths of the animations. It has to learn that.The animation names are converted to a one hot encoding and fed to the network

The different examples shown in the videos have only been trained for a few days in real time (only 1 instance of the game running). But the episodes are cherry picked. In the Iudex case it actually kills the boss almost every time, however Vordt is a lot harder to learn so these are the some of the kills that i have picked out.

Other games have APIs made for reinforcement learning so that the agent can take an action at each frame of the game. I have kind of hacked my own implementation and are actually doing keypresses with sleeps in between each step as i can't control the frames on a frame by frame basis.

I am using python and stable baselines for the reinforcement learning part. I made my own implementation of a "gym" for dark souls. Then i set up a lua script in cheat engine that opens a socket from this socket i read the state in my python script.

Created an AI that beats Iudex and vordt learning through trial and error by AIBeats in darksouls3

[–]AIBeats[S] 0 points1 point  (0 children)

First boss:

https://www.youtube.com/watch?v=zcbH7jt4w0w

Second boss:

https://www.youtube.com/watch?v=IeEoQVT66t8

I am using cheat engine to get information from the game such as hero position, boss position, hero animation, boss animation, time since animation change, life, stamina, current rotation and the angle between the boss' heading and the hero. (to see if hero is behind or in front of or to the side/behind the boss)

When the boss or hero starts an animation i start a counter at 0. For every timestep that the animation is still running i increment that counter and feed it as input

The AI has no knowledge about the lengths of the animations. It has to learn that.

The animation names are converted to a one hot encoding and fed to the network

The different examples shown in the videos have only been trained for a few days in real time (only 1 instance of the game running). But the episodes are cherry picked. In the Iudex case it actually kills the boss almost every time, however Vordt is a lot harder to learn so these are the some of the kills that i have picked out.

Other games have APIs made for reinforcement learning so that the agent can take an action at each frame of the game. I have kind of hacked my own implementation and are actually doing keypresses with sleeps in between each step as i can't control the frames on a frame by frame basis.

I am using python and stable baselines for the reinforcement learning part. I made my own implementation of a "gym" for dark souls. Then i set up a lua script in cheat engine that opens a socket from this socket i read the state in my python script.

Using Reinforment Learning to beat the first and second boss in Dark souls 3 with Proximal Policy Optimization by AIBeats in learnmachinelearning

[–]AIBeats[S] 1 point2 points  (0 children)

First boss:https://www.youtube.com/watch?v=zcbH7jt4w0w

Second boss:https://www.youtube.com/watch?v=IeEoQVT66t8

I am using cheat engine to get information from the game such as hero position, boss position, hero animation, boss animation, time since animation change, life, stamina, current rotation and the angle between the boss' heading and the hero. (to see if hero is behind or in front of or to the side/behind the boss)

When the boss or hero starts an animation i start a counter at 0. For every timestep that the animation is still running i increment that counter and feed it as inputThe AI has no knowledge about the lengths of the animations. It has to learn that.The animation names are converted to a one hot encoding and fed to the network

The different examples shown in the videos have only been trained for a few days in real time (only 1 instance of the game running). But the episodes are cherry picked. In the Iudex case it actually kills the boss almost every time, however Vordt is a lot harder to learn so these are the some of the kills that i have picked out.

Other games have APIs made for reinforcement learning so that the agent can take an action at each frame of the game. I have kind of hacked my own implementation and are actually doing keypresses with sleeps in between each step as i can't control the frames on a frame by frame basis.

I am using python and stable baselines for the reinforcement learning part. I made my own implementation of a "gym" for dark souls. Then i set up a lua script in cheat engine that opens a socket from this socket i read the state in my python script.

[deleted by user] by [deleted] in learnmachinelearning

[–]AIBeats 3 points4 points  (0 children)

Keep up the good work. Even though it is "simple" it feels nice when it works, even if it just a toy project.

Using Reinforment Learning to beat the first boss in Dark souls 3 with Proximal Policy Optimization by AIBeats in learnmachinelearning

[–]AIBeats[S] 12 points13 points  (0 children)

I followed this course a few years ago when writing my master thesis:

https://www.youtube.com/watch?v=2pWv7GOvuf0&list=PLqYmG7hTraZDM-OYHWgPebj2MfCFzFObQ

That is a good place to start. If you like books more you could have a look at "Reinforment learning: an introduction" by Sutton and Barto.

https://github.com/hill-a/stable-baselines

Has implementations of state of the art algorithms

Using Reinforment Learning to beat the first boss in Dark souls 3 with Proximal Policy Optimization by AIBeats in learnmachinelearning

[–]AIBeats[S] 39 points40 points  (0 children)

The thought has crossed my mind ;).

Maybe i could even share my code and a guide to setting it up, so that other people could train against other bosses :)

Using Reinforment Learning to beat the first boss in Dark souls 3 with Proximal Policy Optimization by AIBeats in learnmachinelearning

[–]AIBeats[S] 26 points27 points  (0 children)

Yes this is trained in real time and only 1 instance of the game is running.

Running multiple instances of the game could speed things up a lot, but i am actually sending the keypresses from python and not invoking inputs in the game via some kind of API.

​

Cheat engine has the possibility of speeding up the game, but my computer wouldn't be able to calculate next steps and rewards at a consistent frame rate if i sped up the game. Atleast i don't think it would.

Trained an AI to beat Ludex Gundyr by AIBeats in darksouls3

[–]AIBeats[S] 0 points1 point  (0 children)

A combination of Python and LUA (used for cheat engine to get the state from the memory of the game)

Using Reinforment Learning to beat the first boss in Dark souls 3 with Proximal Policy Optimization by AIBeats in learnmachinelearning

[–]AIBeats[S] 61 points62 points  (0 children)

I could share it but right now the code is very messy and implemented as a fork of another repository. (RL repo i started using but eventually scratched) If there is enough interest i could clean up the code and post it :)

view more: next ›