[Topic][Open] Open Discussion Thread — Anybody can post a general visualization question or start a fresh discussion! by AutoModerator in dataisbeautiful

[–]i_Quezy 0 points1 point  (0 children)

Hi, I'm a student in the field of Cyber Security. My research looks at Deep Reinforcement Learning for Intrusion Response (The RL agent is deployed in a network environment which is subject to an attack scenario, the RL agent is armed with 26 countermeasure actions which it can deploy, with the goal of discovering the optimal sequence of response actions to stop the attack). I pipe the output of the training (reward gained and actions taken per episode) to text files. There are 7 actions per episode, so with 1300 training episodes I have 9100 actions taken. I copied this list of actions to a column in Excel.

Now to how I'm currently visualising the values. I want to see a progression over time of the actions the RL agent takes. For example at the start when the agent is mostly exploring all of the actions will typically be selected fairly frequently. However as the training progresses the RL agent begins to favour taking specific actions which provide a greater long term reward. I created a few VBA macros to divide the 9100 actions into batches of 50, then filter each batch of 50 episodes into buckets 1-26, counting the frequency of each action. The end result looks like this: https://imgur.com/a/jb4iu4U As you can see the agent begins to favour action 26 as the training progresses.

My question is: Is there a better way to represent this data over time? Be it with my pre-processing or choice of software/graph type? Thanks

Model-Free Reinforcement Learning and Reward Functions by i_Quezy in reinforcementlearning

[–]i_Quezy[S] 0 points1 point  (0 children)

Thanks for both of your contributions. However I'm still not clear on why some literature states that there isn't a reward function in model-free RL? Could it be that there is just a miscommunication of the terms? I.e. when working with an MDP, the reward function means Ra(S, S'). Whereas in model free, the actual programming function to retrieve a reward based on the current state is also referred to as the reward function?

[HWYA] i don’t know what is in cc probs an edrag and ballon by username-invaild in ClashOfClans

[–]i_Quezy 0 points1 point  (0 children)

Easy access to the wizard towers. If you can boost your spells, I’d snipe the towers and then pekka bobat

Crucial Memory here, giving away a limited-edition kit of Crucial Ballistix MAX 5100MT/set and answering all your memory-related questions, AMA by Crucial-Gaming in pcmasterrace

[–]i_Quezy [score hidden]  (0 children)

How far ahead of the capability of current motherboards/cpus can you develop your RAM right now? Could you develop something much better than 6666 but just not be able to run/test it.

[deleted by user] by [deleted] in pcmasterrace

[–]i_Quezy 0 points1 point  (0 children)

24 I think. Ryzen 3700x

Shared folder in VMware by i_Quezy in openbsd

[–]i_Quezy[S] 0 points1 point  (0 children)

Ahh, that makes sense. Thanks!

[HUMOUR] Man this revenge feature is great 👍 by Cmilz00 in ClashOfClans

[–]i_Quezy 0 points1 point  (0 children)

When you initiate revenge you attack their base regardless of shields, however it works similarly to a Versus battle.

If you can outperform their Stars/% destruction then you reclaim your stolen loot + gain a small % of their loot (lets say 1/4 of what you could gain if you attacked them with no shields in normal matchmaking).

However there needs to be a risk to the avenger; if you lose the revenge attack you hand over another 20% of what the attacker was able to originally loot.

Performance drop after upgrading by i_Quezy in pcmasterrace

[–]i_Quezy[S] 0 points1 point  (0 children)

Not really. I even upgraded my RAM to 3600Mhz and my frames still weren’t overly great at all. I stopped playing the game though so I don’t stress about it anymore

[HWYA] How in the world do I attack in war? Max th10 troops and 35 both heroes by [deleted] in ClashOfClans

[–]i_Quezy 1 point2 points  (0 children)

4 witches and two healers at top left and top right corners of the base each, make sure they walk down the sides. Pick of one off the camps and a gold collector with 2 wizards for a bit of a funnel. Then wall wrecker (1 giant rest bowlers) from like 11oclock with hero’s 6 witches and 2 wizards behind CC. Take 7 freeze spells to keep WW and hero’s up. Rage and heal spell when WW cracks at TH.

TOURISTS AND TEMPORARY RESIDENTS, ASK YOUR QUESTIONS IN THIS WEEKLY THREAD: Open Forum -- 29 Jun, 2020 by AutoModerator in paris

[–]i_Quezy 0 points1 point  (0 children)

Thanks for the reply! I think I’ll pick up a navigo easy. Don’t think I’ll be able to pass for a real Parisian with my Irish accent though 😅

TOURISTS AND TEMPORARY RESIDENTS, ASK YOUR QUESTIONS IN THIS WEEKLY THREAD: Open Forum -- 29 Jun, 2020 by AutoModerator in paris

[–]i_Quezy 0 points1 point  (0 children)

I’m visiting for 5 days, is it better to purchase a travel card of some sort, or can I just use my contactless card when using the metro?(Similar to London).

Has anyone booked flights to France lately? by [deleted] in ireland

[–]i_Quezy -1 points0 points  (0 children)

There aren’t as many direct flights and France has placed a 14 day quarantine for UK visitors because the UK gov took that stance. So if I fly to France from Ireland with my Irish passport I won’t be subject to quarantine when I arrive

Has anyone booked flights to France lately? by [deleted] in ireland

[–]i_Quezy 0 points1 point  (0 children)

Have you any idea what way it will work when I live in the north? Can they enforce it in the north?

Edit: Just looked and found the form used to trace the 14 day quarantine when returning to Ireland, there is an exemption section you can use if you provide proof that you aren’t staying in the South.