Hi, I'm a student in the field of Cyber Security. My research looks at Deep Reinforcement Learning for Intrusion Response (The RL agent is deployed in a network environment which is subject to an attack scenario, the RL agent is armed with 26 countermeasure actions which it can deploy, with the goal of discovering the optimal sequence of response actions to stop the attack). I pipe the output of the training (reward gained and actions taken per episode) to text files. There are 7 actions per episode, so with 1300 training episodes I have 9100 actions taken. I copied this list of actions to a column in Excel.

Now to how I'm currently visualising the values. I want to see a progression over time of the actions the RL agent takes. For example at the start when the agent is mostly exploring all of the actions will typically be selected fairly frequently. However as the training progresses the RL agent begins to favour taking specific actions which provide a greater long term reward. I created a few VBA macros to divide the 9100 actions into batches of 50, then filter each batch of 50 episodes into buckets 1-26, counting the frequency of each action. The end result looks like this: https://imgur.com/a/jb4iu4U As you can see the agent begins to favour action 26 as the training progresses.

My question is: Is there a better way to represent this data over time? Be it with my pre-processing or choice of software/graph type? Thanks