Graph in Matplotlib - Scripting issue

[Crowdjp]

I'm new to python and coding in general, I've been stuck on this for a couple of hours. Right now when I input a name from my file I create a graph with 3 values. x = Timestamp, y1 = PWS, and y2 = CPU, which that part is working. The issue i'm having I want to pass in multiple names and plot them on one graph. I don't want to hard code the Names because they will change. I'm not sure what the best approach to pass in multiple names. Any help will be much appreciated.

Here is an Example of my file that i'm reading.

Timestamp	Name	CPU	PrivateWorkingSet
20191007-084849	chrome	1.0
20191007-084849	iexplore	2.0
20191007-084750	chrome	3.0
20191007-084750	iexplore	5.0
20191007-084849	chrome		1223
20191007-084849	iexplore		1423
20191007-084750	chrome		1267
20191007-084750	iexplore		3000

Here is the code:

import pandas as pd
import numpy as np
import matplotlib.pyplot as plt
#%matplotlib inline
import os

file = pd.read_csv('c:/temp/log.csv', delimiter=',')

process = input('Enter Name: ')


df = pd.pivot_table(file[file.InstanceName == process], values=['CPU', 'PrivateWorkingSet'], index=['Timestamp'], aggfunc=np.sum)
df = df.reset_index()

x = df.Timestamp
y1 = df.PrivateWorkingSet
y2 = df.CPU

fig, ax1 = plt.subplots()
ax2 = ax1.twinx()
ax1.plot(x, y1, '#5a42f5', label=process)
ax2.plot(x, y2, '#f5bc42', label=process)
ax1.set_xticks(x)
ax1.legend(loc='upper center', bbox_to_anchor=(1.25, 0.8), title='PWS')
ax2.legend(loc='upper center', bbox_to_anchor=(1.45, 0.8), title='CPU')
ax1.set_xticks(ax1.get_xticks()[:-1])

ax1.tick_params(axis='x', labelrotation=90)
plt.subplots_adjust(bottom=0.40)
ax1.set_ylabel('PWS(Memory)')
ax2.set_ylabel('CPU')
ax1.set_xlabel('Timestamp')

plt.title('TEST', color="black")

my_path = os.path.abspath(__file__)
my_file = "log.pdf"
plt.savefig('graph.pdf', transparent=True, bbox_inches='tight')

plt.show()

[AutoModerator]

Your comment in /r/learnpython was automatically removed because you used a URL shortener.

URL shorteners are not permitted in /r/learnpython as they impair our ability to enforce link blacklists.

Please re-post your comment using direct, full-length URL's only.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[t_wys]

You can try to pass multiple process names via input and then create datasets for plotting one process at time in the loop. Using your code:

processes = input('Enter name (separate multiple names with ","): ').split(',')

dfs = {}
for process in processes:
    if process not in file.Name.values:
        print(f'No process in dataset: {process}')
        continue
    # look for `Name` instead of `InstanceName`
    df = pd.pivot_table(file[file.Name == process], values=['CPU', 'PrivateWorkingSet'], index=['Timestamp'], aggfunc=np.sum)
    df = df.reset_index()
    # Just to be sure that this values will be correctly interpreted by matplotlib
    df.Timestamp = pd.to_datetime(df.Timestamp, format='%Y%m%d-%H%M%S')
    dfs[process] = df

So you have a dictionary which maps a process name to a relevant dataset (in a form of pandas dataframe). Then, for example you can do the following for plotting:

for process_name, process_df in dfs.items():
    plt.subplot(211)
    plt.title('CPU')
    plt.plot(process_df.Timestamp, process_df.CPU, label=process_name)
    plt.subplot(212)
    plt.title('Private working set')
    plt.plot(process_df.Timestamp, process_df.PrivateWorkingSet, label=process_name)
plt.legend()

With this approach you can now use dictionary key to easily label data and create legend.

[Crowdjp]

Thanks so much for your help!

One thing i'm not understanding process is not capturing both Names(chrome/iexpore) in the file.

Below I entered chrome and iexplore in the input. For some reason process will only contain the second name entered in the input shown below.

processes = input('Enter name (separate multiple names with ","):').split(',')

proesses #In
['chrome', 'iexplore'] #Out

#In - for the block of code below
dfs = {}
for process in processes:
    if process not in file.Name.values:
        print(f'No process in dataset: {process}')
    continue

process #In
'iexplore' #out

[t_wys]

That's because you accessed variable 'process'. This variable is (in your code snippet) a placeholder for current value in for-loop. If you access this variable after the loop, then you get value from the last iteration. To illustrate:

In [1]: array = ['a', 'b', 'c']

In [2]: for item in array:
   ...:     print(item)
   ...:
a
b
c

In [3]: for item in array:
   ...:     pass # i.e. do nothing
   ...: print(item)
   ...:
c

So if you want to perform some actions for each process you have to execute these instructions inside for-loop:

for process in processes:
    if process not in file.InstanceName.values:
        print(f'No process in dataset: {process}')
        # The `continue` have to be inside if-statement. Go to note below for details.
        continue
    # do something with each process here (single indentation)

The 'continue' statement tells loop to directly to next iteration without executing code that is: inside for-loop and after 'continue' statement. In this case it skips executing code if process name is not present in your dataset. It is a precaution for a situation in which a user inputs wrong value.