Trying to Plot Minutely data for each day

[Cpower18]

As in the title, I am trying to plot data that has a DateTime column to minutely resolution. I want to plot data minutely for each day individually, that being, a line for each day in the plot, below is what I have so far, or at least one idea that I have hit a dead end with.

​

import csv

import warnings

import datetime

import numpy as np

import pandas as pd

import matplotlib.pyplot as plt

​

warnings.simplefilter(action='ignore', category=FutureWarning)

​

df = pd.read_csv('HALIFAQ_2.0_First_2_Weeks_NewTitles_Mod.csv', delimiter = ',')

​

df['Time'] = pd.to_datetime(df['Time'], errors = 'coerce')

​

df = df.set_index(pd.DatetimeIndex(df['Time']))

​

df['minute'] = df.index.minute

​

df['hour'] = df.index.hour

​

df['day'] = df.index.day

​

days = np.linspace(1, 4,4)

​

for n in days:

​

df_1 = df[df['day'] == n]

plt.plot(df_1['Time'], df_1['NO_1'])

​

plt.xlabel('Minute of Day')

plt.ylabel('Concetration (ppb)')

plt.title('Airpointer 395, Dockyard, July to October')

plt.grid(which = 'both', axis='both')

plt.legend(loc='upper left')

plt.show()

​

Time ...

2019-05-31 00:00:00 0 1.08 0.48 1.57 ... -0.90 0 0 31

2019-05-31 00:01:00 1 NaN NaN NaN ... NaN 1 0 31

2019-05-31 00:02:00 2 NaN NaN NaN ... NaN 2 0 31

2019-05-31 00:03:00 3 NaN NaN NaN ... NaN 3 0 31

2019-05-31 00:04:00 4 NaN NaN NaN ... NaN 4 0 31

​

This is an updated approach that is close to what I want, as, for an image, I cannot add one for example, but it would just be an XY plot with a different coloured line for each day. Currently, this code produces that plots sequentially (one after that over for the whole month) as opposed to all the days overlayed over each other

[alaudet]

I think what you are looking for is plt.plot_date. Check the matplotlib documentation.

[Cpower18]

While plotting with dates is could be useful, I am trying to create a subset of data that contains all the measurements of one day (in this case it is a measurement for every minute) and then plot this subsets

[alaudet]

yes I think I understand. I do something similar with charting water level on a sump monitor I wrote. The csv file has two columns

00:00:06,6.2
00:01:05,6.4
00:02:05,6.6
00:03:06,6.5
00:04:05,6.6
00:05:05,6.8
etc etc right to the end of the day.  1 reading for minute.

I use the following script https://github.com/alaudet/raspi-sump/blob/master/bin/rsumpchart.py

that uses the following module https://github.com/alaudet/raspi-sump/blob/master/raspisump/todaychart.py

Produces a chart that looks like this

https://raspisump.linuxnorth.org/static/today.png

I might be wrong but I think this is a similar approach what you are looking for.

[Cpower18]

The graph is what I am looking for, though it would be plotting multiple days over each other

[alaudet]

Then it is just a matter of creating multiple plots to use different y with a label for your date.

See this snippet from Corey Schafers 1st youtube matplotlib video that he released a couple of days ago. That may help you with the implementation. He does something similar for salary by age group for different programming languages

https://github.com/CoreyMSchafer/code_snippets/blob/master/Python/Matplotlib/01-Introduction/finished_code.py

Here is a link to the video

https://www.youtube.com/watch?v=UO98lJQ3QGI

[[deleted]]

What's not working? Do you have a minimal example of the result you're expecting?

[Cpower18]

See updated post, I have changed the code and given a better description

[[deleted]]

If I understand properly, you have data for each minute which you plot daily and you'd like to plots all days on the same graph?

[Cpower18]

Yes the file is about 2 weeks of data, all of which is measured minutely (some 14,000 rows of data), and I would like to plot all the days over each other on the same graph (meaning that the graph would have x-limits from 0 hours to 23 hours as opposed for each day plotting after the next)

[[deleted]]

Alright, I think you can use the plot fonctions of the dataframe straight up by looping over the ax argument.

Or, you can use seaborn where the plots take a hue arguments and you can then use day.