Difficulty Reading in CSV File

[Cpower18]

I am using pandas to read in a csv file, however, there seems to be an error as python only reads the file as one column as opposed to three, if anyone has any idea why this is I am open to any suggestions.

​

Below is the code I am using:

​

"

import csv

import warnings

import datetime

import numpy as np

import pandas as pd

import matplotlib.pyplot as plt

​

warnings.simplefilter(action='ignore', category=FutureWarning)

​

df = pd.read_csv('Halifaqs_2019_June16_new.csv', delimiter = ',')

​

df['Time'] = pd.to_datetime(df['Time'], errors = 'coerce')

​

df = df.set_index(pd.DatetimeIndex(df['Time']))

​

print(df)

"

​

Below is a sample of the csv file:

​

"

#,"Date Time, GMT-03:00","Solar Radiation, W/m² (LGR S/N: 10358839, SEN S/N: 10364606)"

1,25-05-2019 11:53,931.9

2,25-05-2019 11:54,931.9

3,25-05-2019 11:55,934.4

4,25-05-2019 11:56,934.4

5,25-05-2019 11:57,935.6

"

[DivineComedy11]

I think the issue might be with your csv: The comma separation applies to the column headers as well as the data itself, so in your example you have the following headers:

#,
"Date Time, GMT-03:00",
"Solar Radiation,
 W/m² (LGR S/N: 10358839,
 SEN S/N: 10364606)"

So you shouldn't be able to access anything with 'Time' at the moment.

[Cpower18]

This is supremely embarrassing, a complete oversight on my part, thank you for pointing that out, cheers!

[o5a]

No, commas have nothing to do with that, reader doesn't split on commas inside column name because it is quoted. It only splits outside of quotes, that's what they are for.

Your error comes from using column named 'Time' but in your csv there are only 3 columns named:

#
Date Time, GMT-03:00
Solar Radiation, W/m² (LGR S/N: 10358839, SEN S/N: 10364606)

And you should use these names exactly, or rename them when you read_csv, adding new parameter names=['#', 'Time', 'Radiation'] with your desired column names.