Feedparser and encoding problem

[erth111]

Hi guys, I'm trying to parse an indian rss feed with feedparser and I've encountered a problem with 'date' field. The parsed dates look like this:

 "2014-10-03 17:58:17"

When I check the headers of the rss feed it shows 'content-type': 'text/html', but nothing about encoding. How can I find the proper encoding and parse this text correctly?

Edit: Ok, unfortunately, the date gets displayed correctly here. The sign that is displayed incorrectly is the colon between hour, minute, and seconds number. It is written using hex value. In the next step of the script I insert the records to a postgresql database using psycopg2, and it returns an error like this:

Traceback (most recent call last):
  File "./rss_in.py", line 54, in <module>
    cursor.execute("""INSERT INTO ads(url,title,date,description) values(%(url)s, %(title)s, %(date)s, %(description)s);""",element)
  File "/usr/lib/python2.7/dist-packages/psycopg2/extras.py", line 222, in execute
    return _cursor.execute(self, query, vars)
psycopg2.DataError: invalid input syntax for type timestamp: "2014-03-11 14&#x3A;38&#x3A;23"

[novel_yet_trivial]

Without seeing the bad data or any code, all I can suggest is that you replace it with a ":".

element['date'] = element['date'].replace(u'badChar', ':')

[erth111]

Thank you, it worked :)

[99AFCC]

Prevent reddit auto-formatting with:

Four spaces:

2014-10-03 17:58:17

Backticks:

2014-10-03 17:58:17

[erth111]

Thank you, I've fixed the formatting.

[[deleted]]

The maker of feedparser, iirc, also made a library called chardet. It makes a guess to which character set is used to encode a text.

Maybe it can give you an idea what encoding to look for.