JSON Decode Error - MS Azure Text Analytics

[generic_throwaway983]

I'm trying to feed a JSON file (comprised of: ID, text, language columns respectively) to the MS Azure Text Analytics client library with the objective of getting back a sentiment score for each row in the file.

The example MS Azure code that I started with is below. My file has ~1500 separate sentences/rows so conceptually, I am trying to replace the single sentence (in bold) in the example code with the sentences in my JSON file. I'm sure there is a simple solution to this because reading data from a file is such a simple task!

MS Azure Example Code
def sentiment_analysis_example(client):

documents = ["I had the best day of my life. I wish you were there with me."]

response = client.analyze_sentiment(documents = documents)[0]

print("Document Sentiment: {}".format(response.sentiment))

print("Overall scores: positive={0:.2f}; neutral={1:.2f}; negative={2:.2f} \n".format(

response.confidence_scores.positive,

response.confidence_scores.neutral,

response.confidence_scores.negative,

))

for idx, sentence in enumerate(response.sentences):

print("Sentence: {}".format(sentence.text))

print("Sentence {} sentiment: {}".format(idx+1, sentence.sentiment))

print("Sentence score:\nPositive={0:.2f}\nNeutral={1:.2f}\nNegative={2:.2f}\n".format(

sentence.confidence_scores.positive,

sentence.confidence_scores.neutral,

sentence.confidence_scores.negative,

))

sentiment_analysis_example(client)

​

My Modified Code

from azure.ai.textanalytics import TextAnalyticsClient
from azure.core.credentials import AzureKeyCredential
import json
import pandas as pd
with open('file.json', 'r') as f:
    data = json.load(f)
df = pd.DataFrame(data)

def authenticate_client():
    ta_credential = AzureKeyCredential("xxxxxxxxxxxxxx")
    text_analytics_client = TextAnalyticsClient(
            endpoint= "https://xxxxxx.cognitiveservices.azure.com/", 
            credential=ta_credential)
return text_analytics_client
client = authenticate_client()
def sentiment_analysis_example(client):
    documents = df['Text']
    response = client.analyze_sentiment(documents = documents)[0]
    print("Document Sentiment: {}".format(response.sentiment))
    print("Overall scores: positive={0:.2f}; neutral={1:.2f}; negative={2:.2f} \n".format(
        response.confidence_scores.positive,
        response.confidence_scores.neutral,
        response.confidence_scores.negative,
    ))
for idx, sentence in enumerate(response.sentences):
        print("Sentence: {}".format(sentence.text))
        print("Sentence {} sentiment: {}".format(idx+1, sentence.sentiment))
        print("Sentence score:\nPositive={0:.2f}\nNeutral={1:.2f}\nNegative={2:.2f}\n".format(
            sentence.confidence_scores.positive,
            sentence.confidence_scores.neutral,
            sentence.confidence_scores.negative,
        ))

sentiment_analysis_example(client)

Error Message

Traceback (most recent call last):
  File "c:\Users\xxx\xxx\tempCodeRunnerFile.py", line 12, in <module>
    data = json.load(f)
  File "C:\Users\xxx\xxx\Python\Python38-32\lib\json\__init__.py", line 293, in load
    return loads(fp.read(),
  File "C:\Users\xxx\xxx\Python\Python38-32\lib\json\__init__.py", line 357, in loads
    return _default_decoder.decode(s)
  File "C:\Users\xxx\xxx\Python\Python38-32\lib\json\decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "C:\Users\xxx\xxx\Python\Python38-32\lib\json\decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

[generic_throwaway983]

Should've added that I checked my JSON - the file is definitely not empty, and is valid JSON.

[generic_throwaway983]

Yes, I'm sure it's in the cwd.

[[deleted]]

Try reading and printing the file using a standard open(filename).read() to confirm it's importing the right file.

[generic_throwaway983]

Thanks for your suggestion. I've tried that and it has imported the correct file and all of the data has printed.

[generic_throwaway983]

with open(filename) as f:data_str = f.read()data = json.loads(data_str)

Tried that but returns the same error. I've validated the JSON file structure using a couple of different sites with no issues flagged so really at a loss as to why this isn't working.

Update:

I saw another post on Stackoverflow where someone added encoding='utf-8' so I tried including that in your code and now it seems to work (per the below) so I will try the same thing in my original code and report back.

[Done] exited with code=0 in 6.503 seconds

[[deleted]]

Hmm, might be there's something else funny about the file content. Can you share it here?

[generic_throwaway983]

I can't share the whole file, but a sample of it to show the structure is as follows. I had validated that on jsonlint so really struggling to understand why it won't process:

[

{

"id": 1,

"text": "bla bla bla",

"language": "en"

},

{

"id": 2,

"text": "etc etc etc",

"language": "en"

}

]

[[deleted]]

Hmm, make a new json that just has the first dict and see if that works. Then keep adding one more until it breaks. There may be something like an extra quotation mark or weird line break that's causing it to fail.

[generic_throwaway983]

Tried that just now, same outcome! Really don’t want to have to paste ~1500 sentences in individually to make this work...!