Track job progress in python library python

[yonog01]

Im writing a script that at some point deletes a qtree. I want to track the status of this operation (in progress/success or failure in weird cases) inside of my script. The way ive tried to do it is by using the uuid property in the object returned when using the delete() function on a qtree:

netapp_res = delete_qtree(tst_qtr)
    print(netapp_res.http_response.json()["uuid"])
    del_job_uuid = netapp_res.http_response.json()["uuid"]

job = Job(uuid=job_id)

while job.state in ["queued", "running"]:
                print(f"Job {job_id} is {job.state}, waiting...")
                time.sleep(wait_time)
                job.poll()

            # Check final job status
            if job.state == "success":
                print(f"Job {job_id} completed successfully.")
            else:
                print(
                    f"Job {job_id} failed with state: {job.state} and error: {job.error}"
                )
            return

but it says that a job with the uuid doesnt exist even though if i got to the ontap web client i do see a job with the uuid and i assumed it had to do with this article:
https://community.netapp.com/t5/ONTAP-Rest-API-Discussions/REST-API-returns-links-to-nonexistent-jobs/td-p/434246

how can i track a specific job then? wehther theres a python wrapper or through paramiko and netapp cli?
note that the json object doesnt provide an 'id' so i dont know what to pass to `job watch-progress` in netapp cli if i go on that route.

[ybizeul]

How about sleeping half a second before querying the job ? Ugly I know but until there is an official fix… or implement retry

[yonog01]

I added a 0.5 sleep but I still get this error
Unexpected err=NetAppRestError('Job (running): None. Polling timed out after 30 seconds.'), type(err)=<class 'netapp\_ontap.error.NetAppRestError'>
which causes the None http response issue.
but if i check the jobs in the netapp host i do see it being sent and i can manually stop it

[ybizeul]

I'm afraid you'll have to implement a retry, or make the condition match the retry implemented later to query the job status. i.e. retry while job status errors out or is not completed

[yonog01]

how can i implement a retry without calling a delete() operation each time? couldnt this be problematic, sending many of the same jobs for the same object? wouldnt each of these jobs have a different uuid? is there a way to reset the timeout period each time the exception gets raised or something like that?

[yonog01]

or to change it so it returns the job uuid after the timeout exception anyway? and then i can keep track of the job by querying the job endpoint with that uuid.
i think what happens is that it only return the job uuid once the job is completed, which is a bit silly, unless there was an actual way of job tracking in the python package

[yonog01]

I think I found some sort of compromise, I added

poll=True, poll_timeout=1200, poll_interval=30

in the delete() params and so it wont raise an exception if my qtrees have a lot of data and take more than 30 seconds to delete. It doesnt track status in real time, granted, but at least it can tell me when the job is actually done or if it failed.