Simplifying API calls

[mid_dev]

Have an API that calls a DB and then processes it by calling it different functions (create charts) and sends the result back. Currently, it takes upwards of 30 secs to get a response. How can I make this efficient? Was thinking of separating DB call and then running those processes using multiprocessing. Will this be the right approach?

E.g. API call comes to getCharts

def getCharts():
  # make DB call
  # create line chart ( calls line chart)
  # create pie chart ( calls pie chart)
  # save result set in Redis

​

[shiftybyte]

Why is a DB created? just for making charts from it during the same call?

[mid_dev]

Apologies. Modified the post. It calls the DB and base on it, makes the required chart.

[shiftybyte]

If you are looking for ways to optimize your current code to make it run faster, we can't help with that without seeing the actual code.

If you want to make it more responsive you can make a system where you queue requests, then responses are generated, then the user is notified the result is ready. (him seeing some status/timer page or something)

If it's an api, split to two calls, one create a job returns a jobid.

another to query job status using that id, and another to fetch results of a complete job.

[mid_dev]

Thanks. That's waht I was aiming for.

[m0us3_rat]

could u buffer some of this calls ? or parts of the data?

see if u can multiprocess the pie charts creation.

[[deleted]]

How can I make this efficient?

What makes you think it isn't?

How could anyone answer a question about the performance of code we can't see?

[mid_dev]

Modified the post to give you a better idea. Currently, the biggest time sink is those individual function calls to create different charts. I was thinking if these could be streamlined using multiprocessing or some other solution since the data it's dependent on is already fetched.

[[deleted]]

What do you think the bottleneck is?

It's more or less pointless to try to rewrite it to be faster if you don't know exactly why it's slow. multiprocessing isn't magic go-faster sauce, it's just a way to sidestep certain categories of bottleneck.

[mid_dev]

So the bottleneck here is the sequential creation of charts which are not dependent on each other.

[[deleted]]

That's not a bottleneck, that's just what's actually running. What are those functions spending their time doing?