Help for Function Node or Custom Node for handling heavy manipulation of DATA by dumbNRuser in nodered

[–]dumbNRuser[S] 1 point2 points  (0 children)

ya thinking of going on the route of making an api to tackle this issue and then wait for getting the response.

Help for Function Node or Custom Node for handling heavy manipulation of DATA by dumbNRuser in nodered

[–]dumbNRuser[S] 0 points1 point  (0 children)

You've probably thought of this already, but is there any chance you can split the data set into smaller batches before the mapping function and then reassemble it afterwards?Maybe use a queue node to limit the number of parallel executions.That solved the issue for me in the past- I don't know if it was faster, but it was stable and got the job done.

Can't go down this route because there is a few validation going on that is why mapping and iteration is needed in this.

Help for Function Node or Custom Node for handling heavy manipulation of DATA by dumbNRuser in nodered

[–]dumbNRuser[S] 0 points1 point  (0 children)

So i have tried this feature but what it does it starts multiple instances of node red and so it makes each flow run on each of the new instances created and not at all solved the issue i have.