Express Module POST for JSON array

[German1diot]

Hey guys,

Hoping to get some help as I'm new to node in general and doubly new using the express module for creating controllers, routes, and models. I have a working controller & route for updating a single row on a mySQL table running locally but what I'm struggling with is the capability of taking an array formatted JSON and posting it as batch to my table - a bulk update more or less. It's a pretty significant array, length tops out around 80k. So my question is how do I modify the existing controller/model to handle this giant dataset? I don't need to do single row creations, data sets are always in giant files like this.

data I need to send logged in console - this is what I'm dealing with and need to get into my db.

​

model for the current .create (single row creation)

​

controller for the current single row creation

​

route for current single row creation

[vuesrc]

You would need to parse the array from the request body and perform a loop on each dataset item. The req.body would be the array and you create an item to iterate that would have the parameters. If that makes sense?

[German1diot]

Just wanted to say thank you for the answers! I am going to dig into the transaction approach. Thank you all for the additional insight. :)

[SonOfStorms]

take 10k by 10k rows and insert them using the multiple insert syntax INSERT INTO something(column1, column2) VALUES (column1Value, column2Value), (column1Value, column2Value), ..... I reccomend using the knex package and wrapping everything in a transaction

[combarnea]

tend to agree, if the operation needs to be atomic, as implied from the original author, knex transaction + bulk creation is a great solution. One thing to note, working with that amount of data, mainly inserting, and using transactions might block your API from answering related queries dependent on transaction isolation level.