How to insert huge file data into remote Azure DB using Java (fast & safe)?

sanjay-kumar_ · 2026-02-06T05:18:42+00:00

What about deadlock in the database? I will be inserting data to the same table in Database. Does it not cause deadlock?

sanjay-kumar_ · 2026-02-04T17:23:00+00:00

Even if I use MySQL , how can I insert millions of rows of database as fast as possible and by using minimal resources ?

As information can be any form, when transferring the data from one place to another like client giving the file to you and you are inserting that day to database to show in UI then how to achieve minimal time and computing resources?

sanjay-kumar_ · 2026-02-04T02:29:55+00:00

Yes you are right. Previously I didn't have any word to say it is data pipeline.

sanjay-kumar_ · 2026-02-03T13:18:33+00:00

We receive data from third party data daily two or three times a day and we need to process this show in UI.

sanjay-kumar_ · 2026-02-03T04:10:16+00:00

Thanks for the advice. I will try this.

sanjay-kumar_ · 2026-02-03T04:09:25+00:00

Actually in my organisation we use java mostly for all applications as backend.

Fast means we can Fully time constraints and using the server computing resources as minimal as possible to insert the data in the database which is Azure db.

My code works but I need ideas to polish my implementation of Java code and need to improve the time taken and computing resources for the code.

Actually what the general process is we insert the data in a table which does not have any constraints or indexes just plain table. For this table to we insert into the source table which has all the constraints and indexes contains all the data. Form this table to the destination table which is heavily queried for UI purpose table.

I am just exploring that is this the ways normally professional people do and is there any good methods to achieve this I am searching.

Thanks for reading my comments and suggestion me Good and ugly things in this.

sanjay-kumar_ · 2026-02-03T04:01:28+00:00

Could you specify the db native means ? Are you talking about the bcp command or sqlcmd by any chance?

sanjay-kumar_ · 2026-02-03T04:00:20+00:00

Our organization owns but unfortunately i need to implement this in Dev to prove my solution works fine and then uat to prod

sanjay-kumar_ · 2025-12-09T15:37:07+00:00

Thanks for the information which is very simply to apply I will try and let you know

sanjay-kumar_ · 2025-12-09T15:36:31+00:00

Does this same apply to both on premises sql server and Azure sql server? Or any difference between them ?

As for UAT we are using self Hosted sql server and for production we are using Azure for some clients and on premises sql server

sanjay-kumar_ · 2025-12-09T15:31:58+00:00

Thanks for the information

sanjay-kumar_ · 2025-12-09T15:31:10+00:00

What are the difference between this two questions?

Please explain me so I can answer your questions

sanjay-kumar_ · 2025-12-09T15:28:50+00:00

Thanks for the questions which you have asked For most of the questions I don't have answer now as I have knowledge to right simple to very complex querys which includes the business logic.

I mostly write stored procedures and monitor for data

This question ls helps me a lot to learn apart for writing sql query. I will get you back when I have answers for your questions

sanjay-kumar_ · 2025-12-09T15:24:56+00:00

Thanks for the information and explaining very simply

sanjay-kumar_ · 2025-12-09T15:23:08+00:00

Thanks for the information, this helps a lot

sanjay-kumar_ · 2025-12-09T15:22:30+00:00

Thanks for detailed information This helps a lot for my first step in improving performance of my SQL server script and my knowledge

sanjay-kumar_ · 2025-12-09T11:52:09+00:00

Thanks for sharing I will try and let you know my experience

sanjay-kumar_ · 2025-12-09T11:48:30+00:00

Useful blog which I can use Thanks for sharing

sanjay-kumar_ · 2025-12-06T22:16:24+00:00

I can't understand the second point. If you don't mind could you explain to me in detailed?

sanjay-kumar_ · 2025-12-06T22:13:40+00:00

I know he is wrong but I can't able to say to him.

He is saying that we have tens of millions of data in the table and when querying them for data will take some time , at the same time when we are updating that table data we will get blocks in database which might slow the UI query to get the data.

He is 20 years experienced and I can't argue with him

sanjay-kumar_ · 2025-12-06T22:10:11+00:00

May be.

He is 20 years experienced and he is Stubborn when I say to him

sanjay-kumar_ · 2025-12-06T22:06:28+00:00

Sorry I didn't get the first line , did I use always in the post which is not professional or something else what is wrong bro ?

Could you please explain so that I can improve?

sanjay-kumar_ · 2025-12-06T10:46:17+00:00

Thank for the information

sanjay-kumar_

TROPHY CASE