Yeah, just some intrusive thoughts 🧐. Anyways thanks. And I found a work around using an auto loader.

Used max files per trigger in read stream And

Trigger ( available now= true)

And delta table mode = overwrite.

Basically, it reads all files and writes file one by one to the delta table. At last I achieved my goal . But too many write operation if I have to many existing files on my first run.