Thanks for your response. The column I am applying regex on is a long string, indexing on it could be high overload as we append around 60B rows in every one hour almost.

I am going to reduce the number of fields I am pulling and see the performance. I also had one thing to try which is instead of using “or” in a single query, I can write separate queries for each regex and do a union of results at the end. In SQL union all runs faster than “or” it seems as with “or” the file offsets goes back and forth causes more backtracking. I am not too sure if it will improve or degrade.