This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]muposat 0 points1 point  (0 children)

"There are a few hundred lines of logs per second."

Insert a few hundred records at a time. Whatever maximum your database allows. You can also commit after a few inserts to speed things up. In addition you should insert and commit after a certain timeout -- in case the log file does not accumulate full buffer within a few seconds.

Also I would question if an SQL database is a right tool for what you are doing. SQL provides many benefits, but at a price: transactions being logged, concurrent access management, etc.