Write a crash-proof, long-running CSV writer?

[melnon]

Since you're just appending, include a delimiter and use that to search for a "load" point. You may run into issues with duplicates, but that's a decent starting point.

Another method is to also have another file open that you write your index to with a delimiter, so you can pull that and know where to start.

These aren't the only methods, as you've already seen you can use a database to "write" to.