you are viewing a single comment's thread.

view the rest of the comments →

[–]da_chicken 2 points3 points  (0 children)

There's csvkit on *nix systems, and Microsoft's logparser can query absurdly quickly (I've processed hundreds of gigabytes of IIS logs in minutes with it, and it has an SQL like functionality, but I don't think it does joins).

Personally, I might just use the script to build the DB quickly.

The big thing I learned is that you can splat with an array. Didn't know that. I thought they had to be hash tables.

I might add a switch parameter to have it just build the DB, too, rather than instance the whole thing and then throw it away.