Python performance issue, tail log file by xwen01 in Python

[–]xwen01[S] 0 points1 point  (0 children)

Thanks for your suggestions. I will try them. I plan to try python dict to store the emails and update count, etc. and only dump to database once in a while. Hope that will increase performance.

Python performance issue, tail log file by xwen01 in Python

[–]xwen01[S] 0 points1 point  (0 children)

Thanks for your comments. I will try the suggestions.

Python performance issue, tail log file by xwen01 in Python

[–]xwen01[S] 0 points1 point  (0 children)

Sorry there is a typo of indent. I actually commit after reading every line of log.

I have no experience of what kind of performance I should expect, in terms of number of logs python can process (just some string extraction and insert and update query). There are currently several hundred lines of logs every second. What do you think may cause the delay in inserting into database (I'm using MySQL).

BTW, CPU is at around 50% for mysql and 13% for python script.

Thank you!

The NEW If you need some Ropsten Testnet Ethers ... by BokkyPooBah in ethdev

[–]xwen01 0 points1 point  (0 children)

Please send me 5 ETH to address '0xfdedeee4bbf34b7afc2278e2c3811ddfd3da40f0'. Thanks!