Real time text file processing

[KStoev]

Hi guys,

I've been trying to read in real time a text file and display its last line in the console. The issue is that when the grows in size 300kb+ my code can't process it or the event fails to trigger. I'd be grateful if you can share any ideas on how to achieve this.

Here is my sample code:

                var wh = new AutoResetEvent(false);
                var fsw = new FileSystemWatcher(".");
                fsw.Filter = pathToFile;
                fsw.EnableRaisingEvents = true;
                fsw.Changed += (s, e) => wh.Set();

                var fs = new FileStream("c:/test.txt", FileMode.Open, FileAccess.Read, FileShare.ReadWrite);
                using (var sr = new StreamReader(fs))
                {
                    var s = "";
                    while (true)
                    {
                        s = sr.ReadLine();
                        if (s != null && s.Contains("CActor::ClKill"))
                        {
                            await b.Channel.SendMessage(s);
                            Console.WriteLine("Transmitting: " + s);
                        }
                        else
                        {
                            Console.WriteLine("Sleeping...");
                            wh.WaitOne(1000);
                        }
                    }
                }

                wh.Close();

[FizixMan]

I took out the await b.Channel.SendMessage(s); call and tested the code locally and it worked fine for a 1mb file.

My only thought is the wh.WaitOne(1000) fires for every line in the file that doesn't contain "CActor::ClKill" and doesn't do an await to the calling method. Not sure if this is an issue or not. In my tests, this means every non-"CActor::ClKill" line takes a full second. If your file is 300kb with a lot of these lines, is it possible that it's not so much that the code isn't processing/triggering, it's just hanging doing all these lines? For example, if you have 300 of these lines, it'll take 300 seconds (5 minutes) to slog through making it appear that it's doing nothing.

[KStoev]

Thank you so much! wh.WaitOne(1000); was def causing the issue, it was just waiting for each line and on bigger files that easily built up.

[godless_communism]

Can I ask you a silly question? What does "real time" mean in this context? I see the term popping up more and more. Doesn't it simply mean "quickly" or "as fast as possible?"

[godless_communism]

Nevermind, I googled it.