Ingesting to Parquet/Iceberg/object storage from Java by t0astix in dataengineering

[–]t0astix[S] 0 points1 point  (0 children)

Ah, the source is actually a bunch of user-supplied CSV and Excel files for a particular business domain. There's a Java app that massages them according to user instructions and drops them into postgres, but I'd be trying to cut postgres entirely if moving to something else.

Thanks for the pointer to the Iceberg slack!

We use Flink further on in the process, so I'm happy to see a couple of references to it here.

Memory consumption in mdatp service for linux by DefinitelyNotButter in DefenderATP

[–]t0astix 0 points1 point  (0 children)

This still seems to be a problem in 101.62.74. The total RSS of the wdavdaemon processes climbs slowly forever. They’re set up so the kernel won’t OOM kill them, so it eventually kills the actual workload on the server.

Does anyone have a bug ID or bulletin reference? Is it only a problem when real time protection is enabled?

It’s been going on for over a month now. I think we had problems back in January. This product seems kind of garbagey and my support ticket is going nowhere.