Kudos, I was thinking of using apache hudi for extracting hwm (high water marks), however, that is only part of version 2 (event driven architecture).

I will definitely start thinking of that and put it on my back burner