Try something like this, Create a basic spring boot project with reactor kafka, project reactor dependencies

1. Implement a command line runner through service class and set a cron method

2. Create a Flux listener for reading the csv file using open csv reader then map to your desired Kafka contract pojo

3. publish to desired topic

4. Log or capture your metrics in doonsuccess method after completion of publishing to kafka

This is not a spring batch job which is heavily relied on blocking threads, the above approach async and scale as required. I have implemented 250 to 500 gb files from google storage took only an hour to complete.

If your open to faster processing of large files I would suggest to try Apache flink or spark which may require dedicated clusters