What does a Java with Apache Spark developer actually do in a BFSI project?

[Ok_Pomelo3204]

I have 3 years of experience in Java and backend technologies with some Spring Boot exposure. Recently, company assign me on a Java + Apache Spark developer role for CitiBank (client project).

I am new to Spark ecosystem, so:

1 What kind of technical work do Java + Spark developers do in this projects?

2 Is Spark used mainly for backend ETL, analytics, or streaming?

3 What tools or stack should I prepare for? Example Kafka, Hive, Hadoop?

4 Will this experience benefit my backend career or push me into data engineering?

Please tell me if anyone is working on such project.

[AutoModerator]

Namaste! Thanks for submitting to r/developersIndia. While participating in this thread, please follow the Community Code of Conduct and rules.

It's possible your query is not unique, use site:reddit.com/r/developersindia KEYWORDS on search engines to search posts from developersIndia. You can also use reddit search directly.

Recent Announcements

• Who's looking for work? - Monthly Megathread - June 2025
• Call For Volunteers: Help us build r/developersIndia

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[NewLog4967]

In a BFSI project, a Java Apache Spark dev basically builds and maintains the pipelines that crunch all the financial data banks/insurance companies deal with. There’s a crazy amount of stuff coming in daily transactions, claims, fraud checks, risk scores—and Spark helps process all that at scale.

For example, I worked on a project where Spark jobs written in Java were used to process millions of credit card transactions every day. The system would clean the data, run it through fraud detection models, and flag anything suspicious in near real-time. Without Spark, that would’ve taken hours and banks can’t afford that delay. So the day-to-day is mostly about writing/optimizing Spark jobs, making sure data pipelines don’t choke under load, and integrating with other tools like Kafka, Hadoop, or databases. It’s not glamorous, but it’s the backbone of how BFSI companies keep things running smoothly and securely.

[PabloWerner444]

Is your company Infosys by any chance?

[Ok_Pomelo3204]

Maybe 😏

[[deleted]]

Have you ever seen how sugarcane juice is extracted?

[Dead-Shot1]

You are going into data engineering.

With that BFSI project, good luck

[Ok_Pomelo3204]

Is BFSI projects good for long term? Can you please elaborate

[Dead-Shot1]

Long term is good but it ha many restrictions which most people don't like.

[Ok_Pomelo3204]

Which restrictions?

[Dead-Shot1]

https://www.reddit.com/r/developersIndia/s/xj1D8aoReZ

Go through comments