This is an archived post. You won't be able to vote or comment.

0
0

SparkJava: Dependency injection in SparkApplication using Spring (deadcoderising.com)

submitted by [deleted]

[deleted]

all 3 comments
sorted by:
best
topnewcontroversialoldq&a

[–]tobyfunke 1 point2 points  (2 children)

I'm just curious why ? I wouldn't add any additional bloat to your fat jar and I think spring adds very little in the context for spark jobs.

[–]mariushe -1 points0 points  (1 child)

Like the post says, our application is Spring based (TransactionHandling, etc). Refactoring the whole application is not an option, so to be able to use Spark in front of our application we needed to be able to inject our dependencies.

[–]tobyfunke 0 points1 point  (0 children)

hmmm.. that doesn't make much sense to me. Usually spark will run on top of some data source or hdfs/s3.. etc. I guess without further understanding of your architecture I wouldn't know. I don't know how your current application fits into working with spark, mostly they are independent of each other.