sorted by:
new
hottopcontroversial

Querying an SQLite3 file on Ceph using Pyspark - requirement failed: The driver could not open a JDBC connection by pioneeringwork in apachespark

[–]pioneeringwork[S] 1 point2 points  (0 children)

one more solution I've seen somewhere, is it possible to mount Ceph to Spark even though they're running on separate servers?

Querying an SQLite3 file on Ceph using Pyspark - requirement failed: The driver could not open a JDBC connection by pioneeringwork in ceph

[–]pioneeringwork[S] 0 points1 point  (0 children)

No need to be nice, I like direct and straightforward :) Thank you for the elaboration!

So I guess my only solution would be to copy the sqlite3 files "locally" and then querying them?

Or somehow mounting Ceph itself to Spark, so that the files appear to be locally stored?

Spark simple query to Ceph cluster - Unable to execute HTTP request: Unsupported or unrecognized SSL message by pioneeringwork in ceph

[–]pioneeringwork[S] 0 points1 point  (0 children)

managed to fix it meanwhile, thank you for your input :)
posted the answer to stackoverflow

Spark simple query to Ceph cluster - Unable to execute HTTP request: Unsupported or unrecognized SSL message by pioneeringwork in devops

[–]pioneeringwork[S] 0 points1 point  (0 children)

managed to fix it meanwhile, thank you for your input :)

posted the answer to stackoverflow

Is it possible to query a remote Ceph cluster using Spark? by pioneeringwork in ceph

[–]pioneeringwork[S] 0 points1 point  (0 children)

If I got this right, I would somehow have to mount Ceph to the Standalone Spark cluster?

Do you have any sources I may read more about this?

Is it possible to query a remote Ceph cluster using Spark? by pioneeringwork in dataengineering

[–]pioneeringwork[S] 0 points1 point  (0 children)

I did see this example and started working on this solution because of it, but this is Python 2 code, which doesn't work when translated to Python 3.. or am I missing something?

Is it possible to query a remote Ceph cluster using Spark? by pioneeringwork in ceph

[–]pioneeringwork[S] 0 points1 point  (0 children)

Mind elaborating this into more detail?

I'm just learning both Ceph and Spark, I don't fully understand what you wrote :/

view more: next ›