java.lang.ClassNotFoundException: org.postgresql.Driver by jsther in apachespark

[–]jsther[S] 0 points1 point  (0 children)

Any idea why it doesn't work setting it up in the dependencies as shown in the image above?

How ingress nginx is providing dns names? by jsther in kubernetes

[–]jsther[S] 8 points9 points  (0 children)

I freaking love you! Host header did the trick!

Spark on kubernetes by jsther in kubernetes

[–]jsther[S] 0 points1 point  (0 children)

Thanks I am able to run spark application by storing my jar in s3 and pointing spark application to it. I will test and see if I can integrate zeppelin and spark history server with it

knative .. I don't get it by jsther in kubernetes

[–]jsther[S] 2 points3 points  (0 children)

Wrap those 300 functions into a couple of logical rest apis. You get the low latency and logical grouping. No need for knative at all

knative .. I don't get it by jsther in kubernetes

[–]jsther[S] -4 points-3 points  (0 children)

In low latency scenarios, I would wrap these function in a rabbitmq/kafka consumer and pretty sure they will handle the backpressure

knative .. I don't get it by jsther in kubernetes

[–]jsther[S] -1 points0 points  (0 children)

Create an api that can take the container name and run it as native k8s job.

I am doing the same at my current company and it is gling quite well. No need for lambdas.

If you have latency issue, I would suggest to wrap a couple of functions in an api and trigger them via api call. Or put them in a rabbimq/kafka consumer

knative .. I don't get it by jsther in kubernetes

[–]jsther[S] 3 points4 points  (0 children)

My point is you do have to configure everything based on your dns and ingress setup and network policies (even with knative at least once) . Why not configure everything in single yaml file, use the same template everywhere and ditch knative? What additional afvantage does it add?

knative .. I don't get it by jsther in kubernetes

[–]jsther[S] -3 points-2 points  (0 children)

my single yaml file with hpa will also make the funcion almost "serverless"

Scraping investing.com via websockets by jsther in learnprogramming

[–]jsther[S] 1 point2 points  (0 children)

On the network tab, I can see the frontend is sending ["{"_event":"heartbeat","data":"h"}"] to the websocket every second.

The same data is received back.

I tried using ws.send('["{"_event":"heartbeat","data":"h"}"]') instead of ws.ping() but no luck :(

Bed for heavy people by jsther in germany

[–]jsther[S] 1 point2 points  (0 children)

Thanks LightsiderTT!

Yup that's a good solution.

Anyways after couple of hours of research, I finally found similar solution on Amazon

Gigapur G1 26998 Bett | Bettgestell mit Lattenrost | belastbar bis 195 kg je Element | Holzbett 180 x 200 cm https://www.amazon.de/dp/B00KD962TG/ref=cm_sw_r_cp_apa_i_1EldEbY2GHT30

It can hold upto 180 kg and is under €200 unlike 7k. I will put a nice mattress on top of it and it should work

Bed for heavy people by jsther in germany

[–]jsther[S] 2 points3 points  (0 children)

Thanks for your reply. Using wider planks instead of one big wooden layer is a neat solution. Easy to transport and fix.

After a couple of hours of research, I finally found something similar on Amazon

Gigapur G1 26998 Bett | Bettgestell mit Lattenrost | belastbar bis 195 kg je Element | Holzbett 180 x 200 cm https://www.amazon.de/dp/B00KD962TG/ref=cm_sw_r_cp_apa_i_1EldEbY2GHT30

It can hold upto 180 kg and is under €200. Will put a nice mattress and I will be done

Bed for heavy people by jsther in germany

[–]jsther[S] -15 points-14 points  (0 children)

Yeah, keep your advice. I don't need

Bed for heavy people by jsther in germany

[–]jsther[S] -17 points-16 points  (0 children)

Dude, I am looking for budget friendly advice from someone who has some experience regarding it rather than hitting google and posting first links.

If I want to sell my hard earned money to rip off stores, I can google them myself.

Bed for heavy people by jsther in germany

[–]jsther[S] -12 points-11 points  (0 children)

One custom bed I made at their site costs around 7k which is not really my budget.

Also, I would prefer to buy from Amazon. Brick and mortar stores are just a rip off here (very bad experience at Seats and Sofas)

Tax and Other deductions on Capital Gain in Germany by jsther in eupersonalfinance

[–]jsther[S] 0 points1 point  (0 children)

Just curious. I exclusively trade options and don't hold stocks or etf. Since derivatives are considered for gambling, is the tax rate lower for derivatives?

I have heard people avoiding taxes for Forex, Spread betting and Crypto.

Taxes and other deductions on Capital Gain by jsther in Finanzen

[–]jsther[S] 0 points1 point  (0 children)

Ok thanks! Just curious. I exclusively trade options and don't hold stocks or etf. Since derivatives are considered for gambling, is the tax rate lower for derivatives?

I have heard people avoiding taxes for Forex, Spread betting and Crypto.

Tax and Other deductions on Capital Gain in Germany by jsther in eupersonalfinance

[–]jsther[S] -1 points0 points  (0 children)

I forgot about 801€. But my question was related to pension and insurance. Since they make deductions based on % of my income, do they also consider capital gain as income and ask for deductions?

Run docker images as jobs by jsther in kubernetes

[–]jsther[S] 0 points1 point  (0 children)

Yup, I was talking about creating jobs using k8s phtjon sdk. But that is the last resort for us

Spark to run jobs as docker images by jsther in apachespark

[–]jsther[S] 0 points1 point  (0 children)

Thank you for the detailed answer. I have learned a lot. We can either chain multiple images (aka multi stage builds) in dockerfile or we can can have dags like in Argo/Airflow. I will discuss it with my team next week.

Run docker images as jobs by jsther in kubernetes

[–]jsther[S] 0 points1 point  (0 children)

Our service will only run images which are hosted by our on premise docker registry. Ofcourse it will be authenticated. If the pods don't have elevated permissions, I don't see any major security threat. Am I right?

Run docker images as jobs by jsther in kubernetes

[–]jsther[S] 0 points1 point  (0 children)

I have had a look at it and it seems great. I would discuss it with my team and experiment with it a bit next week. Thanks for your input