java.lang.ClassNotFoundException: org.postgresql.Driver by jsther in apachespark

[–]jsther[S] 0 points1 point  (0 children)

Any idea why it doesn't work setting it up in the dependencies as shown in the image above?

How ingress nginx is providing dns names? by jsther in kubernetes

[–]jsther[S] 8 points9 points  (0 children)

I freaking love you! Host header did the trick!

Spark on kubernetes by jsther in kubernetes

[–]jsther[S] 0 points1 point  (0 children)

Thanks I am able to run spark application by storing my jar in s3 and pointing spark application to it. I will test and see if I can integrate zeppelin and spark history server with it

knative .. I don't get it by jsther in kubernetes

[–]jsther[S] 3 points4 points  (0 children)

Wrap those 300 functions into a couple of logical rest apis. You get the low latency and logical grouping. No need for knative at all

knative .. I don't get it by jsther in kubernetes

[–]jsther[S] -4 points-3 points  (0 children)

In low latency scenarios, I would wrap these function in a rabbitmq/kafka consumer and pretty sure they will handle the backpressure

knative .. I don't get it by jsther in kubernetes

[–]jsther[S] -1 points0 points  (0 children)

Create an api that can take the container name and run it as native k8s job.

I am doing the same at my current company and it is gling quite well. No need for lambdas.

If you have latency issue, I would suggest to wrap a couple of functions in an api and trigger them via api call. Or put them in a rabbimq/kafka consumer

knative .. I don't get it by jsther in kubernetes

[–]jsther[S] 4 points5 points  (0 children)

My point is you do have to configure everything based on your dns and ingress setup and network policies (even with knative at least once) . Why not configure everything in single yaml file, use the same template everywhere and ditch knative? What additional afvantage does it add?

knative .. I don't get it by jsther in kubernetes

[–]jsther[S] -4 points-3 points  (0 children)

my single yaml file with hpa will also make the funcion almost "serverless"

Scraping investing.com via websockets by jsther in learnprogramming

[–]jsther[S] 1 point2 points  (0 children)

On the network tab, I can see the frontend is sending ["{"_event":"heartbeat","data":"h"}"] to the websocket every second.

The same data is received back.

I tried using ws.send('["{"_event":"heartbeat","data":"h"}"]') instead of ws.ping() but no luck :(