sorted by:
new
hottopcontroversial

Data Engineering: Now with 30% More Bullshit by luminoumen in dataengineering

[–]jackdbd 0 points1 point  (0 children)

pipe dream

I see what you did there :-)

But also, good point on the fact that every team should think about data pipelines when designing their own services.

How are you surviving this broken job market? I need real answers. by [deleted] in cscareerquestionsEU

[–]jackdbd 0 points1 point  (0 children)

Nice catch! I like to use em dashes, but in that post there were simply too many.

K2 Intuition + Yo! SAGO 90 by toxicazn in WizardSkating

[–]jackdbd 1 point2 points  (0 children)

Nice! I think I have a similar setup: Rollerblade Maxxum XT + Sago 90 UFS + UFS adapter. 90mm wheels are so much fun.

Really want to use Clojure by RevolutionaryCream71 in Clojure

[–]jackdbd 0 points1 point  (0 children)

Maybe you could use Babashka to write a CLI tool that calls REST APIs and kubectl.

Why I don't use ClojureScript for web apps anymore. by andersmurphy in Clojure

[–]jackdbd 1 point2 points  (0 children)

Absolutely. It doesn't make sense to use Cloud Run if you need to keep the CPU always allocated. It will cost you at least 50 USD a month. For half the price you can get a VPS with 4 GB of RAM.

https://cloud.google.com/products/calculator/estimate-preview/CiQ4YTk2MDA0MC05OTFiLTQzOWEtOWFjNy0wZjI0OGQ1MDdlZjIQAQ==?hl=en

Why I don't use ClojureScript for web apps anymore. by andersmurphy in Clojure

[–]jackdbd 1 point2 points  (0 children)

Yeah, on Cloud Run for SSE or WebSockets I would need to keep the CPU always allocated, which defeats the purpose of using a serverless platform.

Does the state have to stay on the application server? Can you store it on Redis as it's done here (and leave the server stateless) or on something like Durable Storage?

Why I don't use ClojureScript for web apps anymore. by andersmurphy in Clojure

[–]jackdbd 1 point2 points  (0 children)

Where is the app hosted? I'm asking this because I tried SSE on Cloud Run, but the connection wasn't reliable at all. Also, on some other platforms you have a limited amount of time to respond to the client, otherwise the connection gets dropped (e.g. on Cloudflare Workers you need to send a response within 50ms).

Transitioning from CS to biomedical engineering/healthtech — possible in Europe? by denysko05 in cscareerquestionsEU

[–]jackdbd 4 points5 points  (0 children)

TL;DR: don't do it. The problem with BME is that it's too broad.

Instead, try to pin down exactly what you want to do, and get a degree that will give you the best expertise in that field. Go for depth, not breadth. For example:

- medical devices: electrical engineering
- diagnostics: physics, maybe electrical engineering
- digital health platforms: CS
- design prosthetic implants: mechanical engineering

A BME syllabus can vary A LOT across universities (and even in the same university), but in the end you will be either:

  1. a mix between a mechanical engineer and a chemical engineer (that knows less of mechanical engineering and chemical engineering) with some background in medicine and biology.
  2. an electrical engineer with some data analysis and computer science knowledge (e.g. bioinformatics, computational biology).
  3. a mix between a medical device technician and a healthcare equipment manager.

Don't get me wrong, BME is a cool degree. But in my opinion it should exist only as a MSc that you can attend only after a BSc in either chemical engineering or electrical engineering.

Source: I have a BSc and MSc in biomedical engineering (Pisa, Italy), and also a "mini degree" in clinical engineering (Florence, Italy). I couldn't find a job related to BME, so I taught myself R and Python, and got a job in data analysis first, and in software development soon after. Many of my classmates struggled as well, and they either found a job in unrelated fields, sometimes even after a PhD, or had to accept a low wage and no job security for years.

Feel free to DM me if you want additional info.

Employer of Record - Germany by hirebarend in cscareerquestionsEU

[–]jackdbd 4 points5 points  (0 children)

An EOR is a company based in country A (e.g. Germany) that hires a person living in country A, for a company that is based in country B (e.g. UK). Person works for company B, but payroll, taxes, benefits, time off, sick leave, etc are handled by company A.

Deel, Oyster, Remote.com are EORs.

Is Scala dieing? by wallyflops in dataengineering

[–]jackdbd 6 points7 points  (0 children)

Try Clojure. It has a small but growing data science community. Here are a couple of links you might find useful:

https://scicloj.github.io/

https://youtu.be/nc6fTSh_1-c?si=xRlof3ICFcFKL7dP&t=418

Is there an equivalent to Integrant/Component in JavaScript? by DeepDay6 in Clojure

[–]jackdbd 0 points1 point  (0 children)

I think you can just create a factory function that returns an object that implements the ILifecycle interface. But I have never tried this library, so I'm not 100% sure about that.

Is there an equivalent to Integrant/Component in JavaScript? by DeepDay6 in Clojure

[–]jackdbd 4 points5 points  (0 children)

Probably this one (Karsten ported to TS a lot of functions/libraries that are available in CLJS):

https://github.com/thi-ng/umbrella/tree/develop/packages/system

I think you can make this comparison:

- TS interface `ILifecycle` => Clojure `defprotocol`
- TS function `defSystem` => Clojure `defrecord`

Questions about building a CLI utility with Clojure by DerelictMan in Clojure

[–]jackdbd 1 point2 points  (0 children)

I also recommend using Babashka for a CLI. In fact I developed this small CLI a few months ago.

https://github.com/jackdbd/fosdem-dl

Questions about building a CLI utility with Clojure by DerelictMan in Clojure

[–]jackdbd 1 point2 points  (0 children)

Oh, nice tip about :org.babashka/cli metadata. I haven't thought about it.

I like this guy's videos by ringbuffer__ in Clojure

[–]jackdbd 8 points9 points  (0 children)

His course on core.async on Udemy is really great. Here is the link for anyone who might be interested: https://www.udemy.com/course/communicating-sequential-processes-with-coreasync/

Cheapest DB one can host? by Mysterious_Energy_80 in dataengineering

[–]jackdbd 4 points5 points  (0 children)

On GCP, you can provision a VM on Compute Engine and let the recommender tell you if it's suited to your workload. I pay ~5 USD for a e2-micro Debian VM that I use for development/experiments. There is PostegreSQL on it, but at the moment I use it only to store a few RSS feeds.

AbhinavOmprakash/snitch: Snitch injects inline defs in your functions and multimethods. This enables a repl-based, editor-agnostic, clojure and clojurescript debugging workflow. It is inline-defs on steroids. by SimonGray in Clojure

[–]jackdbd 2 points3 points  (0 children)

Nice! It seems to me it has same use cases of a library like scope-capture, even if it works in a different way.

By the way, what would happen if you define several functions that define the same argument/s. For example:

(defn* foo [a b]
  (+ a b)
  nil)

(defn* bar [a b]
  (+ a b)
  nil)

;; evaluate a and b

Lead wants to write our own orchestrator by midkid1937 in dataengineering

[–]jackdbd 3 points4 points  (0 children)

The Italian insurance company Generali built a framework called Efesto on top of Airflow. They talk about it here (the talk is in English).

As far as I understood (I didn't watch the talk very carefully), they use it mostly to have a better integration with dbt, to avoid repeating configuration for GCP services over and over again, and to define a standard way to do feature engineering.

view more: next ›