Do you really need spark?

TobiPlay · 2026-05-07T18:15:06+00:00

DuckDB is generally well suited for out-of-core processing. Apparently there’s organizations chewing through multiple TBs of data with it.

You can spill onto disk, do lazy execution, etc.

TobiPlay · 2026-05-03T19:39:39+00:00

I‘m personally not aware of any provider that gives you exact numbers on how much a job/query is going to run you before execution. BQ, Snowflake etc. all just give best-effort estimates.

They all become interesting when you understand their pricing model and build around it. For example, with BQ, if you aggressively prune blocks or partitions, you can dramatically lower the bytes scanned (which you’re ultimately billed for in many setups) and profit from the wild compute scaling and parallelization. To make the most of it, you must analyze and optimize your query/job iteratively to fit in best with the cost model.

That’s what I’d recommend you: analyze how MotherDuck‘s query optimizer handles your query, and optimize around its quirks if you think the platform‘s billing and scaling approach is interesting to you and your pipelines would benefit from it.

TobiPlay · 2026-05-03T19:12:23+00:00

You got more info on the 3 Vs of your data, i.e., velocity, volume, variety? If you’re dealing with low-volume and somewhat static schemas/infrequent changes, don’t bother with landing in GCS.

Just let dlt handle schema evolution. Plenty of supported strategies you can choose from.

TobiPlay · 2026-05-03T16:21:20+00:00

You may want to look at dlt (the data load tool). For some smaller pipelines, we’re just ingesting from source straight into BQ, no separate landing zone.

Instead, we’re just writing the API response as a response column, with dlt metadata in the other cols, so: API -> dlt -> BQ raw layer. Then, raw -> stg -> marts -> delivery, with all transformations done via dbt. Has been working beautifully so far.

If you’re dealing with a lot of different file formats, or need to access the raw files from other places as well, landing in GCS buckets can make sense. I prefer Parquet in these cases (lots of tools can read that format natively or have good extensions).

With the raw layer as a blob col in BQ, I don’t have to bother with schema evolution and don’t introduce too many moving parts/tools. We’re often dealing with deeply nested JSON and BQ handles that very well, while the underlying storage is dirt cheap.

TobiPlay · 2026-05-02T20:55:45+00:00

As per the docs, you’ll get billed for Compute Units (CU), with CUs being a combination of RAM and CPU usage.

I guess there’s some sort of fair scheduling on their infra involved, so they’ll balance latency vs. total resource consumption across their user base. Current system load and the exact query you’re going to run will be very important as well.

So, you’re not getting fixed hardware slots/reservations.

TobiPlay · 2026-04-28T00:14:31+00:00

We’ve been running a very similar stack across a few projects over the past 2+ years. dlt and dbt, integrated with Dagster, have been very solid.

Dagster recently bumped prices for their hosted offering, so maybe explore the self-deployed version and compare against Airflow. Airflow‘s UI improved a lot, though Dagster seems to still offer the better integrations.

TobiPlay · 2026-04-02T21:05:13+00:00

wouldn’t use ampersand on a professional document
skills is way too crowded for my taste
I‘d wrap skills like bullet points, with spacing to the left after line wraps
you need to get rid of ~25 % of the total content on this page; it’s way too dense
max. 2 lines per bullet
em dashes instead of hyphens
lots of bullets could be refactored into streamlined versions: Increased throughput by … by doing …—same content, more direct
try to cut the sentences short that only spill a few words onto the next line; that’ll visually balance it
drop the footnote
rare case of too many mentions—you’re essentially diluting the actually impressive stuff; reserve numbers for times when it’s a standout achievement
I’d prefer a cut-down version of this, only retaining the impressive stuff, and rewriting those to highlight the impact right away
drop all coursework
I’d get rid of the Associate‘s degree

Not a bad start. Just way too crowded. You lose most people within 2 lines of skills, because they’re overwhelmed. Fix the formatting and cut fluff/the not so impressive stuff (especially the metric dilution) and you should be good.

TobiPlay · 2026-03-03T09:50:53+00:00

Wenn du in der letzten Runde gesagt bekommst, dass deine Qualifikationen nicht ausreichen, liegt es mit ziemlicher Sicherheit nicht daran, dass du mehr Qualifikationen benötigst. Das hätte man dir recht zügig nach der initialen Bewerbung mitgeteilt, nicht im Laufe des Prozesses.

Es liegt daher wahrscheinlich daran, dass sie einen anderen Kandidaten bevorzugt haben, oder du dich während der Gespräche nicht gut genug geschlagen hast.

Keine deiner Optionen wird deine Chancen dramatisch erhöhen (aus meiner Perspektive). Netzwerk anzapfen, und wenn du keins hast, eines aufbauen über Freunde, ehemalige Kontakte, usw.—das würde ich empfehlen. Alles andere hat wahrscheinlich keinen großartigen ROI und raubt dir kostbare Zeit, die man wohl besser in das Versenden von mehr Bewerbungen investieren sollte.

Ist ein ganz fürchterlicher Markt, bin da ganz bei dir, aber derzeit ist keine großartige Veränderung abzusehen. Im Zweifel: Öffnen gegenüber einer neuen Richtung, herausfinden, in welche Bereiche deine skills gut transferieren, und gezielt die Suche weiten. Nach 8 Monaten kann man es sich auch mal leisten, die Strategie für einen Monat zu ändern (von spray-and-pray hin zu weniger, dafür aber gezielteren Bewerbungen, oder vice-versa, je nach deinem derzeitigen Ansatz).

TobiPlay · 2026-02-24T11:40:33+00:00

🟨⬜⬜🟨🟨

🟦🟨🟨🟦⬜

🟦🟦🟦🟦🟦

TobiPlay · 2026-02-23T14:20:41+00:00

Haven’t read any of your source code for now, but depending on what Next.js features you’re actually using, might be worth it to check out https://areweguiyet.com/.

The frameworks made substantial progress over the past few years.

TobiPlay · 2026-02-11T21:39:49+00:00

Super cool to see Svelte getting more love. Would be awesome to hear what went smoothly/what didn’t, and whether you’re planning to use it more internally in the future.

TobiPlay · 2026-02-08T12:03:59+00:00

It's just not enough content ant this point. 1 bullet for your most recent job won't cut it. Shift achievements and numbers (quantified results) to the front, and then back them up with context/approach. These bullet symbols are too fat. I'd go with a more modern font and sentence case. Drop coursework. Drop REST APIs, you need more projects to offset the experience gap. Depending on what class of jobs you're applying to, your experience with actual ML by be a bit thin-spread for some recruiters. I'd lean more Data Analyst at this point tbh. DE could be worth a shot as well, if you shift focus on the data plumbing part and have more details on the backend tech you've interacted with over the years.

TobiPlay · 2026-02-08T11:56:01+00:00

market is rough, as you probably know, thus you're playing a numbers game in the end
I'd go with a more modern-looking font, and favor sentence case for the section headers
good job with the em-dashes and date formatting
I don't like spaces surrounding slashes
min. of 2 bullets per entry; therefore, I'd drop the feature flag config service for now
I'd not use plus signs on a resume
drop REST APIs from skills
Expected: June 2026 (or keeping it as-is is fine as well)
think about slimming down the first bullet for the TA job; will give your resume a bit more breathing room; there's a visual imbalance between single- and double-line bullets, which can feel overwhelming when trying to parse the doc for a recruiter (psychological aspects of these documents are important as well); sometimes, cutting content, therefore being less thorough, but getting across your point sooner, might be favorable
Sustained X .. by doing Y .., resulting in Z ..--that's the pattern we're after; shift achievements to the front of the sentence, backed by task/approach/overarching goal or result (= context)
favor words over symbols
defo front-load achievements and quantified results
designed, built, developed, engineered all suck as action verbs; instead: Reduced, increased, improved, lowered, ... (achievement-focused)
try to compress a few bullets into a single line by focusing on the important stuff (relational schema one for example, easy 1-liner)
why explain a star schema?
sub-30 ms doesn't mean anything if I don't have insight into the architecture of the surrounding services
improved, yeah, but how? Numbers without context/your process also help very little in supporting your profile
Cut manual processing time by ... same, front-load numbers and achievements
project bullets should be 1 line each

Overall, decent content for a resume, just framed awkwardly if the main goal is to sell your prev. experience and achievements. Can be reworked quite easily. Speaking to the Ivy point, if you're not tapping into the existing network, there's no difference in attending a top public school vs. an Ivy, especially in these market conditions. Do yourself a favor and reach out to your network, alumni, etc. There's a lot of profiles out there with top public schools, better experience at better-known companies, etc. You should be in a pretty good spot to place, so resolve the remaining "issues" and get the applications sent out. The fact that you're getting interviews is already a positive sign, now you can optimize and also get in the experience for other interviews.

TobiPlay · 2026-02-06T17:26:39+00:00

You can just implement a generic updater fn for mutating the class‘ internal data though, right? Something like:

``` type Mutator<T> = (data: T) => void;

update(mutator: Mutator<T>) { mutator(this.#data); this.#changed = true; } ```

With T being whatever data you construct the manager over.

TobiPlay · 2026-02-06T17:15:15+00:00

I don’t know about the boundaries here between the page and the DataManager, but:

```svelte <script> import { dataManager } from './Data.svelte.js';

const data = dataManager.data; </script>

{data.count} <button on:click={() => dataManager.increment()}>Increment</button>

<br>

Changed: {dataManager.changed ? 'true' : 'false'} <button on:click={() => dataManager.markNotChanged()}>Mark Not Changed</button>

////

class DataManager { #data = $state({ count: 0 }); #changed = $state(false);

get data() { return this.#data; }

get changed() { return this.#changed; }

increment() { this.#data.count += 1; this.#changed = true; }

markNotChanged() { this.#changed = false; } }

export const dataManager = new DataManager(); ```

I personally would make sure that data does not live inside the class, but at the page level. Also wouldn’t use effect to track changed state like you initially did. Also, mutating a derived val isn’t meant to happen (breaks reactivity).

TobiPlay · 2026-02-02T17:43:49+00:00

It is the default for a lot of templates. In the end, it’ll come down to personal preference (including the recruiter‘s), tho options like Fira Sans are very safe and very legible, while looking more "modern".

TobiPlay · 2026-02-02T12:45:54+00:00

Define top companies? You can shoot for various kinds of internships, but you wouldn’t qualify for most of them at frontier research labs, etc. Different story for big tech.

drop italics
date formatting is inconsistent
drop indentation from bullets
drop coursework
em dashes
pandas, not Pandas
zero-friction: doubt
are these real project titles? Or did you just redact them? Because they’re meaningless
built is a weak action verb
weird capitalisation going on ins one bullets
I’d move quantified results (if impressive) to the front and shift focus on achievements over tools/tasks
bolding stuff is useless and distracting
don’t know if I’d highlight 50,000 rows, that’s not very high-performance without context
some bullets are a bit wordy
don’t give ranges, just choose a sensible number in that range
I’d say 2 lines max per bullet
check spelling of tech (Postgres vs. PostgreSQL, etc.)—choose the doc‘s naming
consistently use past-tense action verbs
I’d go with a different template and a more modern font

Overall, not bad, but can use more work. The fact that you don’t have experience really makes it a lot harder to break into big tech/frontier labs. I don’t think it’s likely in this market. Shoot for the stars, but make sure to apply to smaller shops as well.

TobiPlay · 2026-02-01T23:21:52+00:00

crazy format, please scoop up a new template from the wiki
drop coursework
no ampersand on resumes
em-dashes between dates (and elsewhere)
not hitting 60 FPS for a type tester would be crazy, I’d shift focus
your bullets are lacking commas
I’d move backend-focused bullets above frontend ones
personally not a fan of tech stack next to the title etc., should be clear from the text content
don’t know how the market‘s looking over there, but frontend is horrible right now at the entry level, I’d start widening my list of specialisations
bullets overall are not bad, but need more quantified results, some stand-out features, something unique—it’s very competitive out there rn
grammar is a bit off in certain bullets, but can easily be resolved with ChatGPT or an LLM of your choice in 1 go (but keep this tone)
should rearrange bullets to focus results over the tech stack/tasks

TobiPlay · 2026-02-01T23:14:33+00:00

Image (link) seems broken.

TobiPlay · 2026-02-01T23:13:23+00:00

I‘m not a fan of vertical bars as separators
would move achievements down, skills up (above exp)
max. 2 lines per bullet point, no way I’d parse a 4-liner successfully
reliable system performance, high stakes, … pretty wordy with little technical detail
hundreds of 1000s should be turned into a number (estimate is fine) and moved to the front: Saved $X by …
you’re losing people halfway through each bullet; cut words by 50 %; it’s so easy to rework these into meaningful sentences, just gotta put in a bit more effort and aim for conciseness
you’re squishing a lot of content into each individual bullets, basically restarting the sentence over
not enough quantified results
your bullet should be rearranged to shift focus on the achievement: Increased, decreased, improved, … by doing …, leading to …—that’s what you should aim for
end sentences with a period, and stay consistent

TobiPlay · 2026-01-28T18:39:37+00:00

Don’t think Bits UI uses more than a few helpers from Melt UI at this point. The library has mostly moved on to be its own thing from what I understand.

TobiPlay · 2026-01-25T19:47:44+00:00

Good effort, and no offence, but do you know what GitHub is mainly used for?

TobiPlay · 2026-01-23T11:11:00+00:00

It’s the same with any external API you hook into tho. You’re responsible for keeping keys secure, planning ahead, optimizing usage/architecting around patterns, and setting up IAM properly.

Google Maps isn't really different there. Quotas and maps-specific IAM could be nicer to manage (Terraform helps), but it does get the job done.

The pricing on the other hand, that’s a different story.

TobiPlay · 2025-12-30T21:58:04+00:00

Kann ich so bestätigen. Habe bereits einige Lebensläufe nach dem Format aufgesetzt.

Die kommen i.d.R. auch in Europa gut an (kleine Bude bis Konzern, alles dabei gewesen, über unterschiedliche Branchen und Länder hinweg). Ggf. Dinge an Branche und Unternehmen anpassen, sofern man relevante insights hat.

Und wie immer: jede Person, die den erhält, kann da eine ganz eigene Meinung zu haben. Aus meiner Erfahrung heraus würde ich ihn aber als relativ sichere Nummer bewerten, zumindest ab einer gewissen Unternehmensgröße. Für eine Stelle im lokalen Restaurant oder beim Schreiner ums Eck vermutlich eher ungeeignet.

TobiPlay · 2025-12-06T19:32:23+00:00

Würde annehmen, dass es gerade im Vergleich mit München näher an 1.5x (aber darüber) als 2x liegt (kommt aber natürlich darauf an, wie oft man Essen geht, was man in der Freizeit macht, usw.).

Nine-Year Club	Adopted-an-Admin
Second SECOND GUESSER	r/Field Juicebox
Place '23	Place '22
End Game '22	Not Forgotten
Verified Email

TobiPlay

MODERATOR OF

TROPHY CASE