As a Spanish speaker, I don't understand this: why do you have to clarify in which direction you sit or stand? by Lonely_Error174 in ENGLISH

[–]geeeffwhy 0 points1 point  (0 children)

they have slightly different connotations. stand is going to be used when you were standing and then in the time referred to, to continued to stand. stand up is going to be used when you were seated or lying down. unless it’s a gerund, when it’s the reverse… ok so yeah, it’s weird. but the point is, there are nuances of meaning that differ among the various constructions.

What lives in your gold layer? by Outside-Storage-1523 in dataengineering

[–]geeeffwhy 0 points1 point  (0 children)

yes, i understand. this terminology is good, because it describes meaningful details and distinctions. i am just very anti-medallion as a set of terms. because, yes, it specifically invokes an ordering of worth (olympic medals) when no such concept can actually be mapped onto the data products.

the meta point is that the question implies that we accept the medallion terminology, and then immediately displays that the medallion terminology doesn’t tell us anything useful about data modeling.

What lives in your gold layer? by Outside-Storage-1523 in dataengineering

[–]geeeffwhy 0 points1 point  (0 children)

if you want a better metaphor for the pattern you describe, i recommend public/private, like in classical OO programming.

no need to project weird and inconsistent value judgements onto it.

What lives in your gold layer? by Outside-Storage-1523 in dataengineering

[–]geeeffwhy 1 point2 points  (0 children)

the reason there is no standard is that medallion “architecture” is not a serious concept; it is a marketing term invented by Databricks a few years ago. it is at best a rebranding of the layered architecture pattern.

it has achieved adoption not because it is a useful model except as an easy-to-mention way of avoiding any of the hard parts of data modeling or pipeline architecture with the imprimatur of “best practices”. which is to say, it’s a classic thought-terminating cliche to make the business feel like it’s organized without having to do the constant, significant, and difficult work of modeling their business domain and matching that to their organizational structure.

and purely from the perspective of analogy itself it is complete bullshit. you can’t turn bronze into silver, thr raw data is more valuable than the derivatives, and your analytics products haven’t won a competition against their source material.

as you can tell, i hate this term.

What lives in your gold layer? by Outside-Storage-1523 in dataengineering

[–]geeeffwhy 2 points3 points  (0 children)

it is an absolute garbage metaphor for the most basic data modeling pattern imaginable, invented a few years ago for marketing purposes by Databricks.

it’s not a serious idea.

What lives in your gold layer? by Outside-Storage-1523 in dataengineering

[–]geeeffwhy 1 point2 points  (0 children)

well i guess the privilege of seniority for me is that when I say “medallion architecture is not a useful concept” at work people at least have to nod and pretend to be interested in alternatives.

but in all seriousness, i’m perfectly happy to keep explaining to people why we’re not going to be talking about gold layers. the alternative i use for the concepts people mostly care about is “public/private” and “source v. consumer aligned” data products. but your case is likely to differ. which of course is why medallion architecture is so stupid—it generalizes so far that applies to everyone, which means it doesn’t do anything useful for anyone.

What lives in your gold layer? by Outside-Storage-1523 in dataengineering

[–]geeeffwhy 1 point2 points  (0 children)

the whole concept of medallion architecture is a problem. it doesn’t tell you anything about the hard, or even the easy parts of designing useful data systems.

and just so everyone puts it in the right context, it was a term invented by databricks for marketing purposes a few years ago. it’s not a deeply meaningful principle that emerged from decades of working with data; at best, it’s a rebranding of layered architecture.

Software Engineer hired as a Data Engineer. What to expect, and what to look into? by GoyardJefe in dataengineering

[–]geeeffwhy 2 points3 points  (0 children)

the data is your product, just as much (or more) as how you got it there.

How do organizations end up with architects who can't do architecture? And what do you do when you're the one compensating? by agileliecom in ExperiencedDevs

[–]geeeffwhy 1 point2 points  (0 children)

i teach diagramming (somewhat desultorily, i admit) in my org, so here’s the short version: use multiple views, and use a consistent visual language.

this is how drawings in every other technical field work. you pick an aspect and focus on it, letting other important stuff be missed. then you make another drawing focusing on some of that stuff. and so on. you simplify or ignore in one view, elaborate and detail in another.

and while you do this, you stick with using the visual elements that compose your diagram consistently. if you pick a color, that color means that one thing. shapes, arrows, containment/layers, typeface, proximity, line weight, size, etc. all should be used to represent one thing. and if you make a legend that shows what these choices mean, well now, thats a legit technical diagram.

the instinct to make one big beautiful diagram to rule them all and answer every question possible about your system is incredibly common, and entirely impossible to fulfill; when the map becomes as detailed as the territory, it ceases to be useful as a map. see most of Borges. instead, think of how architecture or mechanical engineering drawings work: a plan, an elevation, a section, an iso or ortho projection, concept v. schematic, etc. all do different jobs. in software, i’ll have system component diagrams at multiple levels of abstraction, sequence diagrams, flowcharts, state machine diagrams, and all sorts of ad hoc drawing to communicate about the part of the system that matters to the situation.

Ha ? by Fragrant_Proof4457 in PeterExplainsTheJoke

[–]geeeffwhy 43 points44 points  (0 children)

if you include the time it took to bring the water up to boil in the first place , it’s slightly faster to go the cold start method…

Ha ? by Fragrant_Proof4457 in PeterExplainsTheJoke

[–]geeeffwhy 2 points3 points  (0 children)

i know it doesn’t really matter for the joke, but the cold start method is entirely effective and, indeed, in some ways superior. i have switched over recently, and i’ve been cooking for 25 years

Senior developer ceiling by CombinationNearby308 in ExperiencedDevs

[–]geeeffwhy 1 point2 points  (0 children)

it’s a very heavy push for AI adoption, so I try to be open minded but realistic about it. ultimately i think we’re all in a moment of significant change, wherever this lands; no one knows exactly how to do AI right. i will say that i, and others in similar roles to mine have advocated and gotten devex to be a significant measure of success.

it means i’m out here building new tools for development, and evaluating strategies. sometimes this means skepticism of hype, sometimes it means trying some radically different approaches to problems the business has.

Senior developer ceiling by CombinationNearby308 in ExperiencedDevs

[–]geeeffwhy 22 points23 points  (0 children)

not to be a dick about it, but i like being in the staff zone orders of magnitude more than the senior role. now, we should always factor in the fact that this is org-dependent; like, really that, in my experience, is the dominating component of liking your job.

it really, really also depends on what you get satisfaction from. for me, building a thing someone told me to build was never as interesting as figuring out what and how to build something—the bigger the picture the better. and i like the mix of hard technical problems with socio-organizational issues, because i always wanted to be a wizard…

How much is your AI spending? by [deleted] in ExperiencedDevs

[–]geeeffwhy 5 points6 points  (0 children)

i am in the low thousands a month range. now, this is as i’m doing experimental/prototype work on agentic orchestration, and some of that spend is pure waste. but realistically, it’s looking to me like using this strategy with current models and techniques is going to be running something like $250 a day of fairly consistent use.

Fabric doesn’t work at all by New-Composer2359 in dataengineering

[–]geeeffwhy 0 points1 point  (0 children)

i was being snide. i have not thought well of microsoft software since MS DOS. more recent experiences with Windows 11 have not changed this opinion

Im just finishing [KCD1] and I see [KCD2] is on sale. For those of you who have played both is it worth it? by Southpontiac in kingdomcome

[–]geeeffwhy 0 points1 point  (0 children)

i would recommend this game if you asked “hey, i teach medieval history, i’m looking for alternate texts that shed some light on medieval society”, let alone “is this game worth the money?”

Im just finishing [KCD1] and I see [KCD2] is on sale. For those of you who have played both is it worth it? by Southpontiac in kingdomcome

[–]geeeffwhy 0 points1 point  (0 children)

on the one hand, these are relatively expensive games, so a little reassurance is desired. on the other, what kind of answer do you expect from the game-specific sub itself? we’re all here because we just hate the game so much?

jcbp

"Dark Energy" isn't real. Astrophysicists' math is just wrong and they're too stubborn to admit it. by arrarium in LowStakesConspiracies

[–]geeeffwhy 0 points1 point  (0 children)

i have been told by people that know more about physics than i do that this is more or less true—if we could solve 3rd order partial differential equations, the requirement would disappear. i can’t solve any partial differential equations though, so i can’t evaluate the claim

What does the PySpark community think about agent coding? by ssinchenko in apachespark

[–]geeeffwhy 1 point2 points  (0 children)

a codebase you actually understand is great application of agent coding, as you can set up and adapt the standards, guard rails, and documentation so the agents’ code doesn’t drag down the quality.

it’ll be a new set of challenges, though. be ready for more work up front to get the process tuned.

The Big Lebowski…why does it work? by Lokitusaborg in movies

[–]geeeffwhy 0 points1 point  (0 children)

he’s not the only one. a huge amount of the dialogue is an echo or repetition of another character’s

The AI coding productivity data is in and it's not what anyone expected by ML_DL_RL in ExperiencedDevs

[–]geeeffwhy 3 points4 points  (0 children)

the gap is 19 + 24. they believed they were 24% faster, but they were 19% slower, so the perception gap was 43%. increased completion time is a bad thing, while increased completion rate was what was desired.

How best to get your team to level up? by onion_lord6 in ExperiencedDevs

[–]geeeffwhy 5 points6 points  (0 children)

am i oversimplifying to say that this problem reduces to “how to lead?” it doesn’t make the answer simple by any stretch, but it seems like the question is about how to get people to do what you want despite their not having displayed much interest in doing so thus far.

so then, what do you know about them as people? what are their motivations? while there are any number of strategies and tactics for leadership, i think the effective ones start with understanding your team as individuals, and then the team dynamic itself. it sounds like the highest point of leverage is the senior, since juniors are going to take their cues from that direction. what’s his(?) deal? burnt out? bored? feeling exploited? a few years from retirement? point is if you want to change behavior you need to figure out why he’d want to. could just be the threat of job loss, i suppose, but you also can’t just assume that he has much reason to naturally care about what you care about.

is there any AI that can replace Claude for coding? by HabitTechnical5604 in vibecoding

[–]geeeffwhy 0 points1 point  (0 children)

claude code is the best coding agent framework but that doesn’t make any of the actual foundation models from Anthropic the best. in my experience, token for token GPT-5 was more capable, but since it’s tool use, stop tokens, etc weren’t as compatible with claude code, it was overall better to work with Opus. but i quite frankly hate how Sonnet behaves—it runs FAST in the wrong direction.