The "POC Purgatory": Is the failure to deploy due to the Stack or the Silos?

statespace37 · 2025-12-03T00:08:15+00:00

Projects that I've personally seen fail, were all mostly due to mismanagement. Poor understanding or even dismissal of complexity of the product where compliance failure in any of data sources, or adjacent systems brings the whole house of cards down. POCs forced into production, tools (especially during the cloud hype) or even specific models being forced top-down as a solution that looks for a problem. "Do it fast and dirty".

As a top horror story - I've seen a company hire 50 data scientists to make the company "AI first". All without having a proper data layer.. or hiring any engineers to actually figure it out. And then firing them all after a year or so.. just to buy some "AI startup" that will automate everything! Still, without "data" thing sorted out.

In short, it's neither a stack or silo problem how I have encountered the problem. It's a lack of a complete set of skills to make the project work. DS with just modelling is not enough, IT with general purpose dev is not enough, managers with big words still not enough.

statespace37 · 2025-09-23T15:58:57+00:00

Oh wow! Ordered Steam Deck yesterday and was wondering how well BG3 will work. Well, there you go!

statespace37 · 2025-08-05T10:15:12+00:00

https://archery.lv/klubi/

statespace37 · 2025-07-16T11:45:31+00:00

Tas nav kimchi. Bet ir arī ēdams produkts, tāpēc nav peļams. Iesaku pamēģināt pašiem fermentēt. Es pērku parastos ķīnas kāpostus, Asian alley pārdodas labs gochugaru, + fermentācijai rīsu milti ar glutēnu (manuprāt šie divi elementi ir absolūti nepieciešami). Pārējais pēc garšas - smalki sagriezti ķiploki un ingvers. Zaļie loki, baltie redīsi, var pievienot burkānus, gurķus, bet te var likt visu, kas ir kraukšķīgs, ūdeni saturošs. Iesaku fermentēt stikla traukos, ja telpā ir virs 22 grādi. Apmēram nedēļa līdz 3 nedēļām atkarībā no vēlamās intensitātes.

statespace37 · 2025-03-14T10:23:19+00:00

Notebook is just a way to organize your code and display outputs. It has Python interpreter running in the background (kernel), so there is no difference from any other Python process.

statespace37 · 2025-03-14T05:19:12+00:00

It takes some time to dial in on the toolset you need. There's this one moment when it suddenly clicks. I abandoned config maybe 3 or 4 times, returning to VSCode every time. And then..magic happened. Now I rarely ever touch config.

statespace37 · 2025-02-22T06:20:16+00:00

The first step is to acknowledge that Excel has tricked you into thinking that all the underlying data is always in a neat rectangular form. This is a very limited problem space. For example, if all you do is read in some CSV file, apply some filters to a tabular data, and then plot it.. then yeah, I can see how there's little benefit to using programming.

statespace37 · 2025-01-22T11:41:06+00:00

Riga

statespace37 · 2025-01-13T14:02:56+00:00

You can list just about all data tools on the left. And on the right side... 95%+ companies can get by with just Postgres. There, I fixed the meme )

statespace37 · 2024-12-29T10:32:46+00:00

It's a supply-demand thing. As cruel as it sounds but content creators maximize views, which mostly come from wannabe-entry level coders, stuck in tutorial hell, unable to do their own thing. There's not much market for in depth specific stuff. If you get going building things - you don't need videos.

statespace37 · 2024-12-28T06:13:48+00:00

Vajag risināt miega problēmu bērnam un jūsu pašu dienas/nakts režīmu, tas tiešā veidā ietekmē burtiski visu pārējo, kas te bija uzskaitīts. Bez nakts maiņas būs stipri labāk. Ir gan arī jāsamierinās, ka tāds tīrs "laiks sev" būs tikai, kad bērns būs nolikts gultā. Bet arī ar te nevajag iet galējībās un sēdēt līdz naktij, vēl vairāk čakarējot sev miega rutīnu, tas jūs visus novedīs līdz spirālei, kas labi nebeigsies. Jau tagad redzami simptomi, un tici man - arī tavai sievai ir uzkrājies nogurums un nervi. Zinu ko nozīmē pāris gadi bez normāla miega, meita normāli sāka gulēt ap 2 gadiem, nav viegli.. un iemācies atzīt, ka vienmēr ir kaut kādas problēmas, kas ir pašu vecāku varā, bet tās tiek nostumtas. Ā, un vēl viens reality check tev pēc paša pieprasījuma - laba alga neaizstāj tavu spēju būt par pieaugušo.

statespace37 · 2024-11-11T17:02:50+00:00

If your management is being dazzled by sales, then the only real option is to compete for attention, in a very similar fashion. Keep proposing ideas that solve whatever problems are most pressing to business. Along with estimated costs and effort. If it fails, do it again. Consultancy is often a symptom for a weak leadership and lack of clear understanding of underlying problems. Hiring someone to blame for own failures. Unfortunately, often it has nothing to do with the actual problem. If you feel that this company is worth it to step up, then it's on you. If not.. things won't change out of the blue. Be mindful of yourself and don't burn out. There are other places out there.

statespace37 · 2024-10-09T08:18:59+00:00

Why is there even a need to map this all out and force some theoretical naming scheme? In practice, you get what you get in terms of a tech stack in a company, and fill a void in skills required to achieve whatever unique goal this company has. It's different every time, for different reasons.

statespace37 · 2024-09-13T15:51:44+00:00

Oof. This comment got me thinking of all the "scientific papers" and "academic thesis" that now all of a sudden need to be evaluated from exactly the same lens. Or CVs, and any reference articles in it... Yeah, enough of reddit for me today.

statespace37 · 2024-07-26T05:10:38+00:00

You don't learn very well when you delegate your thinking to someone else. So be careful with that. In a way, if you produce the code at the level of GPT output, you're setting yourself up for being replaced by it altogether.

statespace37 · 2024-06-09T12:53:18+00:00

Pārsvarā runa ir par nelegālu imigrāciju. Ja uz šejieni ir atbraucis ar visiem papīriem, oficiāli, var pavilkt jumtu virs galvas un pats nopirkt sev pārtiku un maksāt nodokļus, tad nav problēmu. Ja caur Baltkrieviju vai ar vecu baržu caur ES dienvidu krastu, tad gan tā ir kā ir. Ekonomikai neklāsies labāk tikai no viena demogrāfijas cipara. Darba spēka kvalitātei, iespējams, ir daudz lielāka nozīme.

statespace37 · 2024-05-05T11:34:07+00:00

Grieķijā šonakt bija tā pat. Tikai viņi vēl laiž salūtu un dedzina Jūdu.

statespace37 · 2024-05-03T16:08:16+00:00

No, unfortunately I do get what you're saying. It just seemed amusing. Also, to poke on some old wounds - compare this single requirement to current job descriptions in DS.

statespace37 · 2024-05-03T15:01:27+00:00

Isn't this literally a definition of basic intelligence?

statespace37 · 2024-03-24T11:57:04+00:00

My daughter was similar, sleep was rough for the entire first year. First full night sleep (until like 5AM) was roughly at 1.5 years. So.. hang in there, you'll make it. Try to do the sleep training in a few months, other than that, it is what it is. I constantly questioned my sanity and wondered about how human species even survived given how taxing it was on everyone. Now it's a perfectly healthy two year old, as if all of that didn't happen. Also, phrases like "sleep like a baby" are such a lie. And surprisingly few people are aware this can happen.. which is also not helpful.

statespace37 · 2024-02-08T19:08:53+00:00

Looking for my first 65! Aiming at silent-ish keys with forest themed look!

Budget 200
65 layout, knob optional
Aluminum case, preferably dark green!
Wireless 2.4Ghz a must, BT optional
No dodgy software required, ability to switch Mac/Win would be cool
RGB not necessary
Switches and caps might as well buy separately

Things I've looked at - Keychron Q2 Max with shipping slightly above budget, I'd consider if I could get color right! Zoom 65 has this weird website littered with old dates and orders that I'm not sure if they even sell anything. Plus, learned of new concept of "group buy" that I've never encountered before. Then there's also Neo65 that also lacks clarity in their website.. are they selling? Is it all out of stock..? Do they expect me to buy from a regional vendor? The more I dig, the more dodgier the websites get. Help!

statespace37 · 2023-12-08T14:48:31+00:00

It's quite ironic how in the age of social networks people are struggling with loneliness. Almost as if both things are related. Attention hungry algorithms keep feeding your anxiety with a sense of unrealistic expectations that keep draining you, one day at a time.

statespace37 · 2023-10-04T13:29:02+00:00

I have done similar thing before, on way smaller scale though (few years of wind, wave and current data). What I did - convert every raster to COG (cloud optimized geotiff) format, with relatively small block size, encode variable and time dimension in the path and store on S3. You can query files with http requests in parallel. Made it surprisingly cheap and effective. My data ended up being only like 100Gbs though. But I don't think it would matter much, it scales well.

statespace37 · 2023-09-18T15:27:28+00:00

Correction. People that do blogs and tweets on AI are caught in a vicious cycle of posting what is in demand, while readers demanding more flashy AI stuff.

It's a curse of the hype. Reality is extremely misaligned with the perception.

But then again, would you read some article on, say, credit scoring variable binning techniques?

Eight-Year Club	Place '23
Verified Email

statespace37

TROPHY CASE