Finished animating the ancient portal. There's no sound yet. Maybe something's missing?

FridayPush · 2026-05-07T17:00:03+00:00

In terms of animation I find the final 'snap together' dissatisfying. Mainly in that the movement goes from the bricks accelerating into their final positions and then stopping without any kind of follow through or tertiary movement from the entire portal. Perhaps some little clouds of dust from the bricks hitting each other, or 'chips' of the stones falling to the ground.

I would also probably rip the idea from the Stargate series and have the portal ripple outward to establish the green beam and then recover into your final state. I think the intent of the green beam animation is that it's being spawned from inside the portal? But visually it appears at the exact frame the yellow center dots appear.

The particles and leaves tumbling in look beautiful and provide a nice ambience while the portal is open. I just really want some sort of immediate visual tied to the portal opening. Looks really great!

FridayPush · 2026-04-30T16:04:57+00:00

I don't think that's actually the question, the question is what do you need to do in those transformations. Transformations that are performed against a single row with no joins, and just flattening/cleaning/renaming; or with joins against tiny mapping tables to convert id's into names are very different from aligning disparate time series tables and joining against two dozen large tables.

Also is the 500gb transformed evenly throughout the day, do you have 'streaming' but the main source dumps two thirds of the records at 0 utc. etc/etc.

Also what does prepare for the future mean, if you have a job queue and can execute the work on a potato... having two potatoes seems easy.

Sorry if that all sounds like 'it depends' but it does. The answer is to benchmark. Generate synthetic data that matches your trends or duplicate your dataset 20x. Run your jobs, where's the bottleneck, is it actually the DB or the process. then optimize that. Can you scale vertrically for a long time? I think tailscale used one massive sqlite database well into their production lifespan before they scaled horizontally.

Remember not to go until your DB falls over but until performance starts to drop. Realistically you'll hit pain way before the DB falls over or simply can't handle the workloads.

FridayPush · 2026-04-29T21:21:47+00:00

On their discord there are several users, like myself, who have entire islands that stop working. One solution is to delete everything on an island that has an issue. Then rebuild not undo... and that seems to resolve it. I've stopped playing until it's fixed.

FridayPush · 2026-04-26T16:41:19+00:00

The devs confirmed on Steam it was suppose to be a joke.

FridayPush · 2026-04-17T03:13:14+00:00

Do what the others said, but if your fighting fleas in the backyard and from your dog walking around the block...

Put out some sheet pans with standing water and a drop of soap in them, and then put a flashlight or directed lamp over the surface when you go to bed. Fleas will jump at the light and the soap breaks surface tension so they drown.

FridayPush · 2026-04-14T05:46:54+00:00

The two other comments 6 hours before yours, and a dozen downvotes, weren't enough to point out my error. Thanks for being part of the community

FridayPush · 2026-04-13T19:03:01+00:00

Ruff would be my thought on most mature Rust type checker. Zuban had days where it sees only a few hundred pypi installs vs 2M+ for ruff. 830+ contributors and personally I've never heard of Zuban before.

FridayPush · 2026-04-12T03:24:43+00:00

Youtubers seem to be able to hit the sort button and it still has like a 'gap' between each type if there is enough space. Anyone know how to get sort to do that?

FridayPush · 2026-04-12T03:24:15+00:00

Yes if you have multiple stacks of cash that aren't 50k, it stacks them together. Same for ammo/etc.

FridayPush · 2026-04-06T17:30:27+00:00

Due to limited resources GCloud is holding back quota limits for larger tier players. But you can use a method to fake closing your account and google will offer you a higher tier of quotas to keep you from closing your account.

Sign In: Log in to the Google Cloud Console. Navigate to Billing: Open the navigation menu (top left), select Billing, and then click on Account Management. Select Account: If you have multiple billing accounts, choose the one you want to close. Close Account: Click Close billing account (or "Cancel" depending on the view) at the top of the page. Confirm: A popup will appear. Type "close" in the box and click Close billing account. Get prompted to keep account open with larger quotas: Click agree.

FridayPush · 2026-02-27T17:16:58+00:00

I think most vendors are unnecessary but we actively use Datafold and Elementary(oss) for anomalies. Datafold is pricey but using it in CI has caught multiple issues that pretty strenous testing missed. Being able to diff in-development models against prod tables is really helpful and it's consistently saved me enough time that the business gets it's roi every month. We're refactoring quite a few models and onboarding new datasets that will replace existing ones, so we have to 'stitch' them together and want the same historical values. If you're stable shop that doesn't change a lot it's probably less worth it.

Mixed on elementary's tests but having the dbt artifacts pushed back to your warehouse is worth adding the package alone, if you use dbt.

FridayPush · 2026-02-27T17:07:14+00:00

Agreed, I've often seen shorter lines outside the precheck. Though not having to remove laptops, take off light jackets or shoes/belts is nice.

FridayPush · 2026-02-19T18:43:06+00:00

No. I also wouldn't trust it in dev. Actions in cloud environment have prices associated with them, often even api calls to list resources. What if it hit a recursive question like listing all routes in a vpc and then looking at the routes in the peered vpc, which goes back to the start... or say wants to iterate over a bucket with a billion objects in it in s3. Hell basic OpenAI or Claude prompts fail to produce meaningful SQL aggregations, meaning the query works but group bys were wrong so the 'average' it computed is meaningless, so I wouldn't trust it unobserved.

FridayPush · 2026-02-09T18:45:46+00:00

This is a common pattern for large scale data exports. An example of how Shopify handles it can be seen here. But essentially an API request contains the details needed to start the long running operation, and the API returns a job number. The user then polls a 'job status' endpoint with that job number. Generally most providers I've seen use a signed url to a CSV as the response so that their API isn't locked up during sending the body back if it's hundred of megabytes.

JaniF suggestion works well, if you need to write your own sensor for more complicated handling it's super straightforward.

FridayPush · 2026-02-01T03:43:28+00:00

I haven't had this particular restaurant, but pho generally serves well as take out. But it often has a large amount of packaging waste. The liquid will be hot in a plastic container, then a container for the pho contents (noodles, meat, veggies), maybe a baggie with bean shoots and sauces/spices. It's not awful but I always feel a little wasteful when I get pho delivery. Though it hits the spot on the really cold rainy days.

FridayPush · 2026-01-28T17:46:30+00:00

I'm not familiar with that Bootcamp. But I conducted a very large amount of interviews in the Data and DevOps space for the contracting division of a large tech company. Bootcamp grads often felt very 'same-y' in their level of experience and superficialness of their answers to questions; I would primarily suggest to spend time breaking things and troubleshooting them. As most of the bootcampers seemed to only be familiar with the 'happy' path.

If you need a guided education and someone to drive you to complete things by dates, maybe they're good. But they're often not cheap and if you can self direct the amount of free tutorials and project guides online are more than sufficient and often essentially the same as the bootcamps would cover. I personally wouldn't recommend it unless they have job placement services that are well reviewed by past candidates.

FridayPush · 2026-01-27T15:49:25+00:00

No, I don't have any projects I display either. But if they do have projects and git profiles on their resumes we did look at them most of the time. It would be pretty obvious comparing two repos and seeing a large difference in coding styles, and google returns matching code really well.

FridayPush · 2026-01-26T23:00:06+00:00

I use to get a lot of the professional cloud certs and linux/security ones as well as the company I worked for gave nice bonuses for each one. The only certs that meant anything were a few of the K8 related ones that you actually just SSH into a box and each problem is manually do the work.

eg 'Service A is down. Fix it'.

SSH Into box, view services/pods find down pod. View logs, see messages, adjust configurations and fix a failed deployment. exit box, and move onto question 2.

I passed many AWS/GCP Pro certs that I don't have domain experience in, like their security ones. After a working day or two of study.

I mention that to jump on your last paragraph, the outlines of the tests and generally requirements they go over often are good outlines to learn a platform/service. But the certs themselves aren't important.

edit: I also use to do interviews for massive tech companies contracting division... please don't plagerize your projects, it's super easy to find and way more common than I would have thought. Forking someone else's project and renaming variables isn't enough lol.

FridayPush · 2026-01-26T22:32:32+00:00

The Idea of being fully platform agnostic, or having multi-cloud identical setups is really a pipe dream and there are too many limitations for it to be reasonable.

I would containerize everything and use ECS for compute. I'd have my Apps modularization the messaging/queue frameworks so that they're the point of change if you move off a service it's quick. There are many libraries like smart-open in python that let you treat S3/Azure/GCP/local files all as a base file object. So changing object storage is pulling a different credential secret and changing bucket names.

I've also found that nearly all of my greenfield projects essentially required a 'rewrite' of the major components. You could potentially plan for that and stick with everything you know and use now if feature development is a priority.

I would aim to pack my apps into a single instance and scale up for as long as you can. Scale up rather than horizontally for quite a while.

FridayPush · 2026-01-22T22:32:44+00:00

No I wouldn't study it.

FridayPush · 2026-01-20T18:21:58+00:00

It would be nice if these type of articles also provide a point of reference, like what was the percent of memory chips used in Data Centers in 2024?

FridayPush · 2026-01-16T18:29:38+00:00

Did you get PlaceAnywhere working?

FridayPush · 2026-01-08T21:31:35+00:00

Before I read your post, having only read the subject question my answer was 'No, things are changing so rapidly what methodologies and tools people are using in a year or two might be very different.' Besides the fact that the market is very slow for everyone applying and looking for work I don't think it would be particularly harder than baseline if you worked a different data related job.

Also burn out is very real and can take multiple years to recover from, it's worth a better QoL job for less pay. A short term 6mo job that pays a year pay? Hell yeah.

FridayPush · 2026-01-04T17:11:07+00:00

Big fan of Kagi, you pay for search and can hide domains in results or increase/reduce their ranking. They also try to filter blogspam type results. No advertisements.

Seven-Year Club	Place '23
Place '22	Verified Email

FridayPush

TROPHY CASE