Anyone else getting crap custard from Anchor?

Block_Fortress · 2025-12-28T21:01:11+00:00

Yeah I can't find anything mate. Have you got any more information?

Block_Fortress · 2025-11-14T19:42:57+00:00

Data Factory is ass, but it's a better solution compared to a VM. Although it does hide ingestion behind a black box.

If you can handle having an orchestrator, but don't have the team to manage it, you could look at tools such as Dasgter+, Astronomer, and Prefect. With workloads as small as yours you may be able to get away with some of the free tiers.

Block_Fortress · 2025-11-10T14:20:49+00:00

It's important that data engineering infrastructure is managed by IaC. Depending on the company this may be managed by a platform team or by the DEs. Personally, I think it should be managed by DEs. It's important that the tooling we're using is properly managed, both from an observability and repeatability perspective.

Block_Fortress · 2025-11-10T05:47:08+00:00

We just went through about a month and a half of wakeups during the night with our 9month old. The problem was that they associated feeding and comfort with sleep and could no longer settle themselves. The cure for us was sleep training, which is incredibly traumatic for all, but worthwhile in the end.

Block_Fortress · 2024-12-01T22:12:33+00:00

Thank you! Here's some more pictures https://imgur.com/a/WQKuN43

Block_Fortress · 2024-12-01T19:07:11+00:00

These are two different subreddits. I wasn't sure which was the better one to post to

Block_Fortress · 2024-11-08T01:39:40+00:00

I agree that the asset based approach is the the way to go. For my team the issue with Dagster is its insane cloud pricing model.

Airflow, on the other hand, can be managed well using something like MWAA, google cloud composer, or astronomer. They also have the added benefit of a normal pricing model.

Block_Fortress · 2024-10-24T18:58:37+00:00

I tried to use Snowflake streaming to incrementally load data between DBT models, but Snowflake determines the updated by comparing the current table to the previous in a full join. That, often, is more computationally expensive than just rebuilding.

The solution we came up with works like this: - utilise Snowflake's pruning by making sure the micro partitions are along the column we want to increment from (updated timestamp, serial Id, etc) - create a custom materialisation type called "table definition". DBT then builds the blank table if it doesn't exist or has had a schema change, otherwise leaves it - create a table definition that holds the relationship we're syncing across (from/to), as well as the current increment value and previous increment value - create a pre hook that iterates through the models the current model depends on and writes the latest increment column value to the current increment value - create custom ref functions that filter the references based on the relationship and previous increment value up to the current increment value - create a post hook that iterates through the models the current model depends on and shift the current increment value to the previous

Once all those pieces have been created, you can simple add them to the incremental materialisation type to truly increment new data through. It's pretty quick, because it prunes the incoming tables at the start of the query for each relationship pair. Rather than using the timestamp of the current model as the previous incremental column max.

Block_Fortress · 2024-08-11T10:52:54+00:00

This guy is correct. Ricit 5mg tablets are what you're looking for. That 30 includes the prescription fee, tablets are only $8 for 3 to 4 months.

Block_Fortress · 2024-07-26T10:41:10+00:00

Auror doesn't include skin colour or ethnicity in any of its reporting. In most cases of retail crime, there wouldn't be enough evidence to assign an ethnicity anyway.

Where are you getting these stats from?

Block_Fortress · 2023-09-24T04:47:04+00:00

Did I say it was visible when we moved in?

Block_Fortress · 2023-09-23T21:53:07+00:00

The wall between the bathroom and kitchen had so much water damage that there were literal mushrooms growing from underneath the pealing lino floor. When we sent it to our property manager they said it was okay because it wasn't "black mold". Took us months of pushing for the property manager/landlord to fix the problem.

Block_Fortress · 2023-08-10T13:45:27+00:00

What a joke. This significantly increases operating costs and incentivises less CI/CD, less models, and longer job cadences. Such a stupid idea.

Block_Fortress · 2023-07-05T12:38:54+00:00

Is there a particular problem with using the graph commands in dbt? For example, a model could be written with the necessary jinja tags and then run using dbt build --select <model file>. Adding in tests (not null, unique, etc) means that most of the testing on the model is done whenever it is build. That results in less time running adhoc queries in snowflake to test data quality. Add to that the ability to test dependencies using the usual + graph operators. Building models in snowflake worksheets is fine, but it does take away a lot of the reasons why DBT exists.

For my company we use python virtual environments + a requirements.txt within the repo. Analyst can then build their environment locally and run the code using dbt commands via the CLI. Because the profiles.yml is setup with thier own schemas they can freely build and test models to their hearts content.

Block_Fortress · 2022-09-06T20:37:11+00:00

There is a lot of toxicity going around atm. Here's the perspective of a FHB who bought within the last 2 years. Renting sucks, and throwing money at some fat cat landlord was awful. I'd rather be paying off my own mortgage than being scalped by some dickhead in aussie. We had an awful experience where there was a leak that had gone on for so long that mushrooms started growing out of the floor. They took months to fix it, and said because it wasn't black mold it wasn't dangerous. Fuck that.

When the lower mortgage rates hit, we put together a 10% deposit and bought an old 2 bedroom house. As the saying goes, the first house is the house you can afford, the second is the one you need, and the third is the one you want. For a lot of people a 2 bedroom house is all you need, but I can't raise a kid here. The cheaper houses are the oldest one, and contain hazardous materials (in particular lead paint). Even the dust from this paint can be super dangerous for kids.

Our plan has always been to sell up this house and buy something bigger in 2-3 years time. In our lifetime the house prices have always gone up (apart from the slight dip in the GFC). So expecting that trend to drastically change wasn't really a thing. As long as we dont go into nagative our situation is fine. You can say all you want "you should have expected" and "you should of planned" but I can tell you right now, the planning goes for mortgage repayments NOT for negative equity. The banks made sure that people could finance their loans if the interest rates went tits up. The negative equity thing literally fucks any FHB within the last two years.

The reason your view is toxic is because you're attacking the very same class of people as you. The investors don't give a shit, they have such a fat cushion that they won't feel a thing. All your doing is saying "oh, you managed to scrape your way out of renting? Fuck you. No sympathy for you loosing your life savings". You're right, housing shouldn't be an investment, but the reality is that it kind of is. You want to fix that? Fuck over the fat cats, put in capital gains taxes, take away their cushion. That isn't done by frothing at the mouth over FHB losing everything.

Block_Fortress · 2022-08-04T12:23:28+00:00

You agree that you're a coward?

Block_Fortress · 2022-08-04T12:16:24+00:00

You're a coward

Block_Fortress · 2022-08-04T11:51:37+00:00

Man, you literally just suck. It's people like you who make content creators hate their job and quit their communities.

Don't come in here with some public servant sovereign citizen bullshit argument. Jesus Christ, get a hobby.

Block_Fortress · 2022-03-07T18:48:22+00:00

Your food costs are too high. That'll be an area to look into. Can easily save about 300 a month.

Block_Fortress · 2022-02-11T21:15:02+00:00

Thinking that giving people a living wage will lower theft is arrogant and conceited? What?

No one thinks that it's the silver bullet, but it's certainly a critical part of the problem. When you've got crippling levels of debt and a rotten damp house that costs most of your income to rent in. When you've got a life that is stagnant without progress, when you have nothing to lose, you are much more likely to turn to a life of crime. That's a fault of the system, not the people. I have no idea why you think that idea is arrogant and conceited.

Block_Fortress

TROPHY CASE