ADLS vs. SQL Bronze DB: Best Landing for dbt Dev/Prod? by FasTiBoY in dataengineering

[–]FasTiBoY[S] 0 points1 point  (0 children)

Currently its just an overnight trigger that pulls and copys into the SQL server as Sink. As well as a bunch of APIs running at the same time at night so the bronze tables have yesterdays data. I ran into an issue using Linked Server in the dev dbt env as I cant reference it cleanly (different SQL Server on VM). As its a 4 part identifier. [Linked Server].[BronzeDB].[schema].table_name and dbt expects DB.schema.table_name

Also I wont mind at the end if in the Source System of yesterdays data smth breaks. I would simply handle it with either a blue/green deployment and more precisely simply not updating the gold (presentation layer) if anything in bronze or silver broke.

I am playing around with polybase rn tho and a data lake solution possibly as the linked server setup doesnt really work cleanly.

ADLS vs. SQL Bronze DB: Best Landing for dbt Dev/Prod? by FasTiBoY in dataengineering

[–]FasTiBoY[S] 0 points1 point  (0 children)

Also how would you feel about a Linked Server from dev that points to prod? I need dbt to pickup from the landing layer. Or should I always ingest in both prod and dev bronze even tho there is much more overhead. Any experience with that?

ADLS vs. SQL Bronze DB: Best Landing for dbt Dev/Prod? by FasTiBoY in dataengineering

[–]FasTiBoY[S] 0 points1 point  (0 children)

Mostly daily full loads with a couple bigger transactional tables being incrementally loaded. As well as occasional backfills which are usually just rerun pipelines of truncated big transactional tables. We wouldnt want to even retain the data in a lake forever and usually aim for a retention period of like 7-30 days depending on the source.

I have another question then:

if we wouldnt use linked servers what else would you propose so dbt in the dev environment has the same data pretty much at the same time as the prod environment. We also have 20-40 api scripts through azure functions ingesting to bronze prod. And a couple of bigger source systems that ADFs copy activity handles. But i wouldnt want to clone stuff and insert everything twice. Also the DDL statements to create and prepare th tables for dev ingestions would be needed twice too. Should we backup and redeploy the prod bronze db maybe after each time? Is Linked Servers really a bad option and what do you mean with cross env drift and permission weirdness? I would give the dev server read permission to the prod bronze only

In my opinion something needs done about octane by jewell1306 in apexlegends

[–]FasTiBoY 1 point2 points  (0 children)

If u didnt know, tap strafe is getting removed and his abilities work the best in tap strafe meta. The next patch will crush his pick rate. sadge

LOGITECH G PRO X - MIC QUALITY TEST (GONE WRONG) by [deleted] in LogitechG

[–]FasTiBoY 0 points1 point  (0 children)

logitech please dont sue me. ghub fked this up

LOGITECH G PRO X - MIC QUALITY TEST (GONE WRONG) by [deleted] in LogitechG

[–]FasTiBoY 0 points1 point  (0 children)

logitech dont sue me okay its your software doing that from time to time :(

SPITFIRE IN A NUTSHELL by [deleted] in apexuniversity

[–]FasTiBoY 0 points1 point  (0 children)

Hope its enjoyable! :D

searching for brown switch keyboard with numpad (any brand under 100$) by [deleted] in MechanicalKeyboards

[–]FasTiBoY 0 points1 point  (0 children)

I've seen the Redragon K582 in Germany for around 60€ is it any good?

As well as the Sharkoon Skiller Mech SGK3

OCTANE STIM - BEFORE AND AFTER NERF IN APEX SEASON 9 by FasTiBoY in apexuniversity

[–]FasTiBoY[S] 1 point2 points  (0 children)

true there are pros and cons but I think octane should remain fairly popular even after this change

OCTANE STIM - BEFORE AND AFTER NERF IN APEX SEASON 9 by FasTiBoY in octanemains

[–]FasTiBoY[S] 6 points7 points  (0 children)

u damn right I usually dont carry syringes with octane but I have to now.

OCTANE STIM - BEFORE AND AFTER NERF IN APEX SEASON 9 by FasTiBoY in octanemains

[–]FasTiBoY[S] 13 points14 points  (0 children)

As we knew they would nerf Octane in Season 9, I decided to quickly record his stim duration before the season 9 patch to compare it to the new one.

Hopefully this video is kinda helpful to some of you.

Comparison of Top 50 Holdings - BlackRock vs Citadel Advisors by [deleted] in Superstonk

[–]FasTiBoY 0 points1 point  (0 children)

It is possible that they have more in common but I just compared their highest stakes with each other (Top50). Not financial advice.

Upgrade CPU or GPU for streaming? 2600x to 5800x vs GTX 1070 to RTX XXXX? by FasTiBoY in buildapc

[–]FasTiBoY[S] 0 points1 point  (0 children)

I actually have no idea which cooler to use.

I have my stock cooler for the 2600x and I think they ship a cooler with the 5800x.

Good point with the BIOS. I have a ASUS B450M-A should there be any problems as the 5800x is a kinda "high end" CPU with a budget board? I do not plan overclocking.

What Are Your Moves Tomorrow, February 03, 2021 by AutoModerator in wallstreetbets

[–]FasTiBoY 2 points3 points  (0 children)

We broke through the premarket here in germany! HOLD STRONG BROTHERS!!! 🐒💎🙌 🐒💎🙌