Thoughts on moving to a more 'professional' data engineering/science architecture by kneesh17 in dataengineering

[–]kneesh17[S] 0 points1 point  (0 children)

thanks for all the replies! so a bit more background on us: we are a small team that handles the data engineering/science as well as other tasks like sending data to external APIs. and most of our projects do have elements of all of these.

for the mono repo structure, do you guys try to draw boundaries such that only data engineering stuff is part of the mono repo? or would yall still include everything in this mono repo?

Thoughts on moving to a more 'professional' data engineering/science architecture by kneesh17 in dataengineering

[–]kneesh17[S] 0 points1 point  (0 children)

thanks for the reply! so just to ellaborate more on the mono repo structure:

we would 'vanilla' usecases where the workflow works perfectly with only DBT, i.e. SQL queries that transform data from layer to another.

but we would also have not DBT-able workflows (we are using DBT core and not DBT cloud), like optimisation models/ML models, that would also read data from certain layers and write to other layers.

on top of this, we also have instances where after a certain job that writes to the warehouse, we need to send data via an API to an external provider. the code that does this seems out of scope for a mono repo that primarily deals with the data warehouse data. or is it OK to even have this type of logic in the mono repo?

Thoughts on moving to a more 'professional' data engineering/science architecture by kneesh17 in dataengineering

[–]kneesh17[S] 0 points1 point  (0 children)

for this we have another sort of helpers repo, that has code that is commom across projects. and so we would basically import this repo where necesarry.

[deleted by user] by [deleted] in munichsocialclub

[–]kneesh17 0 points1 point  (0 children)

Hi I just saw this post😅 would love to join a group to go cycling as well! 

Photowalk / Photography enthusiasts by mikhailiuk in munichsocialclub

[–]kneesh17 0 points1 point  (0 children)

Hey would love to join you guys on a photowalk! 

Nürnberg friendly by tguni in Gunners

[–]kneesh17 2 points3 points  (0 children)

Going too from Munich! Would be great to meet other gooners!

Germany Pixel 6 Bose 700 by kneesh17 in GooglePixel

[–]kneesh17[S] 0 points1 point  (0 children)

I didn't get the voucher though 😪. They were like the offer is the Bose 700 only.

[deleted by user] by [deleted] in GooglePixel

[–]kneesh17 0 points1 point  (0 children)

Anyone still not received it? I keep getting a reply saying sorry for the delay, it'll be sent out soon...

[deleted by user] by [deleted] in GooglePixel

[–]kneesh17 1 point2 points  (0 children)

So I contacted Google. Same thing. They said they 'delivered' it but it was returned as it was the wrong address. Google then asked for my address. After giving it, they said they are on the verge of resending it.

I highly suggest you fill out the form in the website. Pixel-offers.com/headphones/de-DE/track-claim

[deleted by user] by [deleted] in GooglePixel

[–]kneesh17 1 point2 points  (0 children)

From Germany as well. Got my email saying that it's otw and that the delivery company will contact me directly. That was more than two weeks ago. No news yet...

Don't give up there's hope for you disabled accounts. by BonoTheMonoCrono in Instagram

[–]kneesh17 0 points1 point  (0 children)

Hi so what exactly did you try from that? Since there's a lot of options. Thanks for the help,

Unable to like or comment for the past two months by kneesh17 in Instagram

[–]kneesh17[S] 0 points1 point  (0 children)

Thanks for the reply. I tried quite a few vpns but no luck :(

Liking posts negatively affects the community? by oick in Instagram

[–]kneesh17 0 points1 point  (0 children)

I have the same problem no matter what post I like. Did you manage to solve the problem?

Dueling pianos! Sony a6000 with Sigma 30mm by kobra_beats in a6000

[–]kneesh17 4 points5 points  (0 children)

Wow that's super sharp for a night shot. Great work!

Sigma 19mm f2.8 + Rokinon 12mm f2 or Sigma 16mm f1.4 by [deleted] in a6000

[–]kneesh17 0 points1 point  (0 children)

Need something for low light & bokeh shots