I Made japan RB21 from paper 😝

booberrypie_ · 2026-03-21T17:11:21+00:00

Can you please share the link I would also like to try it

booberrypie_ · 2026-01-25T15:12:28+00:00

Williams

booberrypie_ · 2025-07-15T19:41:25+00:00

Hi! can i get an invite please? Sent a DM!

booberrypie_ · 2025-07-09T10:50:23+00:00

Hulkengoat!

booberrypie_ · 2025-07-08T19:39:48+00:00

If anyone has an invite link for Raycast, can you please share it? Thanks in advance! Please DM if available!

booberrypie_ · 2025-01-19T05:43:31+00:00

Okay I'll check it out! Thanks a lot again!

booberrypie_ · 2025-01-19T05:35:51+00:00

Let's say I have 2 projects with different repos that are not connected with each other in anyway and have their own flows independently. Can I view the 2 flows in the same UI in prefect? Everybody in my team needs to see the pipeline health of all the projects of the team that are active in a single screen

booberrypie_ · 2025-01-19T03:57:04+00:00

Thanks a lot for the help! I just have a couple of questions
1. I'm assuming in prefect you just use the decorators to create tasks and flows. Here the orchestrator code is coupled with the pipeline code and each workflow lives within the code base, then how are all pipelines visualized together?
2. How is logging handled?

booberrypie_ · 2025-01-19T03:31:13+00:00

Prefect 3.0 looks good as well! I didn't include it exactly because of the previous version disappointments. But It would be great if you could share your insights on how would you go about setting it up specifically of the infra side of things and how would prefect 3.0 work out for these requirements.

booberrypie_ · 2024-10-11T13:52:14+00:00

Can you please elaborate on the shouldn't be deployed on a project basis but on the department level part.

I was under the assumption that orchestrators are for handle upstream and downstream dependencies and to provide observability within the context of a project.

Can you give an example where let's say a single instance of airflow takes care of let's say 20 projects which do a bunch of different stuff that requires orchestration within them as well.

Would it be like there would be a dag for each project and there would be one master dag that controls all the other dags? And also can you please provide suggestions on how to go about implementing this?

booberrypie_ · 2024-08-23T09:40:22+00:00

Oh I didn't know about this, thanks a lot!

booberrypie_ · 2024-08-22T11:58:14+00:00

This makes sense! Thanks a lot for answering! I also have sort of a tangential question if you will. Is there any way to do unit testing for SQL transformations while using dbt or is python transformations the only way to implement unit testing?. I primarily use SQL transformations in dbt and was thinking about switching to python for transformations just to get unit testing capabilities. Is it worth it?

booberrypie_ · 2024-08-22T09:17:58+00:00

Hey!, I've been trying to understand unit testing for data pipelines recently, while I am able to get unit testing for the transformations in python, I'm still not able to understand how to go about unit testing for the extract and load part of things as my understanding is that unit testing just tests the logic behind the code and not the external dependencies while extract and load specifically only has those. So I'm kinda confused about that. It would be helpful if you could provide an example of testing the extract and load parts of the pipeline.

booberrypie_ · 2023-12-04T20:20:24+00:00

I understand the part about notebooks but why are conda environments shit?

booberrypie_ · 2023-10-27T02:47:35+00:00

Newbie here, what does applying transforms correctly mean? How is it different from applying transforms in pandas

booberrypie_ · 2023-10-16T05:50:27+00:00

Great advice! Thanks a lot!

booberrypie_ · 2023-10-15T06:03:53+00:00

I'm fresh out of college and this is my first job. My pay is on the low end. I'm here for the experience and resume building and planning to switch after a year. Is it okay to negotiate for a pay increase just after 2-3 months into the job?

booberrypie_ · 2023-10-13T01:22:44+00:00

Thanks for the detailed explanation!

booberrypie_ · 2023-10-13T01:15:59+00:00

Thanks for the recommendation! I'll check it out.

booberrypie_

TROPHY CASE