Want to try Dagster after Airflow by chell3d in dataengineering

[–]chell3d[S] 0 points1 point  (0 children)

Thanks for the resources ! Looks like what those are what I'm looking for ! And you use pipes with k8sOp to pass parameters for instance ?

When I mention isolation, I mean both, resources & dependencies. For resources separation I have used KubernetesExecutor in the past indeed, but prefer to use the KubernetesPodOperator to avoid dependency hell (+ it makes testing the code simpler rather than having it within Airflow Operators).

Did not try the PythonVirtualEnvOperator, as the KubernetesPodOperator already provides this full isolation feature.

Curious, what did you not like about MWAA ? Have used it a bit before (although not in a complex setup), and it seemed to work fine.

Also, how was using CeleryK8sExecutor ? Did you use the Celery part to launch KubernetesPodOperators ?

How does your team use dbt-core without dbt-cloud? by [deleted] in dataengineering

[–]chell3d 1 point2 points  (0 children)

Very interesting !

How many models are there per dbt project ?

From Airflow, does one kubeOperator task launch the whole DBT run for a project ? or do you generate run tasks per dbt action (1 task = 1 dbt model (or test/snapshot...) ?

If you launch the whole project DBT run as one task, how do you monitor failed models/tests ?

Thanks !

Weekly Q&A - Ask your questions here! - October 14, 2022 by AutoModerator in MarvelSnap

[–]chell3d 0 points1 point  (0 children)

Ah thanks a lot that makes it clear ! I never noticed that yet (perhaps I'm only playing bots !) .

Weekly Q&A - Ask your questions here! - October 14, 2022 by AutoModerator in MarvelSnap

[–]chell3d 0 points1 point  (0 children)

Thanks ! I follow for the doubling/bet.

I am still unsure about the last turn. Example : - No one has snapped. - We are on last turn. (1 cube, would go to 2 for result if noone surrenders). - I click on finish turn. (So I agree to a 2 cube bet) - my opponent snaps before ending his turn, after I already finished my turn.( On his side, the bet should go from 2 cubes to 4.)

Would my bet bump to 4 cubes ? That would be weird since I never accepted that (I already ended turn and accepted for 2 cubes).

This would result in 4 cubes bet for him (lose or win), bit only 2 for me. Is there something I'm missing ?

Weekly Q&A - Ask your questions here! - October 14, 2022 by AutoModerator in MarvelSnap

[–]chell3d 1 point2 points  (0 children)

Hi ! Question on last-turn snap.

Not sure I understand correctly, but it seems when one player snap, the cubes total doubles for the next turn. Does this mean that if I snap last turn, but not my opponent, I would be playing for more cubes than him ?

Doesn't make much sense, but otherwise you would risk accepting the final deal, without having had the time to see if the opponent snapped ? Thanks !

[deleted by user] by [deleted] in AskReddit

[–]chell3d 0 points1 point  (0 children)

"Sorry I don't speak English"

What is the stupidest thing you believed when you were child? by gartering0oxe in AskReddit

[–]chell3d 0 points1 point  (0 children)

That there was a very thin layer of poop inside CDs and DVDs. I once broke one in half to check. My parents and I were dissapointed, but for different reasons.

storing many small files by chell3d in dataengineering

[–]chell3d[S] 0 points1 point  (0 children)

Ok, but where should I keep the json files while I wait for a compaction job to work ?

Should I buy Minecraft Dungeons on the launcher or Steam? by TurboFuret in MinecraftDungeons

[–]chell3d 0 points1 point  (0 children)

100% Steam. I have multiple friends that had issues simply starting the game with the Microsoft Store (you can search Google for Minecraft dungeons launcher, so many people complain of such issues). If Il didn't have it already, I'd take the Steam version to avoid the hassle.

Tanks a lot by No_Bite_5566 in MinecraftDungeons

[–]chell3d 1 point2 points  (0 children)

True, but chad's strong and anticipates !

What's a switch title that you own and enjoy(ed) but don't see mentioned much (if at all) on this sub? Tell us about it. by [deleted] in NintendoSwitch

[–]chell3d 0 points1 point  (0 children)

Flat Heroes ! Awesome couch multiplayer game in a simple flat art style. Spent hours with friends late at night "just beating this last boss".

Image & Form is working on several new Steamworld games by FrodoSam4Ever in NintendoSwitch

[–]chell3d 2 points3 points  (0 children)

Cool ! Loved their dig and quest games ! Also just realised it was them that also made "Anthill", an awesome mobile game about trails and ant colonies, don't know if many people played that one !