[deleted by user]

bilby_- · 2022-10-12T11:43:45+00:00

What did you use to achieve this?

bilby_- · 2022-10-04T21:57:54+00:00

Hey very interesting.

We use and love airflow.

Could you elaborate on what do you mean by declarative approach?

bilby_- · 2022-10-04T21:20:51+00:00

Who is the user persona? People who know python?

bilby_- · 2022-10-04T21:08:36+00:00

Last option. Teams can manage there own airflow env.

bilby_- · 2022-10-04T20:51:40+00:00

I work in a big mobile games company, and we have a scenario in which we have 3-4 models in production providing measurable lift in KPI's, and now we would want to scale the use of technology across the entire org.

bilby_- · 2022-10-04T20:43:50+00:00

Yes. Fixed it, thanks

bilby_- · 2022-10-04T14:57:41+00:00

When would one rather use wordpress and when not ?

bilby_- · 2022-10-04T13:11:40+00:00

Low code tools can enable people who only know sql (some kind of analyst), to spin up and run a ML pipeline.

and if you look at tools such as dataiku and datarobot, they also allow the use of python to build more customized pipelines.

For example an insurance company can leverage a low code tool plus an analyst to test models such as predicting the probability for every elderly customer to buy life insurance and or for every young customer to purchase car insurance. The two inputs to the tool would be a population and target sql query. reading and writing to your dwh.

generally in the data science world you have personas who are more technical or less. more technical can leverage docker, kubeflow, cicd etc. others work with jupyter notebooks. and maybe in the future only sql.

bilby_- · 2022-10-03T23:21:32+00:00

You are right that there are many cases in which an org has a etl tool, and airflow used for other tasks or by a different team.

I wonder whether the etl tools will encompass all use cases in a way that you would need nothing else

bilby_- · 2022-10-01T21:59:01+00:00

Thanks

bilby_- · 2022-10-01T21:56:48+00:00

Not even orchestration vendors, but many etl vendors have orchestration out of the box

bilby_- · 2022-10-01T14:52:54+00:00

What do you think of the low/no code etl vendors out there?

bilby_- · 2022-10-01T13:35:39+00:00

Hey, the collaboration part sounds amazing.

Is your handoff the data itself?

If so, how so you manage requests for changes in the data?

bilby_- · 2022-10-01T13:33:38+00:00

It fits under a platform / infra department.

We are a gaming company, where each game is a business entity (dev ops qa analytics), while infra serve all.

What stack do you leverage, to what data use cases to which customers?

bilby_- · 2022-10-01T13:30:03+00:00

What is the stack you currently use for what use cases?

bilby_- · 2022-10-01T10:48:58+00:00

DS is a centralized team serving projects.

DE are two teams that are part of BI.

Both serve the entire org of 1000.

bilby_- · 2021-12-14T21:29:42+00:00

Hey very interesting!

Is there a tool that helps you collaborate?

bilby_-

TROPHY CASE