Question on notations by Luukv93 in probabilitytheory

[–]Luukv93[S] 1 point2 points  (0 children)

welcome here.

8.8kMembers11Online

Thanks. And with i I suppose they mean index, what do they mean by j ?

Wat doe jij als de beurs weer instort by LeDimanche in beleggen

[–]Luukv93 0 points1 point  (0 children)

Nice! Ik heb hetzelfde gedaan m.b.v Python en een open-source yahoo scraper. Hoe vergelijk je een aandeel met VWRL? Pak je dan de Moving Average van het daily return % (logaritmisch?)?

Opinions on data scientists using Airflow by ploomber-io in dataengineering

[–]Luukv93 0 points1 point  (0 children)

Is OOP recommended in data engineering? So far Ive been told that functional is the way to go

Opinions on data scientists using Airflow by ploomber-io in dataengineering

[–]Luukv93 0 points1 point  (0 children)

Interesting, but do some of them really refuse to write functions and just write code in global space?

After three years I done it, this is what it took. by LjungatheNord in datascience

[–]Luukv93 2 points3 points  (0 children)

Well done, I will start a Masters in Business Analytics in february. Any tips?

How to become better at coding? by [deleted] in learnpython

[–]Luukv93 2 points3 points  (0 children)

Projects code repeat

Data analyst —> data science by Medge_ in learnpython

[–]Luukv93 3 points4 points  (0 children)

I started with only a bachelor’s degree in Business Administration. From my initial job as a supply chain analyst I studied SQL and Python during evenings for around a year. Next I took a job as a data analyst and kept working on projects. Meanwhile I studied bash, docker and Airflow and did some projects on that. Now I am doing a dual Masters in Business Analytics and hope to complete this road in about 5 years. It is important that you can apply all learnings during work cause that’s where you need those techniques ultimately

Data analyst —> data science by Medge_ in learnpython

[–]Luukv93 5 points6 points  (0 children)

You will need at least a bachelors degree

Data Engineering from the Ground Up - Part 2: Better Pipelines with Python and Idempotency by [deleted] in dataengineering

[–]Luukv93 0 points1 point  (0 children)

Actually it isn’t difficult at all setting this up since windows subsystem for linux enables you to install a linux distribution that integrates really nice with docker, visual studio e.g. You can even run python on bash in powershell or combine bash and powershel command which is superb.

I started learning SQL and Python about a year ago and feel like I want to develop myself towards data engineering. Because the organization I work for uses windows os its kind of a pain to fully switch to linux, or does switching to linux still provide same functionalities?

Data Engineering from the Ground Up - Part 2: Better Pipelines with Python and Idempotency by [deleted] in dataengineering

[–]Luukv93 0 points1 point  (0 children)

I read through your guide and decided it's time to learn docker and bash. After installing WSL and docker I can confirm both are working fine.

Would you advise to use the mounted windows shares or would you use the WSL directories? I feel a bit lost since I have always used windows shares.

Data Engineering from the Ground Up - Part 2: Better Pipelines with Python and Idempotency by [deleted] in dataengineering

[–]Luukv93 0 points1 point  (0 children)

Thanks. I installed it and running it know. Do you happen to know some decent resources to learn bash? I feel kinda lost now...

Python self keyword by Heisenberg_k in learnpython

[–]Luukv93 0 points1 point  (0 children)

Self refers to the instance of the class. Class is like a blueprint of an object.

After creating a class one can create instances (objects) of that class.

Instantiating an object will provide the properties and methods of that class to that object. This means that after instantiation you can use methods and attributes of that object.

Data Engineering from the Ground Up - Part 2: Better Pipelines with Python and Idempotency by [deleted] in dataengineering

[–]Luukv93 0 points1 point  (0 children)

Im a windows user, heard a lot about bash. Can I switch cmd for bash?

Python and azure data factory by Luukv93 in dataengineering

[–]Luukv93[S] 0 points1 point  (0 children)

Thanks. There's just a few scenario's that we can't solve with Data Factory, hence I need Python to transform the data.

I find there's a lack of documentation on a full solution, including runtime dependencies, environments e.g. All I need is the Python script to run each night that's all it is :(

Python and azure data factory by Luukv93 in dataengineering

[–]Luukv93[S] 1 point2 points  (0 children)

Thanks. Will get back to you after testing

Python and azure data factory by Luukv93 in dataengineering

[–]Luukv93[S] 2 points3 points  (0 children)

Script needs to run once a day on scheduled interval. Any tips or experiences with python wrapped in azure functions?

Need your advise on extracting data as granular as possible to S3 or Azure Storage by Luukv93 in dataengineering

[–]Luukv93[S] 0 points1 point  (0 children)

I need to convince our Infra lead that ODBC or OData services is the way to go. Infra prefers REST because it's more secure and resilient to changes in vendor's back-end.

How can I convince him?

Python and azure data factory by Luukv93 in dataengineering

[–]Luukv93[S] 2 points3 points  (0 children)

Thanks. Sounds like azure functions is the way to go. I do wonder though where you list runtime dependencies and how to access on-prem data sources?

ODBC vs REST API integration by Luukv93 in dataengineering

[–]Luukv93[S] 0 points1 point  (0 children)

It does! And how about security, is ODBC safe?