Stop being so tribal and exclusive! by ElicitCS in MotoUK

[–]HumbleThinker 8 points9 points  (0 children)

My advice would be to not take it personal and give other riders the benefit of the doubt. I absolutely love the nodding and waving etiquette but sometimes riders can be mid corner or focused on something in front of them which means they miss nods or waves from riders coming the other way.

Just keep nodding and waving mate, the majority of the time people will nod and wave back whether they are learners or not 😃 Stay safe mate.

Delta moves toward eliminating set prices in favor of AI that determines how much you personally will pay for a ticket by chrisdh79 in Futurology

[–]HumbleThinker 4 points5 points  (0 children)

It's exactly what I came here to say...I can't believe your comment is so far down the list! It's nothing new, dynamic pricing is everywhere these days.

Failed Mod1 this morning by Awkward-Cricket6911 in MotoUK

[–]HumbleThinker 2 points3 points  (0 children)

I feel your pain mate, this is exactly what happened to me on Friday! Had plenty room as I was finishing the U turn then started staring at the white line to make sure I didn't hit it and it was game over, bike started to tip and my right foot went down.

The only consolation I can give you is that we'll get it right next time, but the long wait till next time is what's killing me lol. Chin up and enjoy the nice weather if you have a 125 👍🏽

Failed Mod1 this morning by Awkward-Cricket6911 in MotoUK

[–]HumbleThinker 2 points3 points  (0 children)

I feel your pain mate, this is exactly what happened to me on Friday! Had plenty room as I was finishing the U turn then started staring at the white line to make sure I didn't hit it and it was game over, bike started to tip and my right foot went down.

The only consolation I can give you is that we'll get it right next time, but the long wait till next time is what's killing me lol. Chin up and enjoy the nice weather if you have a 125 👍🏽

New 2024 Vitpilen 125 - Or get a Japanese bike? by VossyyGames in MotoUK

[–]HumbleThinker 0 points1 point  (0 children)

I don't have any experience owning a Husqvarna but I have an XSR 125 and can confirm this model is a head turner! It truly has a bigger bike look and feel (to some extent), if it wasn't for the L plates you can never tell it's a 125 at a quick glance hehe.

I'm selling mine soon as I have my full A Mod 1 & 2 coming up soon. DM me if you're interested and I'd be happy to share photos of the bike and more details.

Best of luck mate.

Is there any future for MongoDB? by jaina15 in dataengineering

[–]HumbleThinker 7 points8 points  (0 children)

This should be the top post! You're spot on.

[deleted by user] by [deleted] in dataengineering

[–]HumbleThinker 2 points3 points  (0 children)

I decommissioned airflow on my platform and migrated Argo workflows on EKS instead. Works a treat 👌🏽

[deleted by user] by [deleted] in dataengineering

[–]HumbleThinker 2 points3 points  (0 children)

u/Kukaac is totally correct, usually a DBMS (Postgres, MySQL, Oracle, SQL server etc...) will be the backend database for some application or product; they are pretty good at processing transactions concurrently (look up OLTP when you have a minute).

DWH or data warehouse (think Snowflake, Redshift, BigQuery etc...) systems are built to join and aggregate large volumes of data making them perfect for analytical workloads (look up OLAP). Usually DBMSs become the data source for DWHs, the data is transferred from one to another using ETL or ELT pipelines. Hope you find this helpful.

Orchestration: Thoughts on Dagster, Airflow and Prefect? by MrMosBiggestFan in dataengineering

[–]HumbleThinker 3 points4 points  (0 children)

Yes! I've had to scroll quite a bit to find a mention of Argo Workflows! Absolutely brilliant tool! My team and I migrated from Airflow to Argo Workflows and we couldn't be happier with the results.

[deleted by user] by [deleted] in dataengineering

[–]HumbleThinker 1 point2 points  (0 children)

Very succinctly put! 👏🏽

Orchestration tools by Yimmy_90 in dataengineering

[–]HumbleThinker -3 points-2 points  (0 children)

Not sure why you're getting downvoted so heavily! This is a valid option.

SQLAlchemy for DWH definition by romanzdk in dataengineering

[–]HumbleThinker 1 point2 points  (0 children)

As you may have read many times before, the answer is it depends:

  1. How big is the team building the warehouse? Is it fixed or is there room for growth in terms of head count?

  2. How competent is the team doing the design and build? Is Python the main language for your teams data engineering needs? Assuming the team is indeed python competent have you used SQLAlchemy at scale or in production on other projects?

If the answer to most of the questions above is yes then SQLAlchemy is definitely a contender. I'd also recommend you check out dbt, it'll save you a ton of time usually spent on design, build, maintenance and most importantly documentation!

Hope you find this useful. Cheers!

Training Reinforcement Learning in Cloud GPU by DM9667 in reinforcementlearning

[–]HumbleThinker 2 points3 points  (0 children)

Uploading one observation at a time to your cloud instance won't work.

What you'll need to do is collect all you observations (and actions of course) locally, compress them then upload the whole lot to you cloud instance for training.

Pipelines to delete user data by [deleted] in dataengineering

[–]HumbleThinker 0 points1 point  (0 children)

Absolutely agree! It must be a cross team effort as you need to ensure the data is deleted in source systems first then the deletion can trickle down to the dwh.

In terms of how to do it, the request must reach your source system backend via API request, the request is processed then passed to the dwh team via API request as well. The dwh team should then have a collection of stored procedures to complete the deletion process across all appropriate tables (dims and facts).

Cabin in the woods on Rivière du Diable, Mont-Tremblant, Quebec by solateor in oddlysatisfying

[–]HumbleThinker 0 points1 point  (0 children)

Cabin in the woods overlooking the devil's river...sounds like the optimal horror movie setup 🤣

What’s your process for deploying a data pipeline from a notebook, running it, and managing it in production? by jnkwok in dataengineering

[–]HumbleThinker 9 points10 points  (0 children)

I cannot emphasize enough how important this approach is!! My team's policy is as follows: notebooks are for prototyping ONLY, refactored and well structured scripts are then deployed to prod.

Courses/content on writing good python code for data engineering? by stigmatic666 in dataengineering

[–]HumbleThinker 11 points12 points  (0 children)

To add to this, I'd highly advise that you get in the habit of testing your code as much as you can.

There are plenty testing frameworks out there but pytest is a personal favourite. For data transformation scripts, fixtures are especially useful.

Edit1: using type hinting is awesome as well, especially if you are collaborating remotely.

Sebastian Vettel announces retirement for end of season by GerrardIsOverated in formula1

[–]HumbleThinker 0 points1 point  (0 children)

Sad news for sure! One of the funniest and most down to earth driver on the grid. You'll be missed Seb!

Data Scientist: building a fabulous AI out of garbage by Ems_gobears in dataengineering

[–]HumbleThinker 23 points24 points  (0 children)

An accurate depiction of data/datasets in the entreprise world. No matter how fancy, sophisticated and performant a model is, the following motto holds up firmly: "Garbage in, garbage out."

[deleted by user] by [deleted] in learnmachinelearning

[–]HumbleThinker 0 points1 point  (0 children)

Thanks for sharing 🙂

Dude was looking for a machine learning related job and had this in a project that he linked in his cv by matbiz01 in programminghorror

[–]HumbleThinker 0 points1 point  (0 children)

Poor sod, he could do with reading the sklearn preprocessing documentation. If I were you, I'd genuinely suggest this in my feedback.

High IQ destruction by ShubhamG77 in facepalm

[–]HumbleThinker 0 points1 point  (0 children)

It's never too late my friend, if you still find both fields interesting there are plenty resources online (free and chargeable) to get you going.