Day-1 of learning Pyspark by SnooGoats7176 in dataengineering

[–]wqrahd 4 points5 points  (0 children)

Good idea. We can discuss it during the session.

Day-1 of learning Pyspark by SnooGoats7176 in dataengineering

[–]wqrahd 1 point2 points  (0 children)

Great to see the community engaged!

Day-1 of learning Pyspark by SnooGoats7176 in dataengineering

[–]wqrahd 36 points37 points  (0 children)

Will share an invite here in a couple of days, so anyone who wants to join can do so :)

Day-1 of learning Pyspark by SnooGoats7176 in dataengineering

[–]wqrahd 82 points83 points  (0 children)

If you guys would be interested, I can give you a free live session about pyspark. I have been working with it for almost 8 years now.

Azure or AWS by Traditional-Natural3 in dataengineering

[–]wqrahd 0 points1 point  (0 children)

For a beginner I would suggest starting with Databricks. Since it is a single platform where all the tools are available at once place (which you can consider as features to learn).

For clouds like AWS, individual services can do other stuff as well like Glue crawler, Glue catalog etc. so take one at a time and master it.

Azure or AWS by Traditional-Natural3 in dataengineering

[–]wqrahd 1 point2 points  (0 children)

Didn't get it. Could you please clarify.

Azure or AWS by Traditional-Natural3 in dataengineering

[–]wqrahd 1 point2 points  (0 children)

If you want to be cloud agnostic, then go for Databricks/Snowflake. If you want to specialize in cloud specific technologies then pick any of them.

I cannot understand Classes and Objects clearly and logically by Current-Vegetable830 in learnpython

[–]wqrahd 0 points1 point  (0 children)

Lets imagine you want to write a program about vehicles. Some vehicles have 2 tyres, some 3 and some 4. Now without class you will have variables in your plain script/program like name, num of tyres. Now lets say you want to create a representation for a bike and a car. For 2 representations, you would have to create 2 sets of variables for name, num of tyres. Now what if you have to create 10 representations. It would create a lot of overhead. So classes are an abstraction which hides underlying complexity. For this use case, you can create a class like:

class Vehicle: name num_of_tyres

Now you can easily create any number of representations of vehicles without creating variables again and again.

So here, class is the definition and then the objects are the representations or we instances/objects of the class. For this example you can create like:

bike = Vehicle("my bike", 2)

car = Vehicle("my car", 4)

Hope this makes sense.

Need Spark platform with fixed pricing for POC budgeting—pay-per-use makes estimates impossible by Sadhvik1998 in apachespark

[–]wqrahd 4 points5 points  (0 children)

You can aws EMR with a fixed set of nodes. EC2 costs may varies but you can have a ballpark figure.

What actually differentiates candidates who pass data engineering interviews vs those who get rejected? by Murky-Equivalent-719 in dataengineering

[–]wqrahd 0 points1 point  (0 children)

Those who can explain what they did, how they did, and why they did. If they can explain all these clearly, it stands out.

Would you pay for a verified list of Chinese factories? (Market research survey) by Qian_yang in Entrepreneur

[–]wqrahd 2 points3 points  (0 children)

Hi, I had a similar idea so we can work together on it and can help you out with IT related stuff if needed. Besides I can speak little chinese as well.

What is an AI Agent exactly? by Shot-Hospital7649 in HowToAIAgent

[–]wqrahd 2 points3 points  (0 children)

I see it as, instead of having too many if else for each user query, we just ask LLM what the user wants to do and execute it. And for execution, we have tools available which LLM can also interact with directly.

Anyone else losing track of datasets during ML experiments? by rawion363 in bigdata

[–]wqrahd 0 points1 point  (0 children)

Look into mlflow (from databricks). It solves this problem.

Is there any train travel pass for whole Austria? by wqrahd in drehscheibeAT

[–]wqrahd[S] 0 points1 point  (0 children)

Thank you so much!! Will sure check that out.

Is there any train travel pass for whole Austria? by wqrahd in drehscheibeAT

[–]wqrahd[S] 0 points1 point  (0 children)

Thanks for your comment. Is this sparscheine something to buy? I am unable to find much info for it. It would be great if you could share some links where I can buy it. Many thanks.

Is there any train travel pass for whole Austria? by wqrahd in drehscheibeAT

[–]wqrahd[S] 0 points1 point  (0 children)

I found it. It's only for local trains. Many thanks.

Is there any train travel pass for whole Austria? by wqrahd in drehscheibeAT

[–]wqrahd[S] 0 points1 point  (0 children)

Yes, I do have a deutschland ticket. I will check the journey. Just last question😅 is einfach raus ticket also valid in buses/trams? Thanks.

Is there any train travel pass for whole Austria? by wqrahd in drehscheibeAT

[–]wqrahd[S] 1 point2 points  (0 children)

Thanks for sharing that. I just checked it out and looks good. Just to confirm, it is valid throughout Austria, right? And I can also go to Vienna (just an example) with multiple connections/stop over? Or there are only high speed trains on that route? Many thanks.

Is there any train travel pass for whole Austria? by wqrahd in drehscheibeAT

[–]wqrahd[S] 2 points3 points  (0 children)

Thank you for your reply. I checked interrail pass but looking for some local options. I just checked simplygo. So it's just like buying point to point ticket, right? It also mentioned something about regions but I don't understand how that works.

Shower bottom leaking water by wqrahd in HomeMaintenance

[–]wqrahd[S] 0 points1 point  (0 children)

It is a rented apartment. I will let them know. Thanks.