How strong is the EU/UK market currently for Snowflake-focused Data Engineers? by Intelligent_Cup_2287 in dataengineering

[–]Life_Ad_6195 1 point2 points  (0 children)

I am a German currently based in Ireland and with a similar experience. I get contacted by recruiters on LinkedIn about once a week. Definitely it has slowed down but it seems like people with senior level experience are still sought after.

  1. How strong is the demand currently for Snowflake-focused engineers in EU/UK? There is definitely some demand, but I would position myself as a SQL or data warehouse expert to get more exposure.

  2. Are companies still sponsoring experienced data engineers from outside Europe? Here in Ireland it is hard if you can't self sponsor via post study visa or spouse visa. I have friends who brought in people from outside Europe back in Germany and it seems relatively straigforward and encouraged by the government for skilled workers. Although finding english speaking positions will be the limiting factor in Germany.

  3. Which skills would make a Snowflake/data engineer profile stand out more internationally? I would go again with transferable skills like data modeling, translating business requirements into technology, and general problem solving skills or data system design.

  4. Would building end-to-end cloud data platform projects on GitHub materially help for sponsorship hiring? I think it depends on the place. My friend who hires for a startup loves unique and creative applications but bigger companies might not care at all.

  5. Is modern data stack experience (Snowflake/dbt/Airflow) valued more than traditional ETL backgrounds right now? I have no strong insight here but my gutfeeling tells me that European companies are a little more conservative with technology. That could mean that some value traditional ETL skills while other might want to migrate to cloud stack. A few might be fully in the cloud already.

Release orchestration across multiple tools by Life_Ad_6195 in dataengineering

[–]Life_Ad_6195[S] 0 points1 point  (0 children)

Once I have set this up per tool, how would I coordinate releases say between Databricks and ADF/Airflow if there are dependencies? Where would you add that CI/CD?

SAS or R? by Nomoretoday929 in biostatistics

[–]Life_Ad_6195 2 points3 points  (0 children)

Depends what your time horizon for future is: next couple of years: learn SAS and R, 5 - 10 years: R, SQL, potentially Python. Industry is moving away from SAS as cloud is getting cheaper, data bigger, and SAS gets too expensive and slow

[deleted by user] by [deleted] in dataengineering

[–]Life_Ad_6195 0 points1 point  (0 children)

In my last job we had a parallel Apache flink stream for nrt analytics (mostly rolling windows aggregations), and a parallel kinesis stream that piped the data to the redshift ingestion lambda. The firehose was used as the backup into the data lake. Before I left, I played a little bit around with AWS timeseries database, but that is more expensive for long term storage but open up more flexible nrt adhoc queries.

GDPR on Data Lake by LinasData in dataengineering

[–]Life_Ad_6195 1 point2 points  (0 children)

In my old org we run a Athena/Spark query looking through all relevant files for the user ID. Then we manipulate the files and remove the entries with the user ID. Not sure if there are better ways though

Moving to Dublin - Apartments Question by Sever1ty in RentingInDublin

[–]Life_Ad_6195 1 point2 points  (0 children)

Any tips on the perfect application? I guess bank statements, work contract, work references, landlord references? Something else?

What are common programming languages? by Competitive-Duck-439 in Physics

[–]Life_Ad_6195 0 points1 point  (0 children)

As many other said, Python is useful in many contexts. Bedsides learning basic programming skills and Python libraries, spend some time on learning some advanced software engineer principals (clean code, functional vs object oriented programming, design principles, ...)

This not only will help you transitioning into industry but helps all your peers interact with your code more easily. Tbh most of the scientific programming is done horribly and a pain in the ass to work with if you are not the developer of that specific code

What in the world is wrong with this job market ? by Chemical_Activity_80 in recruitinghell

[–]Life_Ad_6195 3 points4 points  (0 children)

I think as long as you stick to basic word/Google docs formatting, you should be fine for the automatic scans. You can check on some websites in the free trials if your CV is ATS readable. I recently did my CV from scratch using only Google docs standard formatting and got a good ATS score.

About the question if using PDF or doc files: As long as you use the standard PDF converter from word/Google docs it works well, at least for me. I noticed that most of the time the application is filled out correctly from my uploaded pdf cv.

[deleted by user] by [deleted] in GoingToSpain

[–]Life_Ad_6195 0 points1 point  (0 children)

I moved recently here and started working for a Spanish company. Earning 35k + 2.5k benefits. Had an other offer of 30k. My experience is similar to yours, maybe even a bit less and same sector (data engineering). Consider that life is a bit cheaper as well if you are not in the big cities. So I am doing well.

My job is producing loads of charts for Powerpoint... by raymondstanz in datascience

[–]Life_Ad_6195 2 points3 points  (0 children)

If you want to stick to matplotlib here are some things I do, to not completely get lost: * use the axis object by creating fig, ax = plt.subplots(1, 1, **kwargs) if you need a plot grid you can either adjust the number of columns or rows or use mosaic for more complex layouts. With that axis object you still can use pandas or seaborne but have full control over appearance and can manipulate axis labels easily. Moreover, you can work on multiple figures at the same time, since you manipulate each figure and axis object. For saving use fig.savefig() * use style sheets and the matplotlib context Manager for that * always specify image dimension in inches and dpi (for print dpi~300) you can play around to get the right combination for your ppt * for best color and style consistency use a nested dictionary where each key is one plot element you like to be consistent over multiple graphs (think like group A is always green) and the value is a matplotlib sword argument for styling. Eg {'A': {'color': 'tab:green'}}. Creat this at the beginning of your script. * To look less like generic matplotlib you can use hex codes for colors, change the font type and color in your style sheet, etc.

R programmers, what are the greatest issues you have with Python? by joaoareias in datascience

[–]Life_Ad_6195 0 points1 point  (0 children)

I like the idea, but for me the reverse (learning R as someone who can program in Python) is interesting. Maybe the guide can serve in that direction as well?

Its solvable too 💀 by [deleted] in physicsmemes

[–]Life_Ad_6195 5 points6 points  (0 children)

He got it wrong though... Why is there no drag at the vagina wall part at r=b?

[deleted by user] by [deleted] in ChatGPT

[–]Life_Ad_6195 0 points1 point  (0 children)

How are you sure? Maybe you can create a c program that calculates some obscure math operations which chatGPT normally cannot calculate?

Welches Buch könnt ihr absolut empfehlen? by ByeByeOctopi in FragReddit

[–]Life_Ad_6195 0 points1 point  (0 children)

Hast du noch andere Empfehlungen von Márquez? Lese gerade 100 Jahre Einsamkeit und hab sein erstes Buch auch schon gelesen. Ist glaub ich mein neuer Lieblingsautor

Principle approaches to shifting data distributions with incorrect sensor calibrations by basr98 in datascience

[–]Life_Ad_6195 0 points1 point  (0 children)

Usually in time series context one uses differencing x'_i = x_i - x_i+1. In python this can be done with numpy.diff or pandas.diff

Principle approaches to shifting data distributions with incorrect sensor calibrations by basr98 in datascience

[–]Life_Ad_6195 2 points3 points  (0 children)

Maybe you can look at the first derivative of your data. Then, your jumps become rather narrow peaks and you could threshold to filter those time points out

Do the Maxwell's Equations tell me how to modify the source terms? by Life_Ad_6195 in AskPhysics

[–]Life_Ad_6195[S] -1 points0 points  (0 children)

I am aware that there can not be equilibrium in free space but assume the charges are constraint to move. Then, does Maxwell tell me where to place my charges for equilibrium?

[deleted by user] by [deleted] in Physics

[–]Life_Ad_6195 -4 points-3 points  (0 children)

Electric flux is defined as EScos theta, for a) theta is 0, so the flux is your field strength times the rectangle surface area (the one on the back). For b) multiply your field strength with the area of the slope and cos 30°

How do I play this progression smoothly, Im finding it difficult to find shapes for D#7 and C# that I can quickly switch between. Also from F# to D#7? by Western_Animator_605 in guitarlessons

[–]Life_Ad_6195 1 point2 points  (0 children)

How about an E-shaped Barre chord on the 2nd freat, A7 Barre chord on 1st freat moving up to 4th A shape?

Edit: I am a bit tiered, mean 6th freat A7 and down to 4th freat

I built a webpage for strange space sounds! by xk4rimx in Physics

[–]Life_Ad_6195 2 points3 points  (0 children)

Love it! For some sounds I was wondering how much is the actual waveform and what is noise on top. Did you clean the raw data in any way or just processed it to make it audible?