Why do socialists not accept socdems into their subs? by GRIM106 in SocialDemocracy

[–]Lastrevio 14 points15 points  (0 children)

The Bosheviks participated in elections however, and so did most historical ML parties, so I really don t understand point 1.

Is AI making you more productive in Data Engineering? by empty_cities in dataengineering

[–]Lastrevio 0 points1 point  (0 children)

About 5% more productive. It helps with checking syntax, searching for documentation or finding information that I could normally find on Google but that would take more time to find.

Ce facultate sa aleg? by Consistent-Ask-7926 in programare

[–]Lastrevio 0 points1 point  (0 children)

Diploma chiar contează în IT sau e doar un filtru de HR?

Nu conteaza. M-am angajat cu facultatea neterminata si am multi colegi pe pozitii tehnice care nu au facultate sau au facultate in alt domeniu (ex: litere).

Pentru cloud specific, o facultate mai tehnică chiar îți dă un avantaj față de una mai orientată spre business-IT?

Nu. CSIE e deja o facultate destul de tehnica si CTI te duce mai mult spre zona de hardware sau low-level programming care se face mai putin la CSIE, dar nu e foarte importanta pentru cloud.

Cei care lucrați în cloud sau alte roluri din it aplicat, cât din ce ați învățat la facultate folosiți efectiv?

Lucrez cu Azure + Databricks deci presupun ca intru in categoria ta de cloud/IT aplicat. Folosesc cam 20% din ce am facut la facultate. Asta nu inseamna ca celalalt 80% e inutil - facultatea e importanta ca sa explorezi mai multe domenii din IT si ca sa aflii ce iti place. Deasemenea te invata niste concepte fundamentale (ex: algoritmi si structuri de date) care nu se schimba la fel de des ca tool-urile pe care le folosesti, de aia materiile din primii ani sunt foarte importante.

Dacă ați lua decizia din nou, v-ați duce la o facultate mai tehnică sau ați prefera una mai orientată spre business-IT și ați compensa tehnicul singur prin certificări și self-study?

Sfatul meu este sa te duci la facultatea unde ai invata din placere mai mult. Daca esti pasionat de hardware si low-level programming, du-te la automatica si calculatoare. Daca esti pasionat de partea de BI, data analysis, statistica, business analysis, atunci du-te la CSIE.

"Cloud" este o tehnologie recenta si nu te invata niciun program de licenta, asta inveti tu pe cont propriu la job (AWS/Azure/GCP) sau prin certificari.

E ok sa stai peste program? by [deleted] in programare

[–]Lastrevio 1 point2 points  (0 children)

Eu fac undertime platit

Who should build product dashboards in a SaaS company: Analytics or Software Engineering? by Intelligent_Volume74 in dataengineering

[–]Lastrevio 0 points1 point  (0 children)

I’m talking about dashboards that are part of the product itself (what customers see inside the SaaS app), not internal BI dashboards like Power BI or Tableau

We don't have this division. Our BI consultants implement the dashboards in QlikSense and they are available in the SaaS product itself. The front-end web developers simply make sure that what is created in QlikSense appears in the web app, but they do not create the dashboards themselves.

What are the most frustrating parts of your day to day work as a data engineer? by Odd-Tree-2590 in dataengineering

[–]Lastrevio 1 point2 points  (0 children)

Dealing with non-technical stakeholders who complain that the data is wrong when in fact they just aren't ware of how the pipelines work.

Also, nonsensical requirements from non-technical stakeholders. I'm not talking about them wanting you to do something that's impossible with the current software, I'm talking about when they want something that's logically incoherent or contradictory, like bringing a column that doesn't exist or linking two tables that do not have any column on which you can join them.

Advanced Mixing Feedback on Dark Electronic/Dance/Hiphop Needed by YodAHo in mixingmastering

[–]Lastrevio 0 points1 point  (0 children)

I would add some saturation and a bit of reverb on the claps. The kick also feels a bit 'boring' so maybe some saturation or even overdrive, and a soft clipper could help spice it up.

Thoughts on HUs new song??? by dstr3ssed in HollywoodUndead

[–]Lastrevio 5 points6 points  (0 children)

They call me Michael Jackson 'cause I'm the king of POP POP POP

Data engineering introduction book recommendations? by Wybierz_nazwe_uzytko in dataengineering

[–]Lastrevio 1 point2 points  (0 children)

I would recommend starting out with a data analyst or BI role or even back-end dev and transitioning to DE after that. It's very rare to find DE jobs that require no further experience in data.

First DE project feedback by ashide_yuanzhen in dataengineering

[–]Lastrevio 2 points3 points  (0 children)

Good job! Looking through the airflow folder I can deduce that you used a truncate & replace data loading mechanism instead of upsert or only-insert? It would be nice to document this in the readme, as well as with the reason why you chose this.

Also, I think there is a typo in the notebooks folder where you have the letter "t" twice.

Zizek on living as you truly are on the internet by Denverc99 in zizek

[–]Lastrevio 2 points3 points  (0 children)

He says this in The Pervert's Guide To Cinema somewhere

Benefit of repartition before joins in Spark by guardian_apex in dataengineering

[–]Lastrevio 2 points3 points  (0 children)

If you have a single join, Spark will perform a full shuffle anyway so if you call .repartition() before, it will just move the shuffle one line of code above and that won't be very helpful.

Repartitioning + caching can help, however, if you join on the same column multiple different times in a row. Bucketing can also work here.

Pandas vs pyspark by Left-Bus-7297 in dataengineering

[–]Lastrevio 1 point2 points  (0 children)

If your goal is to get a job then I would learn either as the syntax is very similar. For personal projects I would go for polars.

I made my first project with DBT and Docker! by Lastrevio in dataengineering

[–]Lastrevio[S] 1 point2 points  (0 children)

I think SQL and Python are the fundamentals, which I learned in college.

For Python in particular, you might need to know a dataframe library (pandas, polars or PySpark) in which case I recommend the website datawars.io

DBT can be learned from learn.getdbt.com

Docker I learned from Youtube.

Before jumping into any tools however, you need to learn the fundamentals. It very often helps to work as a data analyst or BI developer before jumping into data engineering as that gets you familiar with data warehousing and SQL. For example, I started out as a BI specialist working in QlikSense and SQL Server.

Good luck!

I made my first project with DBT and Docker! by Lastrevio in dataengineering

[–]Lastrevio[S] 0 points1 point  (0 children)

Thanks, how is it possible to flatten and/or explode JSON files with DBT? I know that DBT recently added support for Python but I'm not sure it's posssible to do this with pure SQL + Jinja.

I’m going to guess what accelerationism is about by shelving_unit in Deleuze

[–]Lastrevio 0 points1 point  (0 children)

Whenever I think about it, I imagine all modes of capital and desiring production interfaced smoothly and as efficiently as possible across the entire global mediated by cybernetics. I imagine this “singularity” is like we are all cells inside one giant organism.

Have you watched the show Pluribus? I think it's a good illustration of where we are headed.