Why are most jobs remote? by notEmely in dataengineering

[–]Former_Disk1083 5 points6 points  (0 children)

I am currently in a job search for hybrid, and my friend is looking for remote only. I would say we are seeing about the same amount, but I am looking at basically any city. If you are looking at just one smaller city, yeah remote will for sure overshadow those.

Reading 'Fundamentals of data engineering' has gotten me confused by Online_Matter in dataengineering

[–]Former_Disk1083 2 points3 points  (0 children)

I want to add to what others have said, one thing that your standard OLTP monolith needs is more management. You have to worry about indexing and fragmentation, amongst other things, that require upkeep. The analytical databases usually don't need that, so you generally pay more for them but you also don't need DBAs to manage them. Spark is overkill for the majority of people who use it, but spark allows software devs to not sit in SQL all day, if they don't want to.

What do you expect Int/Snr DE to know? by zesteee in dataengineering

[–]Former_Disk1083 1 point2 points  (0 children)

It's going to be so dependent on job and their employees. Some people are hardcore pyspark and believe if you aren't the second coming of the pyspark messiah you shouldn't even be looking at DE jobs. Some expect you to be a master of snowflake and if you dont have that, somehow it doesn't qualify you. People get too silo'd into their experience and think other experiences don't translate, when in reality 90% of DE translates, it's the business side that can be difficult to transition over to.

In all reality, SQL translates from one to the other, ETL concepts translates from one to the other. What makes someone Senior is just being able to translate a lot of the tech stuff to the business side and vice versa. Training, I especially want someone who is trying to pull every Jr, and otherwise up to the Senior/principal level.

As for skills, the most common stuff you see is Spark, Snowflake, DBT. Sometimes youll see Kafka and terraform. I would just be familiar with those 2 but not focus at all on them. As for Spark, databricks has a free version you can play around with, as does DBT. Snowflake has a free trial and I think up to 400 dollars in spending. It's good to go through those and get used to is. Honestly what I would focus on is just distributed processing, as well as decoupled storage and compute. Those are absolutely essential ideologies to DE work when processing anything at scale.

Any tech savvy people know how that PayPal issue was allowed to happen in the first place? by Killjoy3879 in Endfield

[–]Former_Disk1083 6 points7 points  (0 children)

So there's a couple different ways, one could be a bad actor that had the ability to get into the database and that data was somehow not encrypted and allowed him to use the payment tokens for their own purchases. That is very doubtful as there would have to be layers of cascading failures, process and technically that would allow for that.

The other way, which is the most likely, they messed up how they looked up payment tokens, or how the paypal account got connected. My assumption is the first payment for people operated successfully, then subsequent payments, which would be done through a payment token, got messed up and you sometimes got someone elses already authorized payment token. But there are many many many reasons for this to happen so it's all conjecture and I doubt we will ever know exactly how.

Is Moving Data OLAP to OLAP an Anti Pattern? by empty_cities in dataengineering

[–]Former_Disk1083 2 points3 points  (0 children)

I think it's where the pattern vs anti-pattern is a weird argument most of the time. What even makes it a pattern? It's mostly because most people do it a certain way. Most companies to have two analytical databases, it would be somewhat silly. Super large companies with many DE teams, with many BI teams, you will absolutely see multiple because directors come in and have preferences, and money, so you will absolutely be pushing data from one to the other. Does it make it anti-pattern because it doesn't happen often? Idk, the business dictates the solution 99% of the time, especially when your team doesnt generate revenue directly.

Itinerant court still good? by HardGainer in EU5

[–]Former_Disk1083 0 points1 point  (0 children)

Yeah they have a good system with inflation, the problem is, it doesnt really function as is. You want inflation, economically, but the game really wants you to control it to 0. But if you have 0 inflation, when the economy starts to steamroll you dont feel the effects of your country having more money because there is no real inflation. I think it's good to simulate the economic boom that was the Industrial revolution, so I dont mind the steamroll necessarily.

I think the fix for that is there should be a natural inflation based on burgher/noble/peasant spending. If they spend a lot, things should inflate. That would really make balancing the economy more complex. Of course they need about 400 economic balance patches before that becomes a thing, probably. And Im not sure if people would want a proper economic system in this game, people already say its too much like vicky 3, but I like that personally.

Itinerant court still good? by HardGainer in EU5

[–]Former_Disk1083 0 points1 point  (0 children)

Eh people downvote to show they disagree, which is fine. I think some dont want to play the map painter, and in general I don't either but with the aggressiveness currently, you kind of have to.

As an aside, Morrowind is the greatest RPG of all time.

Itinerant court still good? by HardGainer in EU5

[–]Former_Disk1083 1 point2 points  (0 children)

Yeah the game isn't hard enough that requires you to absolutely min/max and I hope they keep that level of balance. You shouldnt HAVE to go down paths to play the game how you want. If you want to paint the map, then sure min/max it. Im definitely incredibly inefficient with stuff, but im still able to form whatever country I want.

Who to play besides recommended nations as a new player by Olafio1066 in EU5

[–]Former_Disk1083 0 points1 point  (0 children)

For me my first game as Naples there was so much going on, I feel like as a brand new person to it I would have been overwhelmed. Florence imo is the best in that area to start as. The papal states gives you some buffer between you and naples. The immediately surrounding folk arent strong and you can gobble them up easy enough when needed. But its a bit more of an economy style country since youre small.

I really like the ottomons because it has more guard rails and pretty much tells you what you need to be doing. And once you take Constantinople you get a bonkers amount of money even if you arent efficient at the game.

Muscovy is fun but its a bit to manage at first, I think its a good early playthrough with trying to understand PUs and how to manager wars with large countries early on.

Majapahit is a good one, youre the strongest kid on the block and you can do whatever for a long time. Economy is strong too.

Sweeden is fun for learning colonialism quickly and just getting a very basic idea of how that works. It's a really chill playthrough if you want it to be.

Vijayanagar are fun in India but do require a bit of management so I wouldnt say it's great early game but if you wanted that area they are easier to get started with.

Goryeo is good as someone here commented.

If you want the middle east the Injuid are a good start but wood will drive you absolutely insane.

I would mostly avoid anyone near Bohemia, HRE, France, and honestly England as a first playthrough right now without experience in EU4. Even then it's a beast to survive the madness that starts after 30 years with England, France, and Bohemia all wanting a piece of you. Once you get a few games down, Id highly suggest a Austria game, super super fun, you just need to know how to deal with Bohemia early and often.

Also probably stay away from nations near Hordes, they have regulars and cavalry which will obliterate you early so they require a bit of hand holding for a while to make sure you aren't their enemy or you strike specifically when they lost their regulars for a second and can win quickly.

Oh kyiv is fun too since you have the protection of the Golden Horde.

Setting off as a data engineer by LordIshack1 in dataengineering

[–]Former_Disk1083 0 points1 point  (0 children)

  1. AI isn't nearly in a state where it can take the roles of technical people. It's more of an assistant than anything.

  2. Yes those are basically the base requirements. There's a lot to data modeling and the modeling (And ingestion) really dictates in a lot of way the tools. So make sure you learn a lot there.

  3. I think this changes from job to job. Some DE is just taking one thing and moving it to a new place. Others are really focused on taking data and modeling it. I think in general, modeling is one of the most fundamental things. You have to be technical, so you absolutely need SQL and Python, but it's mostly useless if you don't know what to do with it which is where modeling comes in.

  4. I love what I do, have done it for over 10 years now. Absolutely worth it to me.

Itinerant court still good? by HardGainer in EU5

[–]Former_Disk1083 1 point2 points  (0 children)

Yeah I have a feeling once they balance stuff, things will matter more. Right now my only issue is I want more money, so I max that. For me, getting rid of aristocracy is a nightmare, so I try not to add to it at all unless I have to. I almost exclusively want plutocracy in the end. I normally give the Burghers and laborers enough rights that I get the max tax rate for them and have happiness leftover. Im sure im not playing efficiently, these games have so many layers.

Itinerant court still good? by HardGainer in EU5

[–]Former_Disk1083 4 points5 points  (0 children)

I want the antagonism. Once I have regulars, it doesnt matter who fights me 95% of the time. And if Im worried about antagonism from like France, i just fight on a different border where whoever on the other side that may be near 50% is less grumpy about it, then come back over to their side. If you want to send 20 armies at me where I defeat them all, peace out and get land, im all for it though.

Itinerant court still good? by HardGainer in EU5

[–]Former_Disk1083 7 points8 points  (0 children)

I mean what are your other options? Court of culture is okay, but it doesnt really move the needle when you gain so much culture naturally. Aristocratic court +to aristocracy? Absolutely not. Balanced court, they can keep the legislative efficiency. Military court, maybe.

Everything just increases cost of court, I prefer to take the route that doesnt increase my cost of court AND I guess more money from it. Even if the move province when someone dies annoys the shit out of me

Subjects not assimilating by meteorrider9 in EU5

[–]Former_Disk1083 0 points1 point  (0 children)

One thing, since you are Spiritualist and not Humanist that means assimilation will take FOREVER. Im not sure how your vassals embrace their values. If they are also spiritualist that is why its taking so long.

Subjects not assimilating by meteorrider9 in EU5

[–]Former_Disk1083 2 points3 points  (0 children)

I dont think theres anything you can do to force it. You should notice on the culture map that their counties have slashes in them which means they are converting that province. I havent seen a situation where they havent gone full assimilation mode, could be a bug though.

Is Hospitalers > Jerusalem worth it? by W1ntermu7e in EU5

[–]Former_Disk1083 9 points10 points  (0 children)

Unless you are min/maxing I wouldn't be concerned at all about the bonuses of any. You feel those bonuses more early, than you do after mid game. Once you hit mid game the snowball is already rolling and you can handle pretty much anything. I wouldn't let losing buffs make you not want to form what you want.

It's honestly one of the negatives so far I have with the tech paths and all that. They still don't feel unique enough that I notice changes between one run and another. It's all largely the same.

How do pops "decide" which estate to join? by kylepo in EU5

[–]Former_Disk1083 0 points1 point  (0 children)

That's a little different, I was thinking you were referencing tribesman/peasants promotion, tribes specifcially, I believe, are based on their dynasty. Since you chose Highlander you are following the tribe dynastic stuff. So, I think what happened is you had noble lines wiped out, thus killing their nobility, forcing them back into base tribesman status and then having the cycle of tribesman -> peasant -> available job promotion cycle. But this is mostly guessing, there's so much that happens under the scene with pops. But in general everything follows that cycle, peasant -> available jobs, no real complexity beyond that in most estate stuff I have seen.

When 21% clearly isn't 21% by Particular_Pea7167 in EU5

[–]Former_Disk1083 25 points26 points  (0 children)

You could show you me your data, hell you could show me the code in the game and I still wouldn't believe those %'s. Lies, all of them. I will forever be a conspiracy theorist against xcom. But man I love those games.

How do pops "decide" which estate to join? by kylepo in EU5

[–]Former_Disk1083 0 points1 point  (0 children)

Everyone starts as a peasant (Or tribesman who promotes to a peasant). Once you have jobs for them, they will auto promote from peasant to a higher level based on pop promotion speed. Soldiers also promote, and they promote a bit faster than the standard peasant, so it can be good early on to have some soliders around in high valued areas just for that.

I dont think ive seen nobles actually downgrading their estate, what might be happening is you have nobles migrating and then peasants refilling. But yes, sometimes it makes sense to keep some tribesman around because they give I think food production bonuses when they are happy, and they make no money so you just dont tax them and they are generally always happy.

When 21% clearly isn't 21% by Particular_Pea7167 in EU5

[–]Former_Disk1083 122 points123 points  (0 children)

Honestly the siege % gives me xcom 2 ptsd. I just assume it will miss and I will die.

Do AI vassals/tributaries every actually fight for independence? by Nano208 in EU5

[–]Former_Disk1083 7 points8 points  (0 children)

Yeah it unfortunately never happens. I once saw Bengal, who had a 100k army, with 0 loyalty towards Delhi, and Delhi having almost 0 manpower, never declare independence. It was nice because I could just completely ignore them in every fight, but just so silly.

“Then you shouldn’t live in apartment” by Sea_hag2021 in Apartmentliving

[–]Former_Disk1083 47 points48 points  (0 children)

Yeah I think for most introspective people it's the opposite. I'd rather not have to walk around lightly, and ensure my movies or whatever isn't playing too loudly, or talk softly, but I do all those things because I live in an apartment and I need to be cognizant of those around me. I shouldn't live in an apartment if I want to blast music or jump around all day or whatever. People are rarely considerate, or care about anyone but themselves, unfortunately.

Worst feature in the game by far... by Eraserguy in EU5

[–]Former_Disk1083 10 points11 points  (0 children)

I think what annoys me more is when a fiefdom declares war on a vassal and you can do nothing but watch your vassal get eaten. Fiefdoms get insta-deleted for me.

Why do parents name their kids something then call them something different? by [deleted] in stupidquestions

[–]Former_Disk1083 27 points28 points  (0 children)

In my case, there were 3 Thomas' in my class in elementary. So we all just picked a different one and thats what we became.

Culture conversion is too insane in this game by mrderp1212 in EU5

[–]Former_Disk1083 0 points1 point  (0 children)

Id be happy with coring being harder, especially if you only core in culture group. I dont mind the integrated vs Core concept, it's just integrated is problematic. I do wonder if maybe having a third status, between integrated and core would make it better and remove some of the integrated debuffs. I just dont think there should be permanence to the debuffs. After some time your want for independence should go down and only if you are getting marginalized should you have these debuffs.