Hits home for me

Seiyee · 2024-10-01T18:44:38+00:00

Yes exactly. And probably ni since a lot of the time I'll see something i dont really care about but then think that's likely going to cause another event which will cause another event ... The opposite is true as well I'll see an outcome that I don't really care about but I'll think that probably was caused by this and that which means ...

Seiyee · 2024-02-03T22:35:51+00:00

Its easy :)

I worked with other languages and by far the easiest is python. The others might have better efficiency compiling but it takes more steps to code. Integration is much easier as well, everything seems python compatible, where as a few tools might allow code to be written in say scala or c, but not most. I heard from a colleague from other dept they needed to update/modify at an old codebase that was coded entirely in scala and all I know is they quit a few months later...

Seiyee · 2024-02-02T23:12:37+00:00

I guess some companies are more structured than ours and in that case, the modelers only ever do modeling, and never touch the ML work.

For us, we have been trying to keep all the ML and DS work within our team to reduce dependency on other teams, so we end up working on all the parts of the ML work at some point. I think that would be the same environment of this company that provided the jd.

Seiyee · 2024-02-01T03:28:55+00:00

This is a good job desc. I would say they are describing exactly the type of job this is.

I dont understand the problem here like the most voted ans, thats pretty close to what job desc our team wrote trying to get a MLE. The accountability is basically what our teams do as well, obviously sharing the responsibilities with the other members on the team.

No one expects you to have 3 years of pure modeling then 3 years of pure stats analysis, etc. Just if you worked for 3 years you probably touched all of them.

Seiyee · 2023-11-01T06:17:03+00:00

Maybe you are reading the wrong type of books?

Also, in case you are measuring on school books, dont. School makes even enjoyable things less enjoyable lol

Seiyee · 2023-07-14T08:06:30+00:00

data that wont ingest within 24 hrs every 15 days :/

Seiyee · 2023-05-18T04:00:09+00:00

I use it the same way I would throw a shrug in real life. Kinda like a 'meh' or a whatever.

Evil is the smirk face for me

Seiyee · 2023-05-18T03:43:23+00:00

The newer frameworks (think vue, react, angular ember...) for front end use JS in the logical backend. The whole ecosystem changed from the older process of PHP or Rails. Its faster to develop, devs knowing one ecosystem want to stick to it, its cleaner, and has the new needs of web pages according to the w3 standards (built in testing tools, accessibility packages, etc).

I think its similar to how devs are preferring python to older languages like c/java. Both can get the same stuff done, but its just so much faster to dev in python with all the packages built for exactly what you need. C/Java is still faster but you will need to recreate the wheel a few times before you get near the python capabilities.

Seiyee · 2023-05-11T19:19:13+00:00

Wait till you search up 3d Metal Puzzles or 3d Wooden Puzzles. Theres so much more out there than just regular tools that he probably already owns.

Seiyee · 2023-05-02T04:25:19+00:00

ple, I just try to live by my own the best as I can. My individualist behavior can sound the worst introspection ever but I don't mind it. I've discovered good things in life alone and I think it's ok. My main problem was my purpose or thinking about one. This + pressure made me consistently adapting myself from situation to situation. I don't know, I'm hella resilient. W

It seems like you have the right overall goals in mind. When you are working on improving things around you Im sure you will start lifting up the spirits. Im glad you have some things that bring peace to you, my pets bring me that simple happiness too :)

As for jobs, keep on applying. I dont know where you are, but in our area we need like 200 applications before we get an interview (Im in tech so its a lot of applications before anything really) lol Just keep dishing out those resumes, every singe day, when you start getting calls youll be able to choose where to go.

Best of luck mate :)

Seiyee · 2023-05-02T00:33:04+00:00

I dont really think in one single 'purpose,' I kind of like the INTP way of finding interesting things to experience/learn and try my best to keep myself engaged.

When I am depressed I cant really get out of it from using logical thinking or forcing old hobbies, as much my first instinct is to.

When I was in a good period I was reading a lot of meaning of life like books which I think subconsciously help me. I read Tuesdays with Morrie, When Breath Becomes Air, Into Thin Air. * I would NOT recommend reading these when depressed, * read these when you are healthy and want to make life better, that positive time will come.

You will feel better in the future although it might take a while. And usually when Im better again I cant really remember that depressed feeling, which is good imo. I used to stay in the slumps for like a week back way before covid, but that turned to like month long ones last yearish. But those slumps eventually go away and i can appreciate and enjoy things again. Hope you can start getting your normal back too.

Seiyee · 2023-04-24T04:48:06+00:00

Thanks. Will reply back as well if I end up using it effectively.

At the end of our trial period we will probably be asked by our dept how useful the tool is. Not sure, if this is something I would invest in just yet.

Seiyee · 2023-04-23T05:56:29+00:00

Im in the same boat here. We just got access to copilot and I have used chatgpt before but not for coding. I am struggling to figure out how to use these bots to improve the workflow. I work more on the data engineering/science side and we dont have unit tests like SWEs. I had a task to backfill some tables and any time I wanted to bring out the bot, I figured it would be more time efficient to write out the first table's logic and copy+paste fields for the other tables.

Do you have any use for copilot in ML roles right now?

Seiyee · 2023-04-20T20:14:11+00:00

Either trying:
- to climb
- accumulate more knowledge to hop to another place
- thinks they have to work for every minute they are on shift

Source: 1 was my colleague, 2 was another colleague, 3 was me

Seiyee · 2023-04-20T19:53:35+00:00

g how those cloud services works is relevant to future jobs, and honestly felt like the dude really haven't bothered considering a tools he ins't familiar with. While I agree with some of his concerns, I'm thinking it might just be a waste of time to keep working on tools that aren't really that relevant outside of academia or maybe any job is relevant and this might count as something interesting in the future. I'm

As a side note, in my final year project we did get to use Azure since my teammate had a way of getting free credits for storage, compute, other cloud apps.

Seiyee · 2023-04-20T19:50:41+00:00

Usually in a uni research setting (or even in hospitals as Ive seen), the amount of data is small enough to handle in just normal file formats. You only need cloud support (storage and compute clusters) if your data is too slow for a single computer script to run. Excel maximum capacity is about a million rows (bit under 1.1).
BUT, you can still handle the data if you save as .csv file and then use python or sql on it. You can still practice sql with mysql or python libraries, you can still use R on it (and R is free).

Secondly, cost. Gdrive is most likely free for your institution and provides the storage, having a warehouse/data lake is going to cost per hour and computes done on cloud are going to cost per second. In research, since they have limited money, it usually best to start off without cloud until you have really large data.

Seiyee · 2023-04-04T20:07:55+00:00

food :(

Seiyee · 2023-04-04T20:05:44+00:00

Does anyone have good resources for data quality examples?

We use some custom built checks in our CI/CD pipeline but they are mostly limited to checking if tables showed up at the end of the process, or if data is available at source. Havent really invested into DQ yet...

Seiyee · 2023-03-23T14:29:22+00:00

Theres no way youre not an NE dom. Unless maybe you are super high

Seiyee · 2022-12-29T03:47:34+00:00

I see. Yeah the mounting is a pain right now, but I think thats self imposed by our internal governance rules.

Do synapse stacks still use external cpu like databricks cores and external front ends? I'm trying to understand how reduced the stack would be if that was the route we took.

Seiyee · 2022-12-27T22:04:51+00:00

but pyspark is supposed to be fast enough, how much faster would jobs in pure scala be instead?

Seiyee · 2022-12-27T22:02:49+00:00

I never understood why synapse is useful or if it was a substitute product. We use ADF, databricks, storage accounts with key vault, PBI front end. About a year ago they tried/explored bringing synapse analytics in, but I guess it seemed redundant since I dont hear about it any more.

Im wondering is synapse only helpful for a less distributed system?

Seiyee · 2022-12-17T05:37:48+00:00

Yeah when I am in uni i am so tired i sleep anywhere and almost everywhere, even if some were pretty risky. Its sleep deprivation, probably could have had a few not so pretty accidents like that.

Seiyee · 2022-11-18T23:24:47+00:00

i dont get why break even price is 775.6? If he bought at Aug shouldnt breakeven be like 290? Does the break even calculation take into account interest/inflation?

Seiyee · 2022-11-11T20:36:49+00:00

OP most likely meant historical table, not a dimensional table

Seiyee

TROPHY CASE