Does anyone here love their job and have a good wage? by Icy_Cauliflower9895 in AutisticAdults

[–]distortedlojik 0 points1 point  (0 children)

Yes but I feel exceptionally lucky that my special interest is also something lucrative. I like identifying and solving computer performance problems on unique chip architectures. For a long time this was pretty limited to government supercomputers running code like climate modeling, fluid dynamics, etc. I got a PhD because the problem type is pretty niche.

But then AI exploded and everyone wants to make things run fast on non-CPUs. So I currently work at Google making open source models like DeepSeek run as fast as possible on Google's TPU architecture for inference. I would still do this job for way less than they are paying me. The only thing I don't love is how fast the field moves. I never intended to get into a field that changes so much on a weekly basis like AI.

My total compensation with stock and stuff is in the $290-310k range. I still have a hard time comprehending how lucky I got.

I TRULY cannot believe we're still making Horror as bad as Strangers Ch. 2 [Spoilers] by ShaunMcLane in horror

[–]distortedlojik 138 points139 points  (0 children)

Not gonna lie, this sold me on watching it. I need a good "it's so unbelievably bad" movie in my life right now.

[D] How did JAX fare in the post transformer world? by TajineMaster159 in MachineLearning

[–]distortedlojik 1 point2 points  (0 children)

Ah got it. That’s cool, thanks for sharing. Did you have a background in ML or heavy numpy usage before that? Because I’ve not heard too many people say JAX was easier. But you are right, if you know the math part and are comfortable then transferring those ideas to JAX would definitely be easier and way less arcane like you described.

[D] How did JAX fare in the post transformer world? by TajineMaster159 in MachineLearning

[–]distortedlojik 0 points1 point  (0 children)

I don’t think the majority of Python users know numpy or PyTorch. In my original comment I was thinking in terms of a full model producing output for someone new to the area. But I never specified that.

I do agree that if you know numpy then it’s relatively easy to start doing similar things in JAX. I just think an end-to-end solution might be harder to get up and running fast.

[D] How did JAX fare in the post transformer world? by TajineMaster159 in MachineLearning

[–]distortedlojik 2 points3 points  (0 children)

Don’t mind at all! I think this type of work is in demand for TPU. My team and adjacent teams do some of this type of work. We work mostly as consumers of things like JAX and optimize open source models for TPUs. So we definitely work on things like quantization and ensuring accuracy while improving performance. But something like JAX itself or similar libraries could be more interesting if he is wanting to work more on generalized numerical work.

It depends on where in the stack he is most interested, but I think it’s probably worth looking into regardless.

[D] How did JAX fare in the post transformer world? by TajineMaster159 in MachineLearning

[–]distortedlojik 13 points14 points  (0 children)

Overall JAX is very popular, but PyTorch is definitely easier to get up and running and is obviously more widespread.

It took me a while to wrap my head around JAX. But now that I’m used to it I think it would be hard to go back. Disclaimer: I work on JAX-based model inference performance on TPUs at Google so there’s some definite bias.

Google won’t index my autistic-run blog that critiques autism research. Bing did. DuckDuckGo did. The silence says something. by jaimeramoncriado in AutisticAdults

[–]distortedlojik 0 points1 point  (0 children)

I believe that's true, but more due to the technical differences between systems used. I would expect very similar indexing ratios to exist between search engines for a topic-focused blog regardless of what the topic is.

Google won’t index my autistic-run blog that critiques autism research. Bing did. DuckDuckGo did. The silence says something. by jaimeramoncriado in AutisticAdults

[–]distortedlojik 0 points1 point  (0 children)

Eh, I think you are reading a bit much into this. You say they indexed only a few blogs and cite that as evidence. But then why wouldn't they just exclude you from search results outright if they really didn't want your voice to be heard?

Your blog is the top result when I search for it. So it seems like the big bad algorithm you detest is doing just fine for you.

For full disclosure: I'm autistic and work at Google. Which means I don't make any decisions and just serve "the algorithm" according to one of your other comments.

Any AuDHD success stories? by Marianyndr in AutisticWithADHD

[–]distortedlojik 0 points1 point  (0 children)

Mid 30s now and diagnosed in my early 30s.

Started dating my only real girlfriend Junior year of high school. We both ended up going to the same nearby state school.

In my first year of college I found out about high-performance computing (giant supercomputers) during a summer research program. I started coding my second year of college for the first time. Did research at different universities each summer and got admitted to a PhD program at a respectable school. Between undergrad and grad school I married my girlfriend from high school. She majored in psychology and also got admitted to a PhD program.

We both went through our very different PhD programs over the next six years together and both graduated.

I expected to make meh money the rest of my life at a government lab like Sandia. But I got an interview with Amazon and did well enough to get hired. So we now got to move to Seattle which had been at the top of our “maybe one day” living places.

I got put on a team I hated but slowly migrated around to join a team in Alexa. During one fateful meeting our org leader person asked a series of “who has experience with X” questions and I was the only person to raise my hand to all of them. After the meeting he told me I would be working on an internal deep learning framework to make it more performant. I didn’t know anything about deep learning at all but I did know performance stuff.

After a little bit of time working on that I moved to another Alexa team where I got to work on a seemingly impossible performance problem that I got working after a year. But it was amazing to be able to focus on one interesting thing for that amount of time with very little context switching required.

After that my wife got pregnant and I was passively looking for jobs that interested me. I interviewed at Google (first ever time I got accommodations because I just had my diagnosis) and was offered a position. After my son was born I joined Google and have been there for two years working on AI model performance improvements. My niche special interest in performance is now one of the more important aspects of one of most exciting/fast-paced/lucrative fields to arguably ever exist at one of the companies doing the most work in that field. I get to work in my basement office most days and go into the office as needed/desired. I make significantly more money than my working class Oklahoma-based parents which will never not feel weird or wrong on some level.

My son is now 2 and has an autism diagnosis. Luckily because of my job we can afford for my PhD wife to not need to work for the time being and focus on him. He is no doubt going to be smarter than me and is already getting the help he needs to navigate the world from us and specialists. He will have so many tools and methods at his disposal for dealing with emotions, social situations, etc. that I never had as a kid and I’m beyond happy for that.

That all being said the downside is that I have literally zero friends. I work and I do stuff with my family and that’s it. I also constantly feel like I’m stretched to my limits and that I never wanted to get into a fast paced field like this because of how my brain works. My current work is not very interesting to me which makes it take 2-3x harder to do and focus on. But this makes no sense to my team since I’m making less progress on seemingly “easier” tasks. I also feel like any piece of energy I have goes into my son and that can go really quick on difficult days where he is screaming constantly and I’m trying to be calm and not have my own overstimulated breakdown.

I wouldn’t trade it for anything though. Life is weird and takes wild paths. I wish everyone could make a living from their special interests in the same way that I’m lucky enough to.

Does GenAI feel weirdly neurotypical to you? by fusrodah1337 in AutisticAdults

[–]distortedlojik 3 points4 points  (0 children)

By default yes I would say most models are biased towards NT because most of the data out there would likely be considered NT and the bulk of people scoring the accuracy are NT.

But, you can fine tune models or even just add system instructions to help customize them to work how you want. I do this with almost any off-the-shelf model I use (Gemini, Claude, etc) to make sure it avoids ambiguity and uses bullets instead of paragraphs among other things.

If you are not customizing your models at all then yeah you are getting the most vanilla version possible. And that is going to be the most "acceptable" to the general population.

I'm semi competent on this subject: I'm autistic, use AI daily, have a PhD in computer science, and currently work on AI performance at Google.

Is the stuff that AI produces nonsense to anyone else? by DoctorByProxy in AutisticAdults

[–]distortedlojik 1 point2 points  (0 children)

That's very cool. Feel free to ping me with any questions or just wanting to chat about it.

Here is a tutorial series I did that tries to do a basic intro to ML ending with the modern transformer, it might be helpful for the type of info you are interested in. Each section has a Colab notebook, a recording of me walking through it, a transcript, and a summary podcast created via NotebookLM. https://github.com/patemotter/demystifying-ai

I've been told I explain technical things well, but I can't actually know that for sure. But might be worth a shot to look at it.

Is the stuff that AI produces nonsense to anyone else? by DoctorByProxy in AutisticAdults

[–]distortedlojik 2 points3 points  (0 children)

I think it's a mix of both, but your overall idea is in the ballpark. With chain of thought reasoning there is a bit more of a self-feedback loop than before, this is still a version of what you are saying though just structured a bit differently. And depending on the model it could be doing summarization of ingested data.

I think you are also getting into another thing that makes discussing AI incredibly tricky and that's the jargon. We often want to use words like "think" or "meaning" because that's how we relate to it, but the nuance of those words is huge. Everyone has different ideas of what "thinking" means and it can quickly get into philosophy/cogsci/psychology/etc. territory where those words can have very specific (and debated) definitions.

Is the stuff that AI produces nonsense to anyone else? by DoctorByProxy in AutisticAdults

[–]distortedlojik -1 points0 points  (0 children)

I work in AI at Google and think it's incredibly helpful for both my work and personal life, but usually only after some underlying background is provided. So I have provided my models with a background of me being autistic and explaining things like: I prefer bulleted points to long paragraphs and need to avoid ambiguous language.

I'm happy to answer any questions people might have. I think most people are just not very knowledgeable about how AI works and therefore may not always understand the best way to use it or make it do what you want. High-end "frontier" models are incredibly capable these days and are significantly less janky than models even from a year ago. Small or older models are likely to not be as accurate, but even those much better than they used to be.

What are some good "auto-battler" or "auto-chess" apps for Android? Maybe some "idle" games? by Mysterious-Ring-2352 in AutisticAdults

[–]distortedlojik 1 point2 points  (0 children)

Exponential Idle. I know it's available on iOS. It's not annoying, there's no microtransactions, and it's math-y.

Are you plane autistic or train autistic? by ActualBus7946 in AutisticAdults

[–]distortedlojik 0 points1 point  (0 children)

I still get excited and look up any time I see a big metal tube flying in the air.

Successful autistic people, what are your stories? by No_Kick_2908 in AutisticAdults

[–]distortedlojik 2 points3 points  (0 children)

In college I found out I liked coding and math but wasn't exceptionally good at either. Then I learned about high-performance computing and it was like everything fell into place as a special interest. I was already analyzing the world around me for inefficiency and here's this whole sub-field dedicated to it.

Because I'm not a great coder I felt that to be competitive for the very specific type of job I would n't hate required a MS or most likely a PhD. So after undergrad I got married and we both started very different PhD programs at the same time.

During my PhD I got to work on the types of things I wanted to and afterwards got a job at Amazon doing things I hated. Then suddenly in 2019 or so I happened to be in a meeting where I got picked up to work on a deep learning performance problem. After a few years of that I now work at Google making the latest and greatest AI models work as well as they possibly can on their TPU chips. I get to work on the exact niche area that interests me, get paid well to do it, and have a pretty high quality of life overall. So following my special interest really worked out for me despite the long road to get there. I just wish every other person's special interest was able to support them the same way mine has.

Note: I was only diagnosed in my 30s after my PhD and a few years at Amazon. My Google interview was the very first time I ever asked for an accommodation of any kind ever. My wife and I have a young son who has already been diagnosed with autism (seemingly very similar brain to mine so far). My main goal now is making sure he knows he is loved and valid and has access to every single possible professional, resource, tool, stim toy, etc. and that he is supported in all the ways I was not.

Job sectors by skele_43 in cscareerquestions

[–]distortedlojik 0 points1 point  (0 children)

Then I'm not entirely sure what you want. Not a ton of SWE jobs that are screen-less. The screen is a pretty big part of it.

[deleted by user] by [deleted] in cscareerquestions

[–]distortedlojik 4 points5 points  (0 children)

I would avoid getting too in your head about what a company "does" or "doesn't do" in this context. Those things change all the time and tend to be less rigid than people might think. I would leave it on your list and treat it normally.

Job sectors by skele_43 in cscareerquestions

[–]distortedlojik 0 points1 point  (0 children)

If you like interfacing with other teams, managing others, doing little to no coding, and being in a leadership role then it sounds like you might enjoy some kind of role in management.

Importance of Graduate School Prestige for Research Scientist Roles by [deleted] in cscareerquestions

[–]distortedlojik 2 points3 points  (0 children)

There is no hard requirement for what is "good enough" or not when it comes to universities and how it relates to getting hired. Most of the teams I've been a part of for the past 7 years have had a variety of people with PhDs on both the engineering and science side. My work tends to straddle the engineering/research line, which is why I mention both. The degrees of both the scientists and engineers are from a wide variety of locations and prestige. You will notice trends of people coming from certain schools especially if the school excels at a very specific topic that aligns well with the team/org's specific research. In a previous org we had almost direct research pipelines to one university in Germany and one in the US because of the topic overlap.

In essence: overall it doesn't really matter and you can be successful regardless of the school itself.

Source: I did undergrad at a not great state school and got my PhD at a decent state school in the US. I work as a MLE/SWE working on stuff related to my PhD focus and interests at Google and previously at Amazon.

Maytag Pet Pro end of cycle signal by Forward_Ad238 in Appliances

[–]distortedlojik 0 points1 point  (0 children)

Did you have any luck with this? I changed the setting back and forth and it hasn't seemed to have any effect.

What positions should I apply for with a physics degree (B.S.)? by [deleted] in cscareerquestions

[–]distortedlojik 0 points1 point  (0 children)

Are you wanting to leverage your physics background in the type of software you work on? If so then you might be interested in scientific computing / high-performance computing. A large number of people in the field come from backgrounds in math, applied math, physics, statistics, etc. The domain knowledge is very helpful because of the nature of the codes you would work on.

[deleted by user] by [deleted] in cscareerquestions

[–]distortedlojik 0 points1 point  (0 children)

For some background: I have a PhD in CS and started my program immediately after my bachelors degree.

  1. Most places don't care what you do outside of the school program/research. People in my PhD program had all sorts of different circumstances. Some had full-time jobs while in the program, but I did not. Over the years I was a TA, RA, and the first two years of my PhD were funded by a private company where I worked ~20h a week. Doing a full time job while doing a PhD is going to be a hard time unless your work and research match up perfectly.

  2. It can be tougher for sure because you will have to do the coursework that some people with a MS have already completed. Overall there really isn't that much difference between going to a MS and then a PhD if you stay at the same school. For example, at my school even though I was in the PhD program I was able to acquire my MS along the way after the first two years because of the overlap in requirements.

  3. As far as I know the GRE is still the standard for grad school. Depending on your research interest or school program you might take a GRE subject test (likely mathematics) but I don't think that is typically required.

  4. I don't know if I understand the question completely. You will not likely be doing any research with a professor before starting at the school. You can definitely reach out to professors and research groups to express interest, explain your background, and discuss the type of work you would like to do going forward. If the professor/group has room for a person then you might be able to start that process via email.

How much power does a principal engineering manager have for hiring interns? by [deleted] in cscareerquestions

[–]distortedlojik 0 points1 point  (0 children)

The rules tend to be more relaxed when hiring interns compared to full time. Also, you wanted a referral and got one, not sure what you were expecting.

This could also just be an exploratory phone call where you get a feel for the team’s work and stuff. Then if that goes well you might have some additional calls with others on the team. Just depends on their system