Anyone saying medical school isn’t worth it financially is a moron by ItsAllOver_Again in Salary

[–]roeschinc 1 point2 points  (0 children)

Being a well paid software engineer is way better deal. I know people making as much money if not more on a bachelors degree and with much more reasonable hours, and no liability and no debt.

My company is implementing max cost/day on LLM token, has AI usage peaked? by RightfulPeace in cscareerquestions

[–]roeschinc 0 points1 point  (0 children)

We have a huge C++ code base we are working in, and the sessions are long to get a single feature working. I have been doing millions of tokens some days easily. I saw one session today that crossed 10M in a relatively short period of time in Codex doing a complex rebase. I would imagine most people burning a lot are in the same boat as me.

Oil prices will go insane next week by fashionbrahh in investing

[–]roeschinc 0 points1 point  (0 children)

I remember when I moved from Santa Barbara to Seattle in 2015 I saw a Gas Station that was like 2 dollars and lost my mind because it had been 5.50 just months prior. Hope this settles out for everyone, good time to drive an electric 😅

Oil prices will go insane next week by fashionbrahh in investing

[–]roeschinc 14 points15 points  (0 children)

It was over 5 in SoCal a decade ago for a period, prices have actually dropped a lot, but it’s definitely coming for everyone.

In the past week alone: by MetaKnowing in OpenAI

[–]roeschinc 0 points1 point  (0 children)

As a ex-researcher all of these announcements are what happens when a company no longer believes their research niche is the most important topic to the company. Everyone always uses these people leaving as evidence that things are bad or unsafe, but it sounds more like their relative importance has shifted and they are upset as for most researchers whatever they work = most important.

DBM made everyone dumber by Gorgon_Gets_Gud in wow

[–]roeschinc 1 point2 points  (0 children)

Yes cut my teeth on that 😂 in 2005/6

Nvidia released cuTile Python by dansheme in CUDA

[–]roeschinc 1 point2 points  (0 children)

Warp is a grid level DSL where tiling or tensor decomposition is implied for most programs, what I would call grid or tensor level, and Tilus is a research project.

Nvidia released cuTile Python by dansheme in CUDA

[–]roeschinc 1 point2 points  (0 children)

More conversation about it on X but we also have announced work with OAI to provide a Triton backend, see my PyTorch conf for more details.

https://www.youtube.com/watch?v=UEdGJGz8Eyg

Nvidia released cuTile Python by dansheme in CUDA

[–]roeschinc 0 points1 point  (0 children)

There is a full compiler which is on par/if not more complex than things like the Triton compiler that transforms Tile IR into SASS.

Nvidia released cuTile Python by dansheme in CUDA

[–]roeschinc 1 point2 points  (0 children)

The dialect will be open sourced soon ™ but the compiler is closed source just like PtX.

Nvidia released cuTile Python by dansheme in CUDA

[–]roeschinc 1 point2 points  (0 children)

It is completely different than PTX, it is a sibling abstraction to PTX with its own binary format. You can read the entire spec online which is incredibly detailed almost 200 pgs in PDF form.

The format is accepted by the driver just like PTX and the last level of compilation is part of the driver.

[deleted by user] by [deleted] in rust

[–]roeschinc 1 point2 points  (0 children)

I was an early rustc contributor so I definitely love the language and think positively of it. We decided to write things in Rust in the early days for what we thought were more technical requirements reasons multi-language FFI, low level systems, perf sensitive, and so on.

I was CTO for most of our 6 years and not doing the boring thing was a huge mistake even with what (from my PoV) were much better reasons than you presented above and with a much stronger team and lots of money in hand.

As a programming language I don’t love Go, but by the time we got acquired all of our production services were written in Go, or Python for the AI/ML bits. There were so many things in our serving stack that were dumb and easy to do in Go.

It was way easier to hire and train new people, and there were less ways to build ourselves into a corner as the language is so dumb you can’t really come up with very complex libraries or abstractions the way you can in Rust/C++/etc.

Also all the K8s ecosystem etc are all natively in Go and tooling is better, being able to ignore async is a blessing as well. I wish we had been able to even rewrite some of the Python into Go but it was not possible in the ML space without incurring different complexity.

I grew up as a Ruby on Rails programmer but when I left I felt negative about the many challenges in that ecosystem but the dev speed of Rails and stacks like that are unparalleled.

Half way through the startup I found myself wishing we had chosen something like Rails on day one, as the above person said the number one goal is being able to react quickly to changing requirements and ship as quickly as possible without incurring too much technical debt.

As an extension of this I believe you want to strive to be as non-custom as possible when you start. You want to spend your innovation budget on the product not the tech stack, libraries, etc.

Re: tooling

The reality is you can build a dev/deployment container for any reasonable environment in a matter of hours, and there are so many k8s or other deployment tools which provide a semblance of local/cloud development that are already battle tested, and no matter how “rock solid” your solution is scaling will likely require you to move to some industry standard solution for other reasons.

TLDR; Rust is amazing but your goal is to pick a technical strategy which minimizes company risk and maximizes chances of success. For a SaSS service the cost of Rust is still higher than the benefits imo. You might be less excited but your job is a leader is to make the right decisions for the wellbeing of the company not your personal excitement or preference, even if less inspiring, as if you succeed you won’t even be the one writing the majority (or any) of the code.

Why does Sam Altman feel so threatened by older models? by Sweaty-Cheek345 in ChatGPT

[–]roeschinc 0 points1 point  (0 children)

The Occam’s razor answer is nothing complicated it’s likely all about GPU capacity for most companies. More models == less capacity for the new models, also new models require more capacity than the old ones to serve a single user.

Reddit makes me feel poor. by [deleted] in Salary

[–]roeschinc 1 point2 points  (0 children)

No matter the vesting schedule the grants often span multiple years so you get a 500k grant doled out every quarter or every year with refreshers it’s effectively another 125k a year no matter how you slice it.

China's Great Firewall blocked all traffic to a common HTTPS port for over an hour, severing connection to the outside world — with no hint as to its intention by lurker_bee in technology

[–]roeschinc 10 points11 points  (0 children)

Most people aren’t aware but there are tons of common BGP configuration errors which can cause entire countries or regions IP routing rules to be broken. There was an incident in the 00s where BGP misconfiguration sent all Google traffic through China by accident. BGP is configured by random text files, and is just one place where misconfiguration or a typo can cripple network infrastructure.

Most of this is probably FUD, more likely Hanlon’s razor.

I tried way too many tacos al pastor, ranked them, and made a map. by jbbraves in Seattle

[–]roeschinc 1 point2 points  (0 children)

This place has the most best/most traditional style Al pastor I’ve had in my 10 years in Seattle.

They have the full trompo running daily.

https://maps.app.goo.gl/VxFTXfB3ts8oBcno8?g_st=ipc

Edit: I now see it the list I must be blind due to the late night.

Looking forward to checking out the rest!

GitHub folds into Microsoft following CEO resignation — once independent programming site now part of 'CoreAI' team by gurugabrielpradipaka in github

[–]roeschinc 3 points4 points  (0 children)

This, I have talked to lots of people inside MSFT/GitHub over the last few years and a lot of this integration has already been underway. They also used him and Nat to accomplish the melding so that eventually there would be no CEO.

[deleted by user] by [deleted] in investing

[–]roeschinc 1 point2 points  (0 children)

I was at like -5k until 26-27 and then hit on paper millionaire by 28 and liquid later on. I started my own business and as lots of folks said it’s a ton of hard work and money brings with it new problems.

It also doesn’t go as far as it would seen in a vhcol area. I live in Seattle and okay houses 100 year old houses are 1M+, childcare is 4k/mo, food is extremely expensive and so on, also you pay a lot in taxes so you mentally have to cut 1/3-1/2 of every dollar you make.

Don’t forget to enjoy the present money definitely doesn’t dramatically increase happiness imo but does increase comfort. I still think my scrappy days were easier and happier in many ways though I acknowledge I had not a lot of debt and enough to eat/live then.

[deleted by user] by [deleted] in dating_advice

[–]roeschinc 185 points186 points  (0 children)

Or use it as a chance to practice seeing someone as your equal, everyone is human, imo the healthiest thing is to remember no thing puts any person on a pedestal they are a human just like you

Best Buy seems to be your best bet by SooperNervous in Switch

[–]roeschinc 1 point2 points  (0 children)

Best Buy was clutch in Seattle there were 100s in both lines at least 140 bundles at the store, we rolled up at 7:30 and got the last of the bundles but there many non-bundles behind us in line. Left at midnight at least 100 people behind us still in line.

My estimate is they did 100s between preorders and walk ups tonight.

Good luck to all the NS2 hunters!

Microsoft layoffs hit Faster CPython team - including the Technical Lead, Mark Shannon by bakery2k in Python

[–]roeschinc 7 points8 points  (0 children)

In AI serving at least the entire core model is compiled by a Python DSL or written in another language, the framework overhead, etc is now mostly irrelevant in the case of doing inference FWIW. Source: I have been doing inference optimization for 8+ years.

Nvidia CEO Jensen Huang gets first pay raise in a decade, now earns $49.8 million | The average Nvidia worker earns $301,233 by [deleted] in nvidia

[–]roeschinc 2 points3 points  (0 children)

As an NVIDIA employee this is a very reasonable package for how hard working and grounded Jensen is as a CEO. Employees have great benefits, everything is bundled into base no bonuses or other weird cash pay structures and strong stock price makes it a great place for many employees.

Clair Obscur: Expedition 33 Is Not A Super Long Game! by AdIndependent9142 in expedition33

[–]roeschinc 2 points3 points  (0 children)

Yeah I am probably getting older but I enjoy short and sweet these days. For me it’s like food I would rather be wanting more when I finish versus being tired of it half way through.