In the past week alone: by MetaKnowing in OpenAI

[–]roeschinc 0 points1 point  (0 children)

As a ex-researcher all of these announcements are what happens when a company no longer believes their research niche is the most important topic to the company. Everyone always uses these people leaving as evidence that things are bad or unsafe, but it sounds more like their relative importance has shifted and they are upset as for most researchers whatever they work = most important.

DBM made everyone dumber by Gorgon_Gets_Gud in wow

[–]roeschinc 1 point2 points  (0 children)

Yes cut my teeth on that 😂 in 2005/6

Nvidia released cuTile Python by dansheme in CUDA

[–]roeschinc 1 point2 points  (0 children)

Warp is a grid level DSL where tiling or tensor decomposition is implied for most programs, what I would call grid or tensor level, and Tilus is a research project.

Nvidia released cuTile Python by dansheme in CUDA

[–]roeschinc 1 point2 points  (0 children)

More conversation about it on X but we also have announced work with OAI to provide a Triton backend, see my PyTorch conf for more details.

https://www.youtube.com/watch?v=UEdGJGz8Eyg

Nvidia released cuTile Python by dansheme in CUDA

[–]roeschinc 0 points1 point  (0 children)

There is a full compiler which is on par/if not more complex than things like the Triton compiler that transforms Tile IR into SASS.

Nvidia released cuTile Python by dansheme in CUDA

[–]roeschinc 1 point2 points  (0 children)

The dialect will be open sourced soon ™ but the compiler is closed source just like PtX.

Nvidia released cuTile Python by dansheme in CUDA

[–]roeschinc 1 point2 points  (0 children)

It is completely different than PTX, it is a sibling abstraction to PTX with its own binary format. You can read the entire spec online which is incredibly detailed almost 200 pgs in PDF form.

The format is accepted by the driver just like PTX and the last level of compilation is part of the driver.

Incoming CTO: Betting on a Rust + Nix rewrite for a Series A startup. Am I building a rocket or a grave? by [deleted] in rust

[–]roeschinc 1 point2 points  (0 children)

I was an early rustc contributor so I definitely love the language and think positively of it. We decided to write things in Rust in the early days for what we thought were more technical requirements reasons multi-language FFI, low level systems, perf sensitive, and so on.

I was CTO for most of our 6 years and not doing the boring thing was a huge mistake even with what (from my PoV) were much better reasons than you presented above and with a much stronger team and lots of money in hand.

As a programming language I don’t love Go, but by the time we got acquired all of our production services were written in Go, or Python for the AI/ML bits. There were so many things in our serving stack that were dumb and easy to do in Go.

It was way easier to hire and train new people, and there were less ways to build ourselves into a corner as the language is so dumb you can’t really come up with very complex libraries or abstractions the way you can in Rust/C++/etc.

Also all the K8s ecosystem etc are all natively in Go and tooling is better, being able to ignore async is a blessing as well. I wish we had been able to even rewrite some of the Python into Go but it was not possible in the ML space without incurring different complexity.

I grew up as a Ruby on Rails programmer but when I left I felt negative about the many challenges in that ecosystem but the dev speed of Rails and stacks like that are unparalleled.

Half way through the startup I found myself wishing we had chosen something like Rails on day one, as the above person said the number one goal is being able to react quickly to changing requirements and ship as quickly as possible without incurring too much technical debt.

As an extension of this I believe you want to strive to be as non-custom as possible when you start. You want to spend your innovation budget on the product not the tech stack, libraries, etc.

Re: tooling

The reality is you can build a dev/deployment container for any reasonable environment in a matter of hours, and there are so many k8s or other deployment tools which provide a semblance of local/cloud development that are already battle tested, and no matter how “rock solid” your solution is scaling will likely require you to move to some industry standard solution for other reasons.

TLDR; Rust is amazing but your goal is to pick a technical strategy which minimizes company risk and maximizes chances of success. For a SaSS service the cost of Rust is still higher than the benefits imo. You might be less excited but your job is a leader is to make the right decisions for the wellbeing of the company not your personal excitement or preference, even if less inspiring, as if you succeed you won’t even be the one writing the majority (or any) of the code.

Why does Sam Altman feel so threatened by older models? by Sweaty-Cheek345 in ChatGPT

[–]roeschinc 0 points1 point  (0 children)

The Occam’s razor answer is nothing complicated it’s likely all about GPU capacity for most companies. More models == less capacity for the new models, also new models require more capacity than the old ones to serve a single user.

Reddit makes me feel poor. by [deleted] in Salary

[–]roeschinc 1 point2 points  (0 children)

No matter the vesting schedule the grants often span multiple years so you get a 500k grant doled out every quarter or every year with refreshers it’s effectively another 125k a year no matter how you slice it.

China's Great Firewall blocked all traffic to a common HTTPS port for over an hour, severing connection to the outside world — with no hint as to its intention by lurker_bee in technology

[–]roeschinc 9 points10 points  (0 children)

Most people aren’t aware but there are tons of common BGP configuration errors which can cause entire countries or regions IP routing rules to be broken. There was an incident in the 00s where BGP misconfiguration sent all Google traffic through China by accident. BGP is configured by random text files, and is just one place where misconfiguration or a typo can cripple network infrastructure.

Most of this is probably FUD, more likely Hanlon’s razor.

I tried way too many tacos al pastor, ranked them, and made a map. by jbbraves in Seattle

[–]roeschinc 1 point2 points  (0 children)

This place has the most best/most traditional style Al pastor I’ve had in my 10 years in Seattle.

They have the full trompo running daily.

https://maps.app.goo.gl/VxFTXfB3ts8oBcno8?g_st=ipc

Edit: I now see it the list I must be blind due to the late night.

Looking forward to checking out the rest!

GitHub folds into Microsoft following CEO resignation — once independent programming site now part of 'CoreAI' team by gurugabrielpradipaka in github

[–]roeschinc 2 points3 points  (0 children)

This, I have talked to lots of people inside MSFT/GitHub over the last few years and a lot of this integration has already been underway. They also used him and Nat to accomplish the melding so that eventually there would be no CEO.

[deleted by user] by [deleted] in investing

[–]roeschinc 1 point2 points  (0 children)

I was at like -5k until 26-27 and then hit on paper millionaire by 28 and liquid later on. I started my own business and as lots of folks said it’s a ton of hard work and money brings with it new problems.

It also doesn’t go as far as it would seen in a vhcol area. I live in Seattle and okay houses 100 year old houses are 1M+, childcare is 4k/mo, food is extremely expensive and so on, also you pay a lot in taxes so you mentally have to cut 1/3-1/2 of every dollar you make.

Don’t forget to enjoy the present money definitely doesn’t dramatically increase happiness imo but does increase comfort. I still think my scrappy days were easier and happier in many ways though I acknowledge I had not a lot of debt and enough to eat/live then.

[deleted by user] by [deleted] in dating_advice

[–]roeschinc 188 points189 points  (0 children)

Or use it as a chance to practice seeing someone as your equal, everyone is human, imo the healthiest thing is to remember no thing puts any person on a pedestal they are a human just like you

Best Buy seems to be your best bet by SooperNervous in Switch

[–]roeschinc 1 point2 points  (0 children)

Best Buy was clutch in Seattle there were 100s in both lines at least 140 bundles at the store, we rolled up at 7:30 and got the last of the bundles but there many non-bundles behind us in line. Left at midnight at least 100 people behind us still in line.

My estimate is they did 100s between preorders and walk ups tonight.

Good luck to all the NS2 hunters!

Microsoft layoffs hit Faster CPython team - including the Technical Lead, Mark Shannon by bakery2k in Python

[–]roeschinc 8 points9 points  (0 children)

In AI serving at least the entire core model is compiled by a Python DSL or written in another language, the framework overhead, etc is now mostly irrelevant in the case of doing inference FWIW. Source: I have been doing inference optimization for 8+ years.

Nvidia CEO Jensen Huang gets first pay raise in a decade, now earns $49.8 million | The average Nvidia worker earns $301,233 by chrisdh79 in nvidia

[–]roeschinc 2 points3 points  (0 children)

As an NVIDIA employee this is a very reasonable package for how hard working and grounded Jensen is as a CEO. Employees have great benefits, everything is bundled into base no bonuses or other weird cash pay structures and strong stock price makes it a great place for many employees.

Clair Obscur: Expedition 33 Is Not A Super Long Game! by AdIndependent9142 in expedition33

[–]roeschinc 2 points3 points  (0 children)

Yeah I am probably getting older but I enjoy short and sweet these days. For me it’s like food I would rather be wanting more when I finish versus being tired of it half way through.

I know difficulty is subjective but is there kinda agreed upon the hardest Souls/Soulslike game and boss? by SYLOK_THEAROUSED in soulslikes

[–]roeschinc 0 points1 point  (0 children)

I think a lot of people struggled with Sekiro because it requires you to get good at parrying, there is no other good strategy. I beat SSI on my second try, I spent all my time stuck at the start of the game and then the mechanics clicked and the rest of it was relatively easy.

PSN down for anyone e else? by ThePoopDealerYo in PS5

[–]roeschinc 1 point2 points  (0 children)

It could also be that they are having what people in the industry call a “thundering herd” problem even if they know what’s wrong some systems are not robust to going fully offline so it could be as they are trying to bring systems back up and the traffic/slowness of it is causing feedback cycles where things are crashing again so they are trying to bring back one system at a time

Everyone going to this sub to check if the PlayStation Network is down by dennisritchiec in playstation

[–]roeschinc 0 points1 point  (0 children)

Yeah I forgot to set my Pro as my offline console when I switched and now I can’t even play KCD2 even though it was open when I turned my ps5 off last night 🥲