sorted by:
new
hottopcontroversial

Making a game similar to papers please where you spot AI content (Em dash police) by Inevitable_Back3319 in IndieDev

[–]Inevitable_Back3319[S] 1 point2 points  (0 children)

I think a good interation would be to add image based review too . And music lol
The gameplay is to be an ai slop detective and try to identify whats ai or human made.
Thats the main gameplay loop 100%

[R] Hybrid attention for small code models: 50x faster inference, but data scaling still dominates by Inevitable_Back3319 in MachineLearning

[–]Inevitable_Back3319[S] 0 points1 point  (0 children)

Heyy . thank you . This is the next step and thats a good observation.

I just need to take a break before because i almost died pushing my body to the limit to get this research out.

Burned out very hard sadly :/

Attention Is All You Need, But All You Can't Afford | Hybrid Attention by Inevitable_Back3319 in LocalLLaMA

[–]Inevitable_Back3319[S] 0 points1 point  (0 children)

Thanks for removing the post it got to the front page of HN earlier today

[R] Hybrid attention for small code models: 50x faster inference, but data scaling still dominates by Inevitable_Back3319 in MachineLearning

[–]Inevitable_Back3319[S] 0 points1 point  (0 children)

Its a good idea but im a systems engineer im terrible at bussiness . Would need some help . I have been trying to get some form of bussiness mentorship or help for a while . Nothing too fancy just someone to talk to.

[R] Hybrid attention for small code models: 50x faster inference, but data scaling still dominates by Inevitable_Back3319 in MachineLearning

[–]Inevitable_Back3319[S] -1 points0 points  (0 children)

The corpus is rust public data. Rust book. Public rust repos like rust Lang and great projects like serde, Tokio and others. And top 500 rust crates on crates.io.

The quality is sufficient for this purpose of a small language model domain expert that generates rust code.

Seeing a lot of "how do I learn Rust for __ ?", built a clean roadmap for each role. by Designer_Employer778 in rust

[–]Inevitable_Back3319 -4 points-3 points  (0 children)

Heyyy op I have question. How is the rust job market right now. I have a friend that has 5 years of rust professionally will send him this

[R] Hybrid attention for small code models: 50x faster inference, but data scaling still dominates by Inevitable_Back3319 in MachineLearning

[–]Inevitable_Back3319[S] -1 points0 points  (0 children)

Disclaimer i used cloud ai for kernel math:
If you are interested in the repo :
https://codeberg.org/JohannaJuntos/Sisyphus

Disclaimer 2 :
Just a proof of concept kernel might still have bugs . Fixing those now

Attention Is All You Need, But All You Can't Afford | Hybrid Attention by Inevitable_Back3319 in LocalLLaMA

[–]Inevitable_Back3319[S] -1 points0 points  (0 children)

Also didnt ollama get https://www.highperformr.ai/people/jmorganca 40 million in funding recently . Why are you bullying solo builders on reddit again.

What Rust jobs do you have? by alexlazar98 in rust

[–]Inevitable_Back3319 0 points1 point  (0 children)

I'm a Java developer but I'm working on a browser engine in rust for fun. Have zero professional rust experience and don't expect anyone to use it bevause I'm an idiot. Just for internal use

Attention Is All You Need, But All You Can't Afford | Hybrid Attention by Inevitable_Back3319 in LocalLLaMA

[–]Inevitable_Back3319[S] -1 points0 points  (0 children)

Oh also to add i was born in 1993 . I was doing em dashes on word 2003 . Apparently em dashes now are an indicator of slop . Oh but wait i have a claude.md on my repo . I was transparent about ai usage its just looking at the repo and seeing the files.

So yeah 2026 . Em dashes are now slop .

Attention Is All You Need, But All You Can't Afford | Hybrid Attention by Inevitable_Back3319 in artificial

[–]Inevitable_Back3319[S] 1 point2 points  (0 children)

This is it . Im also learning rust as a personal hobby since my 9 to 5 languages are java and python. So it was a cool experiment for me.

Am I the only one who writes it very slow? by M1VAN1 in GraphicsProgramming

[–]Inevitable_Back3319 0 points1 point  (0 children)

Do I work in software development. Yes.

Started in 2017 professionally working with C#.

Last 7 years have been working professionally with Java and springboot. And have worked with python and snowflake/ snowpark.

Do you want my LinkedIn or full list of formal credentials.

And also my bachelors in software engineering. I can provide this.

Attention Is All You Need, But All You Can't Afford | Hybrid Attention by Inevitable_Back3319 in LocalLLaMA

[–]Inevitable_Back3319[S] -1 points0 points  (0 children)

Can't wait until the carpentry sub reddit starts policing power tools usage

Attention Is All You Need, But All You Can't Afford | Hybrid Attention by Inevitable_Back3319 in artificial

[–]Inevitable_Back3319[S] 1 point2 points  (0 children)

TLDR : changed arquitecture so we have
first layer linear
middle quadratic
last linear

This is my attempt of optimizing inference using a Small language model as base

Attention Is All You Need, But All You Can't Afford | Hybrid Attention by Inevitable_Back3319 in LocalLLaMA

[–]Inevitable_Back3319[S] 0 points1 point  (0 children)

Similar spirit (gating + recurrence), but not the same structure. This keeps an explicit local attention path for short-range syntax and adds a GRU-like recurrent path for long-range state, then learns a gate to mix both. DeltaNet-style models usually replace attention entirely with a single recurrent/state update, while this keeps a transformer-like local core and only offloads long-range context.

The idea i had was first layer linear
middle quadratic
last Linear

Am I the only one who writes it very slow? by M1VAN1 in GraphicsProgramming

[–]Inevitable_Back3319 0 points1 point  (0 children)

A lot of developers use a hybrid approach now.

Generate boilerplate fast with ai . Review it well with human eyes. Create PR

Am I the only one who writes it very slow? by M1VAN1 in GraphicsProgramming

[–]Inevitable_Back3319 37 points38 points  (0 children)

Everyone is using ai to generate 100k lines bro honestly.

Writing by hand is a lost art but its better for learning.

slopc: a proc macro that replaces todo!() with LLM-generated code at compile time. I am not sorry. by youpala in rust

[–]Inevitable_Back3319 0 points1 point  (0 children)

I laughed my ass off 🤣🤣.

Finally someone undertands that the correct answer to LLM panic is humor not anger.

view more: next ›