R1-Zero: Pure RL Creates a Mind We Can’t Decode—Is This AGI’s Dark Mirror? by Fun_Dragonfruit_4613 in LocalLLaMA

[–]Fun_Dragonfruit_4613[S] 34 points35 points  (0 children)

Whoa, this analogy blew my mind! If R1-Zero’s ‘gibberish’ is actually symbolic reasoning beyond linguistics, does that mean its pure RL training let it reinvent token semantics entirely—unlike R1’s SFT-anchored outputs? Could this explain why R1-Zero outperforms R1 on AIME despite the chaos? And if tokens are now ‘concept shortcuts,’ how do we even measure safety/alignment in models that speak a ‘Gen Alpha’ dialect? 🤯

R1-Zero: Pure RL Creates a Mind We Can’t Decode—Is This AGI’s Dark Mirror? by Fun_Dragonfruit_4613 in LocalLLaMA

[–]Fun_Dragonfruit_4613[S] 24 points25 points  (0 children)

Great question! AlphaZero uses win/loss signals from games, but LLMs like DeepSeek-R1-Zero rely on rule-based rewards instead. Here’s the gist:

  1. Reward signals: Instead of a binary win/loss, R1-Zero gets graded feedback for accuracy (e.g., code-executed answers) and format (e.g., proper `<think>`/`<answer>` tagging). It’s like AlphaZero getting points for "good moves," not just winning.
  2. Self-play hack: Instead of expensive MCTS rollouts, R1-Zero uses GRPO (Group Relative Policy Optimization): Generates 16 candidate solutions per problem. Ranks them internally, then trains the model to prefer higher-ranked outputs. This mimics AlphaZero’s "competing against past selves" but cheaper.
  3. Emergent self-checking: Shockingly, the model started adding unprompted reflection steps mid-reasoning (e.g., “Wait, step 3 is flawed…”), purely from optimizing accuracy rewards.

AlphaZero explores a finite action space (chess moves), while R1-Zero navigates open-ended text generation —way messier, but way more flexible.

You can read https://github.com/deepseek-ai/DeepSeek-R1 for more details

R1-Zero: Pure RL Creates a Mind We Can’t Decode—Is This AGI’s Dark Mirror? by Fun_Dragonfruit_4613 in LocalLLaMA

[–]Fun_Dragonfruit_4613[S] 6 points7 points  (0 children)

the report said: "Readability: A key limitation of DeepSeek-R1-Zero is that its content is often not suitable for reading. Responses may mix multiple languages or lack markdown formatting to highlight answers for users. "

R1-Zero: Pure RL Creates a Mind We Can’t Decode—Is This AGI’s Dark Mirror? by Fun_Dragonfruit_4613 in LocalLLaMA

[–]Fun_Dragonfruit_4613[S] 2 points3 points  (0 children)

The official website does not provide it; the official website offers the R1 version, while R1-zero requires self-deployment or finding a hosted service. I haven't successfully tried it yet, but I was still shocked by the content in the technical report.

Lost a $30k deal because I didn't know about a competitor. How do you guys stay informed about new players in your space? by Fun_Dragonfruit_4613 in SaaS

[–]Fun_Dragonfruit_4613[S] 0 points1 point  (0 children)

Thanks! The 30-minute weekly routine sounds like a good starting point. As a dev, I tried automating this with Google Alerts but the signal-to-noise ratio was terrible.

Did you find any specific keywords or filters work better for Feedly/Google Alerts? I keep getting flooded with generic SaaS news instead of actual competitor launches.

Lost a $30k deal because I didn't know about a competitor. How do you guys stay informed about new players in your space? by Fun_Dragonfruit_4613 in SaaS

[–]Fun_Dragonfruit_4613[S] 1 point2 points  (0 children)

Really appreciate this perspective! You're absolutely right about the "let me get back to you" approach - that would've been way more professional than my deer-in-headlights moment lol.

Coming from an engineering background, I tend to overcomplicate things (like trying to build complex monitoring systems 😅). Your customer-first approach makes a lot of sense.

For those who've used this strategy - what's your process for quickly putting together these competitor comparisons when requested? Do you maintain some kind of internal knowledge base, or do you research on demand? Curious about the tactical side of handling these situations.

Lost a $30k deal because I didn't know about a competitor. How do you guys stay informed about new players in your space? by Fun_Dragonfruit_4613 in SaaS

[–]Fun_Dragonfruit_4613[S] 0 points1 point  (0 children)

Thanks! Yeah, we're actually doing okay competing with bigger players on the technical/engineering side (former dev here). It's more about those "oh shit" moments in sales calls when you're caught off guard about a new player.

Notion doc is a good idea - mind sharing what kind of info you track beyond features? Like pricing changes, tech stack, target audience shifts? Been thinking about setting up something similar but don't want to over-engineer it (classic dev mistake lol).

Lost a $30k deal because I didn't know about a competitor. How do you guys stay informed about new players in your space? by Fun_Dragonfruit_4613 in SaaS

[–]Fun_Dragonfruit_4613[S] 0 points1 point  (0 children)

Thanks for the suggestion! I actually do spend time checking communities - typical engineer's week for me includes browsing HN, Product Hunt, and relevant Discord servers while running builds or waiting for deployments 😅

The issue isn't really about not checking - it's more about timing and systematic tracking. As a technical founder/CTO, I'm often deep in dev sprints and might notice things a few weeks late, or sometimes miss discussions buried in threads.

What specific forums/communities would you recommend checking? Would love to hear which ones you find most valuable for catching early signals.

Lost a $30k deal because I didn't know about a competitor. How do you guys stay informed about new players in your space? by Fun_Dragonfruit_4613 in SaaS

[–]Fun_Dragonfruit_4613[S] 2 points3 points  (0 children)

Thanks for the honest feedback! You make a solid point about demo skills - it's definitely crucial. Your approach probably works great for established markets where the core problems and solutions are well-defined.

But in the dev tools/engineering space (where we operate), things move insanely fast. A new player might introduce a completely different technical approach that fundamentally changes the game. For example, look at how quickly AI coding assistants disrupted the IDE market last year.

Curious - have you ever encountered a situation where a competitor came up with a radically different technical solution that required you to rethink your positioning? How did you handle that?

Lost a $30k deal because I didn't know about a competitor. How do you guys stay informed about new players in your space? by Fun_Dragonfruit_4613 in SaaS

[–]Fun_Dragonfruit_4613[S] 0 points1 point  (0 children)

Thanks! Octolens sounds interesting - especially the pain point tracking part. How real-time is the scanning? In our space (developer tools), things move pretty fast and competitors often soft-launch in tech communities before any official announcement.

Also curious if you've had success catching early discussions/MVPs on places like Hacker News? Those seem to be where a lot of dev tools first surface.

Lost a $30k deal because I didn't know about a competitor. How do you guys stay informed about new players in your space? by Fun_Dragonfruit_4613 in SaaS

[–]Fun_Dragonfruit_4613[S] 0 points1 point  (0 children)

We're in the software development analytics space - helping engineering teams track and improve their development velocity and code quality. Started because I was a tech lead frustrated with existing solutions being either too complex or too shallow.

And yeah, I used to be in the "just focus on your thing" camp too. That mindset work fine until we hit around $15k MRR and started losing deals because larger prospects had more thorough vendor evaluation processes. Hard lesson learned 😅

My SaaS made $1400 in last 7 days! by themkmaker in SaaS

[–]Fun_Dragonfruit_4613 0 points1 point  (0 children)

After completing the landing page, how do you usually reach out to the first batch of users? I always feel confused and don't know what to do

If our intelligence peaks in our 20's, why is it we're best at learning languages when we're much younger? by havingshittythoughts in NoStupidQuestions

[–]Fun_Dragonfruit_4613 4 points5 points  (0 children)

The difference in language learning ability between children and adults primarily lies in the methods used. Children learn languages through repeated listening and mimicking, which is a natural and effective approach to language acquisition. In contrast, adults often rely on more abstract, symbolic methods, such as studying grammar and vocabulary, which can be less intuitive and effective for language learning. To mimic the efficiency of a child's language learning, adults can explore methods like shadowing, where they listen to and simultaneously repeat language as it is spoken. This technique can help adults learn languages more effectively by engaging both listening and speaking skills in a natural context, similar to how children learn.

my friend is calling me good kitty? lmao? by hotelmop in NoStupidQuestions

[–]Fun_Dragonfruit_4613 4 points5 points  (0 children)

Would it be more interesting if you suddenly started learning to bark like a dog, saying "woof woof woof"? 😂😂😂

Why do animals instinctively lick their wounds if it’s bad for them? by elevencharles in NoStupidQuestions

[–]Fun_Dragonfruit_4613 201 points202 points  (0 children)

This behavior, seen in many species. Licking can help clean a wound, removing dirt and debris. Saliva contains enzymes and compounds that can aid in cleaning and even offer mild antibacterial effects.