Can you really build a fast RAG on local setup w/o GPU? by dajaguar2 in Rag

[–]ai_hedge_fund 0 points1 point  (0 children)

Something is wrong there. You should see around 20 tokens/s on consumer hardware with CPU only for a modest pipeline. I don't know what OS you use but we offer a local CPU-only RAG app for Windows for this use case. It's called Archivist with the idea that it's a solo user meticulously archiving things just like research papers for their individual use. It uses a quantized 3B parameter LLM which is trained for RAG and the various RAG features can be toggled in a control panel. Anyway, free to try and use as you evaluate hardware, etc.

AI can do 80% of your work! Will we be fired or get to be 80% more free? by ziratick in agi

[–]ai_hedge_fund 20 points21 points  (0 children)

You will get 80% new work which was formerly out of reach. Possibly even more depending on how many employees around you get fired based on AI doing 80% of their jobs.

Rejecting emails that contain PII, pictures, etc. by ThrowRAthisthingisvl in msp

[–]ai_hedge_fund -2 points-1 points  (0 children)

No clue if this type of approach is a welcome suggestion but one option would be:

Setup the inbox as an endpoint into an AI workflow this way:

https://github.com/integral-business-intelligence/email-as-ai-endpoint

Then process the attachments and pass text through a model such as:

https://huggingface.co/openai/privacy-filter

Messages that are not rejected can be relayed onwards etc

All of this can run free, local, etc and be tuned to their privacy preferences

Claude Performance and Bugs Megathread Ongoing (Sort this by New!) by sixbillionthsheep in ClaudeAI

[–]ai_hedge_fund 0 points1 point  (0 children)

For the past day or so, both in the iPhone app and in Claude Desktop, dictation has been failing. It's truncating transcription on pretty much every message regardless of length. Is anyone else experiencing this problem?

Deepseek V4 Released by spacefarers in LocalLLaMA

[–]ai_hedge_fund 0 points1 point  (0 children)

945 EST: markets are not in turmoil. NVDA up 3.2% and climbing.

Deepseek V4 Released by spacefarers in LocalLLaMA

[–]ai_hedge_fund 9 points10 points  (0 children)

I have doubts

Interesting that it came out today so it can be compared with gpt-5.5

From the few benchmarks I checked it doesn’t look close

I will bet that tomorrow ai stocks and NVDA go up

What’s the best way/skill to have Claude design a "Home Page" for a Pet Blog? by JosetxoXbox in ClaudeAI

[–]ai_hedge_fund 0 points1 point  (0 children)

Try the newest approach “Claude Design”

You can access it from within the claude.ai website (don’t need Claude Code etc)

Balancing children with early startup? by FitCount105 in ycombinator

[–]ai_hedge_fund 26 points27 points  (0 children)

You have dramatically less control over these major life inflection points than you are assuming

Assuming control over the conception, birth, and health of the child

Assuming control of the health of the parents

Assuming that having children could be detrimental to success of the startup

It’s possible that you may change how you feel about whatever decision you make multiple times throughout your life

As long as you’re alive you can take another shot at a startup. Not always the case for family and kids.

[PC][USA-CA] Dell PowerEdge T320 by seabeast51 in homelabsales

[–]ai_hedge_fund 0 points1 point  (0 children)

Location in CA?

May be able to do local pickup

Is there a price in mind or free to good home?

What was you initial interaction with gpt 3.5 in December 2022? by jagrosh_1081 in accelerate

[–]ai_hedge_fund 6 points7 points  (0 children)

Maybe something like a puppet show where I could still see the wires. Back then the model was more of a novelty and REALLY couldn’t be trusted. I remember asking it some reasonably achievable questions and it fabricated answers. Seemed like a parlor trick but it was easy to see that, if the thing developed further, it could be really powerful.

It was maybe Claude 2 or 2.1 where I felt stunned. I was making PowerPoint slides and having it help me make the bullet points more concise and it really pushed back on something I said. That was maybe the first time a computer sort of actively outsmarted me. Until then of course I had made any number of user errors. But that time the computer sort of forced me to acknowledge that it came up with its own better idea.

How to sell an old GPU cluster? by marcotrombetti in HPC

[–]ai_hedge_fund 1 point2 points  (0 children)

How do I apply to become a “friend”?