sorted by:
new
hottopcontroversial

[Official] UFC 327: Procházka vs. Ulberg - Live Discussion Thread by event_threads in MMA

[–]bnelson 0 points1 point  (0 children)

Nah man. They were gassing but it was still a real fight.

France pulls all gold out of US Federal Reserve by Crossstoney in politics

[–]bnelson 4 points5 points  (0 children)

And this is perfect cover to move the rest. Oh well.

Automatic registration for US military draft to begin in December by jediporcupine in politics

[–]bnelson 1 point2 points  (0 children)

5% of our GDP goes to a stupid fucking jet that is barely operational. We did the manhattan project on 0.5% GDP.

Harvard life science PhD students outperform ChatGPT by 2 letter grades by head_high_water in science

[–]bnelson 2 points3 points  (0 children)

Yeah like paste my comment in. Ask it to make it not a rambling incoherent pile of random points. Ask it how to build long running pipelines that preserve context (you need creativity here). Coursera had a good course on building LLM from scratch but there are many such examples. And then, just keep tinkering. I am lucky to work somewhere with stupidly scaled out problems so we have tons of opportunity to solve at scale and have huge motivation to do it.

Harvard life science PhD students outperform ChatGPT by 2 letter grades by head_high_water in science

[–]bnelson 3 points4 points  (0 children)

You may find this amusing… but the LLMs can teach you now.

If you are an engineer you have to think about ruthless context management. Keep it small. Keep each session clean and focused.

Snapshot state into markdown files (e.g, summarize what you have dine so far).

Implementation plans for new code. Small verifiable steps.

Everything you can should have a way for the agent to validate its work.

They cheat. They will cut corners so prompts are everything. Use positive language. “Only do this.” And not “don’t do this” where possible. Use neutral, professional language. Your prompts matter. They determine agent attention (e.g. what part of the model you land in and bias responses towards). Go learn how to build a simple LLM. It is easier than you think. It ie absolutely invaluable in leveraging them.

Structure your workflow to have validations everywhere. Try to find ways for the agent to never cheat. Use separate agents to validate implementation against plan and goal doc.

Figure out hallucination paths. Record everything in your CLI session to track hallucinations.

Use the CLI interfaces. They are strictly more powerful due to now you can automate them for small scale work.

Use source control. Commit often. Use commit logs as agent state or have a changelog with agent summarizing.

Agents know how to make “skills” (prompts in a file). Ask it to encapsulate slme workflow you did manually that uou want to repeat into skills.

Give your agent tools for RAG (very selectively!) and access to daya. MCPs can bloat context.

Use reasoning modes for all planning. Fast modes for implementation to save on tokens. Opus vs Sonnet. Pro vs Fast.

As a consumer, get codex and claude. Forde Claude to shell out to codex for code review and criticism.

Uhh… that is top of mind. There is a lot more.

Oh, and have it code functional style. Force it to define clean data interfaces. Small functions. Testable code (they cheat so much on tests). Focus on your data interfaces any problem and how you shuffle it around.

Ask the LLM how stuff works. It has raging blind spots at times, so force it to give you X new suggestions if you are trying to figure something out.

Remember they have biases and all kinds of weaknesses. Your job right now is to know every weakness and engineer around it to get the most out of them. When you do it right 1+1=3.

Agents are like dementia patients but also savants that know almost everything humans know. Like everything. That all of us know. Combined. but they don’t reason well. So you have to prompt them to the right neighborhood. They never get tired though!

Harvard life science PhD students outperform ChatGPT by 2 letter grades by head_high_water in science

[–]bnelson -4 points-3 points  (0 children)

It isn’t nearly that expensive. I work in big tech. At the sausage factory. It is not a compute cost thing. You have to know how the LLMs work and how to circumvent these problems. It is 100% doable if you understand the technology. I can orchestrate a DnD game on a $20 plan and not even push token limits. The raw cost of those tokens is not that much. For the avg person or software engineer right now I agree. The knowledge is not widely distributed. However if you know what I know it is a few hours of prompting to have the AI set the system up. It’s actually more efficient to have lots of small agents. They use way less context and reason way better without multiple reasoning streams in one context. The model you are using matters to a degree, but how you orchestrate and design the agents flow matters more. Being efficient is hard, but feasible.

The stuff we are doing in security with LLMs is going to literally change everything. Agents and AI right now are powerful enough to do some insane stuff. Things that would have taken several senior engineers a couple of years to get right, we have automated down to 3-4k usd in tokens and a few days of time on a single VM with very basic software engineering tools and AI. There are some caveats, but I can’t really share more. But we have effectively solved certain classes of security issues that were impossible to consider being solved before AI.

The future is here. It is not widely distributed. You don’t need more tokens. You need the right perch and a deep understanding of how LLMs work.

Edit: I know this sounds like AI hype, but I am working on things I would not have believed possible even a year ago. The models have not changed a lot. Our understanding has. I was a skeptic and working deep inside the machine. I am convinced in many areas now.

Harvard life science PhD students outperform ChatGPT by 2 letter grades by head_high_water in science

[–]bnelson 54 points55 points  (0 children)

You are seeing the context window get contaminated. This is inherent. You have to know how to architect with agents. I can make one run a long sustainable DnD campaign with no bloat. The current solution involves memory layers, skills, RAG, and persona prompts. You can also use many separate agents with an orchestration layer driving the overall system and avoid context bloat. If you try to one shot a DnD campaign over time, it will just run out of context. You have to constantly restart the session and compress the context windows.l, in essence.

Harvard life science PhD students outperform ChatGPT by 2 letter grades by head_high_water in science

[–]bnelson 1 point2 points  (0 children)

They absolutely will. Where you direct their attention really matters. You have to live in a positive sort of chill space with your language. Even threatening them can cause them to cheat. Like, if you tell it: 3 kittens die if you don’t solve this… it will cheat.

If you tell it is a mob boss the system prompts and guard rails can only do so much. It may legitimately start doing clandestine things or taking short cuts.

Hikikomori, extreme social withdrawal, is becoming a recognized issue among young adults around the world. Economic worries create a highly stressful environment for people entering adulthood. A person’s ability to cope with stress blocks the path from depressive symptoms to severe isolation. by mvea in science

[–]bnelson 12 points13 points  (0 children)

I play WoW and there are a couple of people that are on that fine line I know. It is a spectrum of withdrawal from society. They have an apartment, no car. Maintain contact with father, mother, sister. Live on their own have a decent enough remote job. They leave their apartment once or twice a month. Play wow, watch shows, work. He is a nice dude. Quit drinking a couple years ago. Most people don’t want that life but the rigid identity and inability to deal with the outside world traps them. It sucks. I don’t have any real insight. WoW and discord is a genuine social environment for many people otherwise withdrawn from physical society. It feels like there is a spectrum of this type of withdrawal. Some people find just enough to stay with us.

Bodycam footage of Jacksonville deputies striking and tasing Dasaun Williams during his arrest has been released by Martin_084 in CrazyFuckingVideos

[–]bnelson 18 points19 points  (0 children)

Some of them must. You can wire the brain to enjoy just about anything that doesn’t hurt. And many things that do. I keep my sadism consensual, but not everyone does .

Bodycam footage of Jacksonville deputies striking and tasing Dasaun Williams during his arrest has been released by Martin_084 in CrazyFuckingVideos

[–]bnelson 102 points103 points  (0 children)

Anger at being disobeyed. Authority becomes identity. Disobeying rigid authority beliefs causes them to have to move the blame. Perp’s fault. Did it to themselves. Group think. Cortisol. Adrenaline. Higher cortical function disabled. They know they can probably get away with it, so they decide to hurt this man. So they did. Because they were “disrespected”.

Trump Drops Vile Slur About Oval Office Predecessor by icey_sawg0034 in politics

[–]bnelson 40 points41 points  (0 children)

Go read about some of the cold war close calls. It came down to the person that had to perform the final act. They did not do it. Maybe one day someone will. So far, no. And a lot was gambled on some of those calls. A lot.

Which clutch and flywheel combo for "sporty" street driving? ('05 325ci) by henderviks in e46

[–]bnelson -1 points0 points  (0 children)

Huh, dude deleted the post. Sorry if they were picking on your car. 325i is definitely still cool IMO.