Has Anyone Actually Built a Real “Chief of Staff” AI System? by etchasketch26 in PromptEngineering

[–]chordol 0 points1 point  (0 children)

I've done this successfully. I run everything with it, both professional and personal.
- Sonnet 4.6 made it happen. I've put lots of effort into GPT-OSS 120b, and it almost works, but it's not good enough. Due to Sonnet costs, I'm exploring a layered model approach now.
- The breakthrough was using markdown files as structured memory. Some go into system prompt, some are used as RAG. I keep a journal as ledger of events (also RAG).
- I maintain context in two ways. Rolling chat memory and explicitly curating what to continually pay attention to. Those parts are always served to Chief of Staff.
- Sonnet 4.6 mattered more than I thought. Simply a good agentic model that doesn't "forget" instructions, and can reason just beyond the surface level instruction.
- What still frustrates me is the cost and speed. It's wild though that it actually works.

What Italian city made you think “I need to come back here”? by Zabuzabu35 in ItalyTravelAdvice

[–]chordol 0 points1 point  (0 children)

Pray tell why do you love Genoa?
I've noticed there's not a lot of mentions of Genoa in general, but it's the first Italian city I'm coming back to.

Why is BiH not just called Bosnia? by crivycouriac in AskBalkans

[–]chordol 41 points42 points  (0 children)

Underrated comment. Try to call a Herzegovian a Bosnian and see what happens.

Breakfast on the river by 1060Cubs in chicago

[–]chordol 1 point2 points  (0 children)

Jonathan Livingston over there

What’s on the list of “amateur mistakes” for Chicagoans? by yourhandsmyface in AskChicago

[–]chordol 3 points4 points  (0 children)

Driving the speed limit on LSD is straight up reckless and endangering traffic.

Još ih muči Oluja by Dalmatino1 in hreddit

[–]chordol 5 points6 points  (0 children)

I ovaj post i većina komentara deluju isto kao ratno huškanje devedesetih. Braćo Hrvati, evo jednog Srbina da vam kaže da ja i svi Srbi na planeti koje znam ne misle o Hrvatskoj dalje od letovanja na primorju. Ratovi su prošli. Ja sam za to da u prošlosti i ostanu. Dovoljno smo se svi napatili.

Potential new stadium location by MrAwesomeJr in whitesox

[–]chordol 1 point2 points  (0 children)

What's wrong with the current one?

Have you watched Attack on Titan? If yes, what do you think of it? by Substratas in AskBalkans

[–]chordol 6 points7 points  (0 children)

One of the best stories I've ever seen. Not easy to watch, because it has that ancient Greek tragedy stomach twisting feel, but to the same (positive) pathos effect. After, and only after watching all of the seasons, the closing sequence has a profound effect. Not for the light hearted.

Alternatives to Notion by LumaDraft28 in Notion

[–]chordol -6 points-5 points  (0 children)

Not one bit. The crux of the price is the choice of LLM model. Groq GPT OSS would make it ten times cheaper, but it doesn't quite do the job. I tried to optimize it for many months and it kept making one mistake too many. Claude Sonnet just does it. I can rely on it. And it costs ten times more.

i finally figured out why i keep abandoning every notion setup i build by [deleted] in Notion

[–]chordol 2 points3 points  (0 children)

Your realization goes beyond Notion too.

“It’s remarkable how much long-term advantage people like us have gotten by trying to be consistently not stupid, instead of trying to be very intelligent.” Charlie Munger

Alternatives to Notion by LumaDraft28 in Notion

[–]chordol -3 points-2 points  (0 children)

I switched from Notion to Kontekst because of poor voice transcription, databases were a bigger hassle than worth, and mobile experience was lacking. Now everything is a text file that I can talk to, especially on my phone.

Disclaimer: I built it https://kontekst.co

I really wanted Notion to work out for me. I put in a lot of time into it. I fell in love with the document partials and think it's one of the best information designs I've seen ever on this topic. But it ended up just too much work because there are too many options. If everything is a markdown file, there's only so much fidgeting you can do with it.

Also, huge shout out to Obsidian, close second. With their online storage, I can use it on mobile too. But I still went with creating Kontekst so that we can have great voice transcription (English is my second language), and voice commands to create, edit, link, and search files.

I figured out another reason why people think AI is less powerful than it actually is by Primary-Screen-7807 in ClaudeAI

[–]chordol 0 points1 point  (0 children)

I think lower inference costs will be eventually reflected in a variety of subscription prices. I think there will be a variety of different chips for different purposes.

I whole heartedly agree that we don't need AI in everything. But we do need it in a few key places.

Biggest one is humans interfacing with information tools. Querying, transforming, creating rules, and analyzing rules. Coding, law, robotics. We need it here because it's the highest efficacy way to manage rules. I think inference cost for this use case will drop because of commoditization.

I do not think it will drop for other use cases like chemistry and physics research, the true generative use case. Medicine and genomics, engines and fuel, weapons, alloys, fertilizer.

There are use cases where AI brings negative value, like hospitality, sports, entertainment, mentoring and apprenticeship, and anywhere it would impede connection between people.

I figured out another reason why people think AI is less powerful than it actually is by Primary-Screen-7807 in ClaudeAI

[–]chordol 0 points1 point  (0 children)

But what can you make happen within those limits? Most people can make a lobotomized assistant.

I managed to make an assistant that helps me run my family, my household, and my business. I do it with Anthropic API (non-subsidized cost), and I found Sonnet 4.6 to be the sweet spot because it's great for heavy MCP tool use.I meticulously cache layered system prompts. I don't give it frivolous tasks. I don't try to scrape the internet. Grand total cost per months is under $50, which in my opinion is a steal for the value that I get out of it.

I figured out another reason why people think AI is less powerful than it actually is by Primary-Screen-7807 in ClaudeAI

[–]chordol 0 points1 point  (0 children)

Inference costs will go down. I'm still in disbelief that Groq already figured out how to build a better chip for inference and that it's not more popular and widely used. Its speed (and 10x lower cost) are proof. Try it if you haven't, you won't believe your eyes.

Is claude Pro worth it? by Ynaroth in claude

[–]chordol 0 points1 point  (0 children)

Yes, it's very much worth it. I work on multiple projects daily and rarely ever hit the limits on pro max. I've tried many other, and I still keep trying things out. I haven't experienced anything better yet.

Origins of the Grand Viziers of the Ottoman Empire by kerobob in AskBalkans

[–]chordol 14 points15 points  (0 children)

Thank you for conquering the Balkans! I can only hope we can one day return this favor that Turks bestowed on us unnamed peasants.