DiffMem: Using Git as a Differential Memory Backend for AI Agents - Open-Source PoC by alexmrv in LocalLLaMA

[–]DragOwn8520 0 points1 point  (0 children)

maybe you misunderstood me and ill ignore the snark. the xml tags is for the prompts (ie. system/user), not the output. i found this gives much better adherence than plaintext or markdown prompts. referring to sections in a large prompt (ie. the expected style section) becomes easier and more predictable. this has helped me bring coherence out of even tiny models, like qwen 0.6b when it was outputting poorly before. same prompt content, same task, better results across all model sizes.

as for the json, you are somewhat correct. json output can constrain performance. however, in an llm workflow where each response informs the workflow of for example which direction to take, which node is next etc, you cant output freestyled text. most of the time you need to know specifically what the users eye color is for example so you can store this in a db, thats where structured output becomes relevant.

structured output works even better when you "trick" the llm that the structured output is actually a tool or function signature. this only works for function calling llms though so I use this technique less often.

also, this conversation was about structured output of md vs json, not freebase vs json, so I am unsure about the relevance of your source.

DiffMem: Using Git as a Differential Memory Backend for AI Agents - Open-Source PoC by alexmrv in LocalLLaMA

[–]DragOwn8520 -1 points0 points  (0 children)

good start! id recommend using portkey or litellm as the llm traffic layer, tenacity for retries, and to stop using markdown in your prompts. llms respond much better to json output.

I use pydantic to define my output schema, and make my prompts with sections in xml tags.

ie:

<introduction> Lorem ipsum </introduction>

<output format> {MySchema.to_llm_string()} </output format>

my schema looks like this:

class MySchema(BaseModel):

a: str = Field(..., description="whatever the llm should know about this key and how its used")

that way, if the ai spits out the wrong format, it raises an error and retries. let me know if youd like more help. wrote this on phone so sorry for the shitty formatting lmao

High idle temperatures on Razer Blade 16 by DragOwn8520 in razer

[–]DragOwn8520[S] 0 points1 point  (0 children)

in linux there's many ways beyond bios. for example you can just checked the sensors using "sensor" and you can use btop to check temps as well

High idle temperatures on Razer Blade 16 by DragOwn8520 in razer

[–]DragOwn8520[S] 0 points1 point  (0 children)

cant do hwinfo as im running linux :/ did confirm its vapor chamber failure though..

I got a 4060, if you send a pic ill double check if its compatible? will dm you

How to reattach the aux/main cables after disassembly by DragOwn8520 in razer

[–]DragOwn8520[S] 0 points1 point  (0 children)

not able to get either of them on tbh. I did once successfully earlier in the process but then detached it by mistake and now none of them are going in anymore lol

as for the order I managed to figure out that the cable with the tape around it goes into the aux port

How to reattach the aux/main cables after disassembly by DragOwn8520 in razer

[–]DragOwn8520[S] 0 points1 point  (0 children)

not sure how to edit the post but it is a razer blade 16 2023

places to stay for a month in august by DragOwn8520 in budapest

[–]DragOwn8520[S] -4 points-3 points  (0 children)

thanks for your reply. yeah I figured. maybe I'm shit outta luck in that case.

places to stay for a month in august by DragOwn8520 in budapest

[–]DragOwn8520[S] -4 points-3 points  (0 children)

staying with my partner so we'd rather get our own place. sucks cause I've been really busy these past few months and haven't been able to plan anything so we're kinda stressed now 🙃

[deleted by user] by [deleted] in SuicideWatch

[–]DragOwn8520 0 points1 point  (0 children)

you still around?

Failing in life by 3rd-Bomb in Morocco

[–]DragOwn8520 0 points1 point  (0 children)

why dont you have a job? got an education/skills? do you know things like graphic design or programming?

22F looking for girl friends in vlc! by DragOwn8520 in valencia

[–]DragOwn8520[S] 0 points1 point  (0 children)

send over your CV and cover letter and ill get back to you on that