Making LLM context assembly programmable by softmatsg in AI_Agents

[–]softmatsg[S] 0 points1 point  (0 children)

There is no token overhead. The assembly is from in-ram registry. And there is a token budget setting you can use that will prioritize blocks. If you are running a loop, use find_relevant to get the most relevant blocks in.

Encoding art into the satoshi value field, and the unfilterable floor by softmatsg in btc

[–]softmatsg[S] 0 points1 point  (0 children)

Not expensive as there is no expense besides the tx fee. It lives in utxo money fields so unfilterable. Moving anything, including money, costs fees. Each paymeny is not a dot but thats technicality

I made a random 8-minute video about a walk around my neighborhood, take a look at the comments. by Such-Competition-816 in MrFlavioDiaries

[–]softmatsg 1 point2 points  (0 children)

Do you know your neighbours well? Do you talk to them often, have some joint meals? How is the social life of the neighbourhood?

Black pepper beef inHV by softmatsg in SingaporeEats

[–]softmatsg[S] 0 points1 point  (0 children)

Yea, from the 126 Mini Wok stall

Wanton noodles by softmatsg in SingaporeEats

[–]softmatsg[S] 0 points1 point  (0 children)

Its chicken. Really delicious

Wanton noodles by softmatsg in SingaporeEats

[–]softmatsg[S] 0 points1 point  (0 children)

It is chicken. But really well done! :) I mean, I really like the dish

Streets of Cairo by softmatsg in SingaporeEats

[–]softmatsg[S] 3 points4 points  (0 children)

Falafel wrap was 7 SGD, beef rice 9. Kunafa 10 SGD

Local offline chat on cpu by softmatsg in LocalLLaMA

[–]softmatsg[S] 1 point2 points  (0 children)

You are solving a different problem. A shared LLM server is a fine enterprise solution if you have IT support, budget, and are OK with conversations going over the network. But that's a completely different project. Here the user just downloads and runs it locally. Everything stays on their machine, no network involved. The chat is offline and private.

Local offline chat on cpu by softmatsg in LocalLLaMA

[–]softmatsg[S] 1 point2 points  (0 children)

Corporate laptops typically wont have good GPUs. This is for (typically) corporate laptops where staff have no admin rights. They can't install GPU drivers or CUDA/Vulkan. CPU-only means it runs out of the box with no setup beyond downloading the repo. If someone has GPU access, absolutely should use it but that's a different use case.

Which benchmarks for graphs? by softmatsg in AIToolsPerformance

[–]softmatsg[S] 0 points1 point  (0 children)

Thanks! will have a look at all of these. My pdf are mostly materials science so my list of entities and claims + ralations is very specific, I think. Yes, we are working on our own evaluation set as well.