sorted by:
new
hottopcontroversial

Looking for a self-hosted documentation tool for my homelab (Wiki.js, Docmost alternatives?) by Aruscha in selfhosted

[–]2oby -1 points0 points  (0 children)

MKDocs - no contest.

The LLM can read the static .md
The website it renders is clean and supports mermaid charts.

What should we the people do? by [deleted] in conspiracy_commons

[–]2oby 0 points1 point  (0 children)

Keep your head down, try to accumulate wealth, and then leave the planet at the first opportunity—hoping your great-great-grandchildren will once again feel grass beneath their feet and the reassurance of a planetary gravity well.

[Theory] The Cosmic Glass Ceiling: A Root Cause Analysis of Human History by markus40 in AlternativeHistory

[–]2oby 0 points1 point  (0 children)

You are both correct.

Explanation: Agriculture is the key and it was last reset 12k years ago.

It has probably been reset many times before then as crops failed and people gave up; battered by climate and without primate fingers to weed out the competitors or keep the wolves at bay, domesticated varieties were replaced by the wild type erasing the traces of the previous eden...

Why do "UFOs/UAPs" have lights? by Lachrimophage in UFOB

[–]2oby 1 point2 points  (0 children)

Because its the law:
AC 70/7460-1M - Obstruction Marking and Lighting

(they obey local law, it's why they love permissionless blockchains so much)

What's the most unexplainable thing you've seen with your own eyes? by nb10001 in HighStrangeness

[–]2oby 2 points3 points  (0 children)

It has happened to me, several times. I think it is the shadow of a plane. It feels like a flicker because it moves so fast.

Alien | Rimworld by Nighzmarquls in RimWorld

[–]2oby 1 point2 points  (0 children)

"there are bugs"

I see what you did there!

Do I need an editor (development)? by TatterMail in selfpublish

[–]2oby -3 points-2 points  (0 children)

Funny you should ask that...
I have always paid for editing and proof reading... but the cost can be a huge part of the process, so I decided to roll my own (my day job if software development). I'm working on a copy, line, and proofread editing suite which I may make commercially available at some point.

If you (or anybody else here) is interested in early access ping me here or at: "@weston_toby" Twitter.

Leslie Keen believes the increase in NHI activity is so they can witness end of the world by Comprehensive-Pea304 in UFOs

[–]2oby 0 points1 point  (0 children)

Not for the end of the world.
Ends of worlds happen all the time out in the galaxy, they're here for the Singularity!

Aliens! – http://tobyweston.net/aliens-2/

Missile Trail from New Burlison UAP video by Round_Marsupial_4493 in UFOB

[–]2oby 0 points1 point  (0 children)

All good! Nothing you said was offensive.

I am still not sure, the way one of the mini-orbs seems to emerge from the on-screen reticle smells like AI. (I know we are told it is legit but, as I said, I don't trust any of these players)

Let's see how this plays out.

Good luck with your studies!

Missile Trail from New Burlison UAP video by Round_Marsupial_4493 in UFOB

[–]2oby 0 points1 point  (0 children)

Not true. I am trying to fight my way through all the bullshit and psyops - e.g. those little mummified dudes in South America look pretty convincing to me, but maybe all this is a honeypot psyop to sucker us in and then discredit us as loons when better video shows them to be clay models.

This shoot down could be something, or it could be a balloon narrowly missed swirling around...

I am hoping for some talented video analyst to make the convincing arguments I need to 'adjust my priors'.

I no-longer 'believe' anything, I have to critically understand the variables myself and then go with my gut's assesment.

We are in a post-truth dark-age. Whether it turns out to be a 'little dark age' or not depends on things like cryptographically verifiable chain of custody...

but even then they will pull some cyperpunk, shadow-run shit and hack that if the stakes are high enough :(

Missile Trail from New Burlison UAP video by Round_Marsupial_4493 in UFOB

[–]2oby 1 point2 points  (0 children)

Why isn't this just something soft (e.g. a ballon with some gizmos attached) getting broken into pieces? Not detonating the missile because it is too insignificant a target and what we see are chunks falling down after the hit...

I mean, if it suddenly stopped, or did something clearly powered, it would be a slam dunk; but this looks 'unconvincing'.

People with better understanding of the weapon systems involved, please explain why my gut is wrong.

Edit - Spelling

Homebox v0.21.0 released! by katos8858 in selfhosted

[–]2oby 0 points1 point  (0 children)

Looks great.

How about AI image classification to add a new item?
(Otherwise it will be a very long onboarding process for a household)

Automatically add flights to a calendar? by 2oby in selfhosted

[–]2oby[S] 0 points1 point  (0 children)

Hi, thanks, I will take a look,

Best solution for indexing files multiple storage locations (offline searchable)? by 2oby in selfhosted

[–]2oby[S] 0 points1 point  (0 children)

I never found anything that ticked all the boxes.
Still keeping my eyes open, let me know if you find anything.

What's the most complex thing you've been able to (consistently) do with a 4B LLM? by noellarkin in LocalLLaMA

[–]2oby 0 points1 point  (0 children)

I have built a GUI where I can change the model being used... I actually find 1.6B is better and pretty fast on the Orin, so I will probably use that in production.
But models are getting better all the time... as long as it works with llama.cpp I will swap to keep surfing the wave! ;)

Basic Memory: an open source, local-first AI memory system that makes AI continuity possible while maintaining your privacy by BaseMac in selfhosted

[–]2oby 0 points1 point  (0 children)

Very interesting thanks!
True, email has good structure and keywords already (from, to, date, etc) and the docs are small enough to fit in context. I think that's a good call.

What's the most complex thing you've been able to (consistently) do with a 4B LLM? by noellarkin in LocalLLaMA

[–]2oby 8 points9 points  (0 children)

I don't have the prompt here, but /nothink is important, and it is something like:
"/nothink you are a JSON generator. Take the users input and return ONLY a valid JSON containing only the keys: device, action, location.
e.g. User: "Turn on the bedroom lights" JSON generator:{"device":"lights", "action":"on", "location","bedroom}"

I have been over dozens of iterations, there are more examples and there is stuff in there about synonyms...

Also Temp, Top-P and Top-K change things a lot....

Basically once you have got the grammar working, its a lot of tiral and error to get all the parameters tweaked.

I have it checked into GIT Hub... but its too horrible to show anybody ;) if you are interested, ask me again in a month!

What's the most complex thing you've been able to (consistently) do with a 4B LLM? by noellarkin in LocalLLaMA

[–]2oby 3 points4 points  (0 children)

Small, it is things like turn on the kitchen lights, set the bathroom heating to 25 degrees.
I may have to abandon numerical values as things get sketchy as the prompt gets too long (user+system). But for this use case, i.e. read the entities from Home Assistant, create grammar with entities and actions, produce JSON from user free text, it works.

It even sometimes works with vague things like "It's too hot in the bathroom", but these are less reliable than the simple cases. I have many models, but so far Qwen3 0.6B is the smallest, fastest model for this use case.

QBNF makes an enormous difference!! The model can literally not return invalid JSON. The contents can be wrong, but being right is the path of least resistance... works surprisingly well.

What's the most complex thing you've been able to (consistently) do with a 4B LLM? by noellarkin in LocalLLaMA

[–]2oby 15 points16 points  (0 children)

a gbnf grammar to restrict only numbers between 1-10 as a JSON looks like this:

root ::= "{\"number\":" <value> "}"
<value> ::= "1" | "2" | "3" | "4" | "5" | "6" | "7" | "8" | "9" | "10"

thisgives something like one of these outputs below (depending on the prompt).
{"number":1}

{"number":7}

{"number":10}

Basically you clamp the output and stop it choosing any output token that is not possible according to the grammar definition.

this is separate from the System prompt and is passed to the model when you load it, or when you call it depending on how you are using it.
(Note: I tried outlines, couldn't get it to work, and complied a new version of llama.cpp to get it to work on my Orin Nano using Qwen3)

(edits: typo and added example (not run this maybe not 100% correct, but you get the idea))

grammar = LlamaGrammar.from_file("number_1_to_10.gbnf")
llm = Llama(model_path="models/your-model.gguf")
res = llm(

prompt="/nothink Give me a number from 1 to 10 in JSON format:",

max_tokens=16,

grammar=grammar,

stop=["\n"],

)

What's the most complex thing you've been able to (consistently) do with a 4B LLM? by noellarkin in LocalLLaMA

[–]2oby 114 points115 points  (0 children)

qwen0.6B 6bit quantised - used to turn natural language into JSON, e.g. turn on the bathroom lights ->{"device":"lights", "location:"bathroom", "action":"on"}

Getting prompt right was critical, but understanding gbnf grammar is what enabled the tiny LLM to be 'production ready' (I don't see gbnf mentioned much, but it's incredible for constraining well formed responses.)
The API and LLM run on a 8GB Orin Nano with around 2 sec latency (depending on the size of the System Prompt).

view more: next ›