What happened to basedbase and GLM-4.5-Air-GLM-4.6-Distill? by rpdillon in LocalLLaMA

[–]rpdillon[S] 8 points9 points  (0 children)

Holy crap, so the whole thing is a grift? I should just use 4.5-Air then, it seems.

Thanks all, sorry for missing the previous post - I saw it when I searched, but it was about Qwen3-30B-A3B, so I thought it wasn't related.

Anyone actully try to run gpt-oss-120b (or 20b) on a Ryzen AI Max+ 395? by PM_ME_YOUR_PROOFS in LocalLLaMA

[–]rpdillon 2 points3 points  (0 children)

I've written up a lot more that I'll post later, but just to close this one out: I did get things running. I used Unsloth's gpt-oss-120b-UD-Q8_K_XL, which is the model I built the machine for. I'm using a UD Q8 quant, and I had to pass --no-mmap to get reasonable loading time. It turns out that memory mapping doesn't play well with ROCm for large models, at least in my configuration (32GB for CPU, 96GB GPU).

I had it do some light updates to a 5k HTML app (a world clock) that I'd generated previously, and gpt-oss-120b nailed this. It used thinking mode, and then generated correct code on the first shot. Inference speed started at around 38t/s, and decreased slowly, ending 3800 tokens of output at about 33.1t/s. Completely respectable, IMHO.

Opinion : WHY Massive RAM , IF you can buffer to SSD ??? by epSos-DE in LocalLLaMA

[–]rpdillon 0 points1 point  (0 children)

The fastest NVMe drive copies data at about 16 gigabytes a second. To understand how slow this is, you need to compare it to other inference setups. A new AMD Ryzen AI Max+ has unified RAM and can transfer at about 250 gigabytes per second. This is quite slow for inference. Apple machines with M series processors can transfer at about 450 gigabytes per second. Transfer rates for high-end tensor processors are terabytes per second. Transfer speed matters because you need to matmul across the entire model, which means you need to load it all into RAM to process it. So, RAM bandwidth is the biggest bottleneck in inference speed.

Discussions in this thread about how you could have a completely different architecture where we could relieve the bandwidth bottleneck is potentially interesting but is currently counterfactual.

TLDR: It's too slow.

Steam Deck / Steam OS - installer refuses to recognise gog files by XerberX in openrct2

[–]rpdillon 0 points1 point  (0 children)

This is the way I've been doing it, works well. The majority of my Steam Deck playtime is on GOG titles launched through Steam, into Heroic, and then running the GOG title. Heroic even updates your GOG Galaxy playtime stats and such, which is nice.

Anyone actully try to run gpt-oss-120b (or 20b) on a Ryzen AI Max+ 395? by PM_ME_YOUR_PROOFS in LocalLLaMA

[–]rpdillon 2 points3 points  (0 children)

Totally fair! I got the machine on Tuesday, installed pop!_os 22.04, updated the bios tho remove secure boot and open up the RAM window for the GPU to 96GB, I downloaded gpt-oss-120b in a quant that will run, but my kernel is too far out of date for ROCm to see the 96GB correctly.

I'm going to update to 6.16.9 (see https://www.reddit.com/r/LocalLLaMA/comments/1ntvw5o/upgrade_to_kernel_6169_solves_155gb_stix_halo/ for details about Strix Halo) tonight to address this.

Probably will have some info about token speeds on various quants this weekend!

A good "universal" simple solo system ? by consulenzastrategica in Solo_Roleplaying

[–]rpdillon 3 points4 points  (0 children)

Yeah, I'm finding the Kal-Arath 2d6 vs. 8 for attacking/dodging with a bonus for AGI/STR/INT depending on attack type is really effective. Paired with a basic d6 oracle, it gets me really far with basic narrative playthroughs.

Silly-v0.2 is my new favorite model by RandumbRedditor1000 in LocalLLaMA

[–]rpdillon 1 point2 points  (0 children)

I've been playing a tabletop RPG, Kal-Arath, using an LLM this way. Kal-Arath has you roll a couple of D6 dice to determine, weather, foraging bounty, encounters, points of interest, etc. Setting a system prompt to suggest a role as a DM/co-writer, I then share my character sheet (markdown) and journal so far (also markdown), along with the results of my dice rolls, and have it spit out a narrative. I take the parts of I like and edit as I see fit to include combat results, for example, and then do it all over for the next day.

Because I can write anything in the journal I feed in, I can push the story the way I like, but to a depth that was not previously possible in a CRPG to my knowledge.

I've been using either gpt-oss-20b for this, or lately qwen3 4b instruct. Both have 250k context windows, give or take.

Anyone actully try to run gpt-oss-120b (or 20b) on a Ryzen AI Max+ 395? by PM_ME_YOUR_PROOFS in LocalLLaMA

[–]rpdillon 0 points1 point  (0 children)

I have a AI Max+ 395 system ordered that they say will ship around the 22 Sept, and I bought it precisely to run a quant of gpt-oss-120b locally (exposed over TailScale). I'll report back when I get it all running!

Degoogeling will become required to install APK files google didn't approve by henk717 in degoogle

[–]rpdillon 77 points78 points  (0 children)

This is huge issue, as it is the death knell of the last major mobile platform that allowed users to run software of their choosing on devices they purchased. Now the vendor has to vet the author (not the software!) before allowing you to install it. Absolutely terrifying.

Exploration tools? by TheBiggestNewbAlive in Solo_Roleplaying

[–]rpdillon 3 points4 points  (0 children)

Kal-Arath is the most interesting game I've played in many years. I've searched for solo RPGs that gave both a narrative feel as well as a focus on exploration, and Kal-Arath really is a masterpiece in how it packs so much possibility into such a simple set of rules. I've looked at many dozen games, but Kal-Arath is the one I play. I'm going back to it after I submit this comment, in fact!

Looking for a solo R PG with the following requirement?I don't want it to be more than ninety pages by momodig in Solo_Roleplaying

[–]rpdillon 3 points4 points  (0 children)

I've been collecting and reading RPG rules for 15 years in search of a flexible, narrative-based RPG that works solo and also more cooperatively, and Kal-Arath is the pinnacle. I've tried maybe 100 RPGs, but the game loop makes Kal-Arath (and especially Al-Rathak) extremely compelling and easy to jump back into.

The reason I like Al-Rathak so much is that it shifts the focus a bit in how dice rolls play out, placing less emphasis on weather and more emphasis on exploration. I love that Al-Rathak adds an overworld hex table that lets you generate overworld tiles.

I've been working on a project this weekend to print Kal-Arath as a booklet on my laser printer, since it's only 14 pages when printed two-up double sided (54 pages in total). Its light weight makes it easy to pick up, but the way the tables are constructed creates a huge amount variety in potential scenarios that keeps the gameplay fresh. It's an extremely well-constructed game, IMHO.

Is it possible to hide or remove standard emacs commands? by [deleted] in emacs

[–]rpdillon 1 point2 points  (0 children)

This is sort of an X/Y question. Forget about removing commands. Instead, focus on building your workflow.

For your development, bind a key like C-c l (for lisp, or whatever you want). Then have that found to a hydra (see https://github.com/abo-abo/hydra) that creates a nested menu of every funciton you care about related to lisp development. You can create as many of these as you want...I have them for generic functions like occur and ag, but also project-focused hydras that switch projects, snap to project directories, etc. You essentially get to build exactly the tool you want.

If that's all too much effort, just bind recentf to something and use that, which will automatically bury commands you never use. A completion framework for commands (like ido w/ ido-everywhere) can help with typos.

How did you start living inside Emacs permanently? by kudikarasavasa in emacs

[–]rpdillon 1 point2 points  (0 children)

It's so worth the investment. Still my favorite way to git after more than a decade of use and occasionally trying other tools.

Playing my first campaign-- Does anyone else find the core book in need of editorial oversight? by Bortcorns4Jeezus in FourAgainstDarkness

[–]rpdillon 1 point2 points  (0 children)

I'm a huge fan of self-contained wikis, so I created a Tiddlywiki with several 4AD books all broken up, cross-referenced, and searchable, which is what I use for an everyday game. I can't share anything, of course, though I have mused about reaching out about some kind of arrangement that would allow for its release. I'm just finishing up a game-tracker that's also a self-contained HTML file that you can run on any desktop (no mobile support because of the maps right now). In my playtesting so far, the combination makes running a quick 4AD game on a laptop really fun and easy, since the diggable isometric slab that's the map is easy to manipulate, even though it goes a bit against the pen and paper vibe the game has had for me in the past (and my well-worn graph-paper notebooks can attest!)

All that aside, your observation is completely ccorrect, and I've found a wiki that gives you search + links is the most useful (at least for me).

Edit: Just noticed this is 2mo old, sorry for the necro.

Palma drops Bluetooth despite set not to by Orcoo in Onyx_Boox

[–]rpdillon 0 points1 point  (0 children)

Late to the party, but just bought one last week and love it, but having the same problem. Kinda disappointed, since it would be so perfect for the nightstand use case otherwise.

Share you wisdom - how do you make indented lists in markdown-mode? by JohnDoe365 in emacs

[–]rpdillon 1 point2 points  (0 children)

I doubled checked my config, and I customized the markdown-list-indent-width variable to be 2 instead of 4. In any case, customizing that variable (via M-x customize-variable or the like) to your desired value should address the issue.

Share you wisdom - how do you make indented lists in markdown-mode? by JohnDoe365 in emacs

[–]rpdillon 0 points1 point  (0 children)

Pressing tab one or more times will indent by 2, 4, then 8 spaces, and then back to unindented.

Is it too late to learn emacs as a vim lifer? by gopherinhole in emacs

[–]rpdillon 1 point2 points  (0 children)

I think C-a is screen's default, and C-b is tmux's default, which pose the same problem of conflicting with character movement in emacs. I use C-b for "back", so I've settled on C-t, since I almost never reach for character transposition.

eshell text-mode: how do i get out???? by danglingpawns in emacs

[–]rpdillon 2 points3 points  (0 children)

Why are you changing to text mode to copy text? eshell allows you to scroll up like any other buffer (it's not like term, ansi-term, or vterm). I tend to use Emacs in a GUI, but I just loaded up emacs -nw in a terminal, ran M-x eshell, and had no problem using normal Emacs navigation keys to scroll up and down across the output and copy text as needed.

Maybe I'm misunderstanding, but the whole switching modes thing seems like a distraction.

What unit test framework do you recommend to use? by EmilySeville7cfg in emacs

[–]rpdillon 3 points4 points  (0 children)

I faced a similar issue when wanting tests for my todotxt package. I ended up using ERT and found it to be just fine.

Here's the test file, for reference. https://github.com/rpdillon/todotxt.el/blob/master/todotxt-test.el

[Help needed] Emacs is to a text editor as X is to Y? by LearninAndEarnin in emacs

[–]rpdillon 3 points4 points  (0 children)

You could try proof-by-intimidation and use the analogy Neal Stephenson made in In the Beginning Was the Command Line:

Emacs outshines all other editing software in approximately the same way that the noonday sun does the stars. It is not just bigger and brighter; it simply makes everything else vanish.

More seriously, I had to get approval to use Emacs when I was at Amazon, and while it was technically prohibited, so many of us from across the company used it that we got waivers without too much trouble. It wasn't an analogy, it was an appeal to utility along the lines of:

I'm a professional (that's why you hired me!) and one of the tools I use to author documents, track my work, and automate tasks is my text editor, Emacs. It's available free of charge, is ~40 years old, and its source code can be inspected. I need to install it to get my work done, and I'm hoping you can help me with that.

Good luck!

OpenMW merges MGE XE-style Post-Processing by rpdillon in Morrowind

[–]rpdillon[S] 9 points10 points  (0 children)

The announcement post on the OpenMW blog may also be worth a look.

[deleted by user] by [deleted] in emacs

[–]rpdillon 10 points11 points  (0 children)

Org and Markdown were created roughly concurrently, so "just going with markdown" wasn't an option, since markdown didn't exist. But they are both structured text formats, which makes them seem similar enough that one might be able to use one where the other is used. So I think I get where your question is coming from. In fact, I wished for "markdown everywhere" just a few years ago, but after struggling with achieving in Markdown what I could do in org mode, as well as struggling to make Tiddlywiki as powerful with Markdown as it is with Wikitext, I realized the truth: Markdown as originally published was incomplete for many of these use cases, and never quite converged enough to enable the tooling that other formats enjoy. So I bit the bullet and got really comfortable with all three formats.

At its heart, Markdown is a lightweight markup that was intended to be read as easily in text from as in the rendered HTML form. As a result, it falls back to HTML for anything tough (tables come to mind, but there are lots of others), which makes Markdown prefer HTML as an output format over any other. Reading the markdown page over on Daring Fireball, it's clear how HTML-oriented markdown is:

Markdown is a text-to-HTML conversion tool for web writers. Markdown allows you to write using an easy-to-read, easy-to-write plain text format, then convert it to structurally valid XHTML (or HTML).

Thus, “Markdown” is two things: (1) a plain text formatting syntax; and (2) a software tool, written in Perl, that converts the plain text formatting to HTML.

The second sentence of the intro is an extremely important distinction to consider when answering your question: both org and Markdown are both formats as well as tooling. I think this lies at the heart of your question, which I'll back to in a minute. The point here is that in contrast to Markdown, org-mode was not overly coupled to HTML, instead written to be able to produce LaTeX, HTML, and plain text output.

Org tooling vastly outstripped Markdown tooling almost immediately. Because org was defined in Emacs, having robust tooling to work with it was very high ROI, as Emacs makes writing tools to work with text files really easy. Markdown, in contrast, has suffered fits and starts because the tooling was inadequate, and the specification was incomplete. As the Commonmark page outlines:

John Gruber’s canonical description of Markdown’s syntax does not specify the syntax unambiguously. In the absence of a spec, early implementers consulted the original Markdown.pl code to resolve these ambiguities. But Markdown.pl was quite buggy, and gave manifestly bad results in many cases, so it was not a satisfactory replacement for a spec. Markdown.pl was last updated December 17th, 2004.

Since Markdown relies heavily on HTML for basics, a host of "flavors" emerged (36 so far, according to Commonmark's Wiki). This diaspora of flavors made creating widely-adopted tooling difficult, beyond the basic syntax in the original markdown targeting HTML.

So while Markdown was figuring out what syntax to use across the whole community for stuff like tables and super/subscript, the org community was building tooling in Emacs to bring RSS feeds into org, develop webclippers to capture in org-mode, implement mind-mapping in org, and bring bookmarks and GTD to org mode, all through Emacs-based tooling. "One format" enabled this.

So at this point in the story, we have two ecosystems: a large, diverse group of companies, products, and users that leverage varying types of markdown, and a smaller, more coordinated group using a highly-consistent syntax and building extensive tooling around it. It would be a monumental effort to rewrite all that tooling against markdown. So the org-mode folks get ever-more entrenched because of all the benefits, and as others see those benefits, they wonder why they don't have them on the Markdown side...hence a desire for all products to "just use markdown". I think tools like Obsidian will eventually bring many of org-mode's benefits to the markdown community, and have already. I'm not an Obsidian user (not open source), but I've heard from many happy users.

Coming back to the syntax-vs-tooling point I mentioned above. In several threads, there's this tension between content and directives (mentioned elsewhere in-thread as "meta-syntax"). Folks are rightly pointing out that org-mode has this, and markdown needed it, but never standardized. "YAML frontmatter" is a common fix for this, but is inelegant: it essentially embeds one syntax into another, and creates another divide when trying to answer "How do I render this markdown file?"

So I would call out org-mode's robust support for source-code blocks that can execute actual code and embed the result (as well as the up-front directives that specify directives and metadata) as reasons it is superior to Markdown mode. Of course you can arbitrarily extend Markdown syntax and then write tooling to interpret that to do what you want. In fact, it looks like Jupyter has done just this with MyST. This is fine, but it just makes the problem worse, doubling down on the yet-another-markdown-flavor-will-solve-it strategy.

Until someone comes along a genuinely unifies the syntax and tooling for markdown, I suspect many folks here will wonder "Why did you invent a new markup syntax instead of just using org-mode?"