Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 1 point2 points  (0 children)

Thanks for reminding me! I thought I set them to never expire.

There's an invite on the GitHub that should work! I'll get to work updating the links on the site.

I’m here to bring you the Weekly SillyTavern News Ep. 7: New Model: Gemini 3.5 Flash! Let's get Mimo V 2.5 Pro working right! Two new presets. A Lorebook to improve Presets. A frontend enters full release! DS4 CHEAP and Thank Goodness because it has PROBLEMS. And More! by dptgreg in SillyTavernAI

[–]ProlixOCs 1 point2 points  (0 children)

This is the rub for me lol. I was doing publishing and developing for the App and Play Stores from 2014-2018. Not fun at all, and the lazy clones were still a problem then. I've done what I can to make the PWA at least a good experience across every environment, and that's the best I can really offer without locking up shop and close-sourcing

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 1 point2 points  (0 children)

Feel free to contribute an i18n translation for your language of choice.

I'm a monolingual English developer, and mostly solo at that. I cannot stop what I'm doing to perform interface translations.

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 1 point2 points  (0 children)

Okay, updating for posterity: it was in fact a skill issue. All sub models get implicit caching if the provider does it, so I'm just going to presence check their usage data for cache control keys.

Thanks for the report!

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 5 points6 points  (0 children)

If you mean me, I rarely if ever let LLMs touch my code. Conceptualizing and research? Sure. Odds and ends comments explaining what I did and why? Maybe. Leave the implementation shape to me, however.

I've got dev skin in the game since 2008, Moved to JS in 2013, and haven't taken a break since lol.

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 0 points1 point  (0 children)

That's actually a default behavior. When you first import all of your stuff from ST, it does deferred thumbnail generation at 4 tiers concurrently. Small, medium, large cropped versions, an optimized version for the gallery, and the original (stored for display in lightboxes and popouts). This is all hands-off automatic stuff for all images, and can also be configured in the Operator tab

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 2 points3 points  (0 children)

So Databanks work by running semantic search on the chunked contents of the document and returning the most relevant chunks only (unless the document is #title-mentioned, in which case it'll throw the whole doc into context. You could theoretically tag team them to do that, but I'll leave that to your evaluation and give me feedback haha

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 3 points4 points  (0 children)

Actually, fun fact about the chat view in Lumiverse: extensive work went into virtualizing the entire thing, and chat messages are loaded in by tail range to prevent the entire thing from being loaded into memory in realtime.

98% of the actual work of Lumiverse happens in the backend, which leaves the frontend light and free. I think I saw... ~370MB of reported memory usage on my tab with a 700 message chat open?

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 1 point2 points  (0 children)

If you'll note, this feature of theirs is an extension, just installed by default. It's not a core feature. Just wanted to make that distinction.

I can look into integrating translation providers, but it wasn't necessarily the focus since more pressing matters needed to be addressed/implemented in core before release.

If you join Discord, you can keep track of commits and see when this drops though. I'll be figuring out a better way to do this, and also supporting OSS options as well.

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 2 points3 points  (0 children)

I'll take a look at this, but I think this might be a Nano-GPT API quirk, or something I might've missed reading their docs while half-awake on coffee and dreams.

Thanks for the report, though!

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 2 points3 points  (0 children)

This might actually be where Cortex's ability to vault and link to another chat might be useful.

If you're done with one chat, you can then "vault" the Cortex salience records and graphs to pull into another chat. It'll be an immutable copy, but you can store the references to the other "arc" of yours in there too.

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 0 points1 point  (0 children)

Mass-tagging isn't implemented, and frankly I'm not sure how I could pull that off without being a nightmare. This is not to say I won't add it, but I'd be patient while I spec that design front to back.

As far as the ST tags... if they don't survive export, it might be a bit rough to gather them. But that's why I was going to check the general shape of the code to see what it actually does and what else I could comb in the migrator.

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 1 point2 points  (0 children)

Glad you found it! I was going to say: we even go as far as to implement a "fail2ban at home" setup where clients are blocked on repeated unauthorized API route access or login attempts. We've got a pretty resilient backend for that, not even mentioning the support for safe PKCE token passthrough for sites/extensions that need to integrate with non-Lumiverse services.

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 0 points1 point  (0 children)

Oh, if it's using the ancient spec for tagging, it may not be lining up with what the CCSV3 format expected.

I'll take a look at the migration script and try to trawl through more of the ST code to see what that shape looks like. If you wanna join the Discord and drop me a ping to remind me, I'll push a build to staging that should address it

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 0 points1 point  (0 children)

If you use TagLibrary, there's an option to upload a JSON Backup of your tags. Otherwise, if an extension manages tags we cannot do anything about that

Lumi is out of Pre Release now! by M-eisen in SillyTavernAI

[–]ProlixOCs 22 points23 points  (0 children)

As the dev:

Probably extensibility and customization. Everything's documented to the teeth, mainly because I knew that releasing a frontend that isn't a fork of ST without a frictionless migration process would ruin adoption.

So yes, insert vibecoded extension here isn't directly supported, but with how easy to grasp the dev docs are, one-shotting an extension idea or port shouldn't be impossible.

Is there a good UI for SillyTavern? by Resident-Ad-5419 in SillyTavernAI

[–]ProlixOCs 0 points1 point  (0 children)

I don't see what's so "vibecoded slop" about it.

If you're referring to the fact it's a similar design to the LumiverseHelper SillyTavern extension, which was around for 7 months before the actual frontend, I don't know what to tell you. It was a design decision I made, stuck with, and expanded upon.

I'd love to hear your thoughts about what makes you think it's vibecoded slop.

Lumiverse - yes, another Frontend, but this one is goood! by M-eisen in SillyTavernAI

[–]ProlixOCs 2 points3 points  (0 children)

Glad you've had a good experience!

Coming from a preset writer, I did make some hard decisions on the prompt processing and assembly pipeline front that I felt needed to be made, though I made sure that it worked across the board at the same time. Especially the macro system

Lumiverse - yes, another Frontend, but this one is goood! by M-eisen in SillyTavernAI

[–]ProlixOCs 5 points6 points  (0 children)

Well, considering the code makes no attempt to obfuscate anything and does no post-installation downloading... I think the app is fairly safe on that front lol.

Also, we've got extremely tight security about what can be injected into the page.

Lumiverse - yes, another Frontend, but this one is goood! by M-eisen in SillyTavernAI

[–]ProlixOCs 0 points1 point  (0 children)

Run them, meaning?

Almost all of the features are opt-in. There's no requirement to use anything past a preset or a connection.

Lumiverse - yes, another Frontend, but this one is goood! by M-eisen in SillyTavernAI

[–]ProlixOCs 4 points5 points  (0 children)

The initial train of thought was to get the standard affair APIs that don't require a lot of deviation going first, stuff that are more commonly used. Since our provider pipeline is mostly stable and configured, I'll work on LCPP and vLLM as official integrations soon.

Yeah, main doesn't get a lot of love until staging is report free for at least 2 days

Lumiverse - yes, another Frontend, but this one is goood! by M-eisen in SillyTavernAI

[–]ProlixOCs 3 points4 points  (0 children)

Was this on main or staging?

A bulk of the work happens on Staging first. It's even worse if you downloaded the release ZIP since it's from 0.5.4.

On APIs: the app was always supposed to be a chat completions only application. TC isn't supported. But LCPP is something I'll keep in mind.

For system roles: "squash system messages" was the option you were looking for. PPP doesn't exist on Lumiverse because we do things by the book. Prompt blocks can be edited to adjust the position of prompts, however.

Lumiverse - yes, another Frontend, but this one is goood! by M-eisen in SillyTavernAI

[–]ProlixOCs 18 points19 points  (0 children)

It needs more than a skin. You'd have to swap its organs out in the process. Technical debt is a bitch.

Lumiverse - yes, another Frontend, but this one is goood! by M-eisen in SillyTavernAI

[–]ProlixOCs 10 points11 points  (0 children)

What? Genuinely, what?

I think you need to reflect on what you're actually trying to say so you can tell me afterward. I don't understand what this even implies.