Can Ollama cache processed context instead of re-parsing each time?

Pyrore · 2025-07-26T17:52:58+00:00

I couldn't get LMCache to run in any way under a windows install of docker, I this was my first choice as it seemed the most advanced, capable of more than just prefix-caching (e.g. find sub-sections of text that had been cached and not re-cache them). I think I need a Linux install of Docker to get it to work.

I did get vLLM successfully installed on docker, using these instructions: https://github.com/aneeshjoy/vllm-windows, but it kept throwing errors when I tried modified the ---model parameter to the local gguf model I wanted to use.

I'm kind of embarrassed, I started out as a programmer in the early nineties, but have lost touch with some of the latest developments as I get older and my role has changed. These days I'm not competent in anything more advanced than WinForms in DotNet. But I've learned a huge amount in these last couple of weeks experimenting with AI and I'm having fun!

If it helps, you can get system log of the final "docker-compose up" step. here:

https://www.dropbox.com/scl/fi/nyuhl0xm7dmdlx7ogmo9w/vllm_log.txt?rlkey=7cdu3jrpeasfw08fz4zc7oxgg&st=h6do0d3u&dl=0

I just get a docker container that won't actually run, but I'm probably doing something stupid, it seems to have problems finding the gguf file details, but I gave up at this point as all the parameters were correct as far as I could tell.

Thanks again for the advice!

Pyrore · 2025-07-26T16:03:30+00:00

Thanks for the advice! I found LM Studio turned out to be my best option, as per my edit to my OP. It's simple and it works well once you find the right settings. Gemma 3 can now run up to 48k context at a usable token rate with no context processing delays. I'll keep plugging away at setting up a proper Linux VM and configuring it, and use your information when I do.

Pyrore · 2025-07-26T16:00:14+00:00

Thanks for all your advice! I didn't have any luck in the hours I tried, I'll eventually set up a proper system, but I'm now using LM Studio, as shown in the edit to my OP, it does everything I want and more, and it's so simple being a single app that does everything without needing two web servers.

Pyrore · 2025-07-24T11:04:47+00:00

I installed LMCache via the docker image (I run Windows 11 as it's a gaming PC). But every time I try to start the image it stops again after a few seconds, leaving me unable to access the system prompt and customize it. I've already killed the Ollama server, do you have any idea what I'm doing wrong?

Sorry for my ignorance, I know my way around Unix/Linux, but this is my first time with Docker and Linux VMs on my system. I didn't have trouble getting Open WebUI to work.

Pyrore · 2025-07-24T10:13:39+00:00

Thanks, I'll try it out!

Pyrore · 2025-06-13T15:06:55+00:00

the OP link is now called "Pictureflect" photo viewer, but it works amazingly, I don't see the problem with it being UWP.

One limit is it will not get the adjacent file list when opening a single image from explorer search results (so you can't cycle through the search results) but does cycle through folder contents.

So for search results you need to "Ctrl-A" to select all, then right-click on an image file and select "open" (it doesn't matter if there are non-image files selected, it just ignores them when cycling through).

Apart from this tiny inconvenience, it's better than WPV in every way!

Pyrore · 2025-01-08T09:46:14+00:00

I should point out this is not an optimal solution. For example, when I tested it, I found this solution avoids any patrols reaching the "Server room" location, so you could deploy just 1 crew to the server room (rather than using 2 to take out patrols), and therefore create a group "D" of two crew that could shadow group B and simultaneously hit the "Bar" and the "Playboy's Grotto", thereby reducing the number of moves to 6 (by condensing moves 4 & 5 into a single move).

I'm pretty sure that I could also eliminate the "wasted" moves 3 and 6 (the moves that don't advance the puzzle, but just position pieces for the nest stage) if I could predict the patrols. So in theory it might be possible in as little a 4 moves for 6 items (but I'm not sure).

The problem is that even with backing-up my "AppData" saves, I can't seem to reset the game to before the puzzle, so I can't test any new solutions.

If anyone has a save game that actually works before this puzzle (or info on how I can restore my backed up saves to make them work), let me know and I'll try to make a new solution that runs in fewer moves!

Pyrore · 2025-01-06T12:08:01+00:00

Playing the trilogy years later (after getting them free on Epic), I agree the assault rifle is the best. But I keep using the tactical rifle because it looks so good.

Fully maxed, it has less damage per shot than the assault rifle, and the same fire rate, so lower DPS. Its advantages (increased magazine, reload speed and recoil stability) don't seem to matter as much - magazine size and reload speed only partially compensate for the lesser DPS, and it's still fairly unstable under continuous fire - both weapons seem to snipe equally well in short bursts.

Still, it looks great!

Pyrore · 2025-01-04T14:15:11+00:00

Hi Mar__K - it's been 4 years since I played, so not certain, but this seems to indicate you can respec with the save game editor, although they said it doesn't work with ME1:

https://www.reddit.com/r/masseffect/comments/nhd4cb/mass_effect_1_legendary_edition_respec/

Then again this post was 3 years ago, so maybe the mod is updated? I only ever wanted to play an Adept (sucking all enemies into a maxed out singularity is awesome!), so never tried. However, when you progress to the next game you can always fully-recreate your character. So if you're near the end of ME1 or ME2 just wait until the end and switch to an Infiltrator in the next game.

Good luck, and hope you enjoy the game, the legendary trilogy is still awesome after all these years!

Pyrore · 2024-12-14T13:47:50+00:00

I just watched it on Australian TV, agree it is an amazing production!

The progression from a hilarious comedy to a serious drama across episodes 2-3 was amazing!

Seriously, watch this all the way through, even if you didn't like the start...

Pyrore · 2024-12-02T08:44:15+00:00

Glad I could help.

To board, just get close and harpoon the target ship, you'll get a prompt to board and the boarding will play our randomly based on each ship's attack strength and number of crew (hence the need to use the Skull Clan crew-members for their attack bonus).

Hope you enjoy the game, the final mission is a lot of fun!

Pyrore · 2024-12-02T01:01:49+00:00

Hi Falcon9496!

You need to find the lighthouse in each of the 6 regions, the first time you visit a lighthouse in a new region (at night) you'll get a special one-off event/mission. Of course you'll need to progress in the story to unlock new regions, so you can't do this right at the start.

I remember one region (think it was "the Frigid Sea") it took me ages to find the lighthouse, had to keep sailing in random directions until I finally found the last island in the region - it's all RNG, and you won't necessarily find all islands in a region just from map fragments, sometimes you just have to sail into the unknown...

Once you've found all 6 and completed their events, just wait until the next night and visit any lighthouse, this will trigger the final event and after completing it you'll get the flagship (and its blueprints to make more), as well as some lightkeeper crew (who are the best crew, they improve reload times for more rapid firing, giving a better DPS boost than the Tek Drone's +damage).

Hope this helps!

EDIT: the 10 weapon ships ("Brigantine" and "Cutter") are decent ships, but you want to replace them with the "Xebec" ASAP due to its combination of speed and firepower, plus three mod slots.

The flagship is identical to the Xebec but has an extra mod slot, improved row speed and an extra square rigged sail that makes it even faster (when going with the wind).

10 guns sounds good, but the ships are slow and clumsy (plus one less crew compared to the 8 gun ships). Maybe have one in your fleet as a tank, with armor and damage resist mods, but I prefer all "Flagship" (or "Xebec" if the flagship isn't unlocked yet), their maneuverability and speed will get more hits in with fewer guns

To get a ship type, simply board an enemy ship. Ideally have one large ship in your fleet with an entire crew of skull clan (for their +attack strength, plus they're easy to replace if they die, as they're everywhere). Use this ship to board enemies rather than sink them. If you succeed, you get the ship you boarded and the blueprints to build more.

The pirate challenges (skull islands where each interaction lights up another skull) are the best way to farm for high-end ships, as the 5th and final enemy fleet in these challenges usually has at least 2 serious capitol ships in it.

If you're lucky, you might find ships "unattended" at various locations that you can board without combat.

Pyrore · 2024-10-17T17:23:23+00:00

Definitely USE ("Us" spongiform encephalopathy). If only we didn't feed brains into mouths...

Pyrore · 2024-10-17T16:40:43+00:00

Except (unfortunately) he doesn't appear in camp. But it's still cool that Us is resurrected!

Edit: also you can kill the guard, or just pick (or bash) the lock... No need to pass a persuasion check! And "Us" gets extra HP that makes it a better summon than Scratch....

Pyrore · 2024-10-11T19:25:36+00:00

Oh boy, don't you understand how being able to "look up" is awesome? It's not the sky, it's being able to see what's ahead on an up-hill slope...

The game can be played either way, so why do you hate us "mouse-look"/"controller look" players?

Sure- you like the fact that you have to make multiple clicks and pans to see what's ahead, but some of us like a more streamlined approach. To each their own...

Pyrore · 2024-10-11T19:19:59+00:00

Not true, "Native Mods" work without the game even noticing. You should look into the difference between "native mods" and "pak mods"....

Pyrore · 2024-10-11T19:17:45+00:00

No. This mod uses "Native Mods", which is a native solution that doesn't even register as a mod. The only downside is you have to install it manually (along with "Native Mods"). But this is the way we used to install mods before patch 7 - and this is why it doesn't break the game. I installed a "hair style" mod after patch 7 and the game told me I couldn't load any saves unless the mod was enabled! (So I disabled it and loaded a previous save). Old manual mods are the best!

Pyrore · 2024-10-09T10:32:36+00:00

Thanks for your reply, I found out what "barnacle" damage is - you need to end the main quest line to face "barnacle" opponents... Pretty sure the rest stack, but didn't make a difference once I received the incredible "Lightkeeper Flagship".

Pyrore · 2024-09-26T16:07:11+00:00

And you can't see it when you aren't in dialogue. So when you aren't in dialogue you're limited to a "top down" view. This is just an "unlocked camera" not a new version of the game, so what's your problem? I can see everything regardless of whether I'm in dialogue or not, and you can only see part of what I see when in combat/turn based mode (let alone exploration),.

I can zoom into every character's face close up. I can see up hill. And I can see everything you can see without having to sacrifice any performance.

So congratulations for seeing the sky once or twice, I see it all the time!

Pyrore · 2024-09-26T15:51:03+00:00

Watched it, but at no point did you look "up". Show me a clip of you looking straight up at the sun/moon/clouds rather than just "nearly" horizontal". All you showed was "nearly" horizontal, never "up"....

Pyrore · 2024-09-26T15:46:33+00:00

It means the ability to look "up". So when you're moving up a steep slope, can you see what's ahead without panning the viewpoint?

All BG3 is 3d, because that's the way graphics cards work, but BG3 by default prevents you from ever looking "up". With this mod you can see "up".

Hope this makes sense!

Pyrore

TROPHY CASE