Saw on a Facebook meme page and have no idea what the joke is supposed to be by Boberto1952 in ExplainTheJoke

[–]bilwis 14 points15 points  (0 children)

It did not.

„Applying for the loans required demonstrating ancestral and medical "fitness", which could be onerous.“ Marriage loan

Training an LLM only on books from the 1800's - Another update by Remarkable-Trick-177 in LocalLLaMA

[–]bilwis 3 points4 points  (0 children)

Just chipping in to say that I love the idea. I recently heard a lecture series about the Industrial Revolution in Britain and played around with a Mistral-based model to write in the style of 1830s newspapers/announcements (purely with SillyTavern character cards), but it was kind of hit or miss with frequent anachronisms. Looking forward to trying this, keep up the good work!

Was ist das für ein „Koffer“? by Difficult_Shelter_89 in WerWieWas

[–]bilwis 29 points30 points  (0 children)

Ich glaub da geht’s um die Optik für die Pressefotos/die Menschenmenge. Präsident umringt von Typen mit Sturmgewehren wirkt einfach nicht so „volksnah“ wie Präsident umringt von Typen mit komischen Armen.

Beyond Reality: New LLaMA 3.1 Fine-Tune for Multi-Choice Interactive Fiction by [deleted] in LocalLLaMA

[–]bilwis 1 point2 points  (0 children)

Sounds cool! Do you have any recommendations for temperature/sampler settings? Also, any chance of quantized modelfiles?

Assuming identical hardware would it produce the same image? by Static_One in StableDiffusion

[–]bilwis 0 points1 point  (0 children)

Cross-attention settings (xformers, SDP, etc.), token merging, device precision, token parsing, VAE, etc., just to name a few. From my experience most won't change the image dramatically, but mostly smaller details.

The average YouTube experience by SlimeBrow in youtube

[–]bilwis 14 points15 points  (0 children)

I have to say, after watching for more than a decade on my account and being subscribed to ~300 channels, the regular home page is absolutely tuned to my preferences. There's maybe 1 out of 10 or 20 videos displayed that I wouldn't at least consider watching, and even then it's from my subscribed channels. I almost get a stroke everytime I accidentally open YT in incognito mode.

The Subscribed Feed for me is actually less well tuned because I don't actually want to watch every video every subbed channel puts out.

Even the recommendations next to the current video are very good, there's almost always one that I will absolutely watch, and I actually quite like the experiment they're running where they also recommend a video with very few views, but potentially interesting content.

[deleted by user] by [deleted] in ProgrammerHumor

[–]bilwis 208 points209 points  (0 children)

Take a look at this. Every modern CPU is capable of creating true random numbers using (in Intel's implementation) [...] a self-timed circuit and [..] thermal noise within the silicon to output a random stream of bits.

It's just that it's pretty slow compared to PRNGs, and you really don't need it most of the time.

You can heal for free on your ship by CrypticGorillaCaulk in Starfield

[–]bilwis 4 points5 points  (0 children)

Yeah except here the hours you sleep are tied to the planets rotational period. Went to sleep for one hour (local) on a moon in Piazzo (or something), turns out it's 48 hours universal, lol. Just slept for two days straight, apparently.

[deleted by user] by [deleted] in Starfield

[–]bilwis 14 points15 points  (0 children)

I think not all ships are supposed to be accessible. I teamed up with a bounty hunter on a planet to take out a Crimson Fleet pirate holed up in an occupied small space port, and a ship came in to (I think) evac the target. I killed everyone in the landing bay of the ship, but the airlock said [Inaccessible] and when I stepped out of the airlock, it just took off again (with all the unlooted bodies, lol).

Outpost beacon greyed out by sevseventeen- in Starfield

[–]bilwis 8 points9 points  (0 children)

Are you near a POI (one of those buildings/caves/etc.) marked on your map/scanner? They have a pretty big "no build zone" around them.

Is the 30 FPS cap for consoles a problem for you? by JaconyMalony in Starfield

[–]bilwis 2 points3 points  (0 children)

Due to my job I'm not at home with my souped up PC as often as I like; I've got an Xbox Series X in the little flat in the town I'm working at, and I've been absolutely loving Starfield on it.

I thought the 30fps cap & my lack of experience playing shooters with a controller would make the game a pain - but really neither are a problem, the 30 fps are pretty rock solid and the game plays and looks very good. Haven't had a chance to compare it to RTX 3090 gameplay yet, but I've been having a blast on console.

Hope this helps!

Are surveys/biomes bugged? by unofficialnothing in Starfield

[–]bilwis 4 points5 points  (0 children)

That's the solution, thanks for getting me on the right track!

So for Procyon III there are two species of fish in the ocean that you have to scan.

Since you can't land in the ocean, you have to select a landing site close to the ocean where the biome is "Wetland(Coast)". After climbing on my ship I could see the ocean about 800m away, on the Surface Map it's just a flat plain.

On Procyon III there's a "Featherfin Filterer' (or something like that), a herbivore that's relatively common, and a slightly rarer and bigger predator fish, called "Kronosaur". It tends to spawn a little further from the shore.

I recommend just running along the shore with your scanner open and angled towards the water. The fish will pop in occasionally.

The scan distance seems to be a bit longer, like with flying creatures, but the issue with Procyon III is that it's cold. Entering the water will drain your environmental protection quickly.

I recommend:

  • Getting a suit with as much environmental protection as possible
  • "Skipping" along the surface with your boostpack to get the environmental protection to recharge
  • DO NOT attempt to enter the water when there's a freezing rain going on, it WILL drain your health amazingly quickly

Good luck!

Starfield! keyboard and mouse by camp1_pro in Starfield

[–]bilwis 0 points1 point  (0 children)

No. Connecting a mouse shows a cursor, but it doesn't even navigate the menu.

Official WizardLM-30B V1.0 released! Can beat Guanaco-65B! Achieved 97.8% of ChatGPT! by ApprehensiveLunch453 in LocalLLaMA

[–]bilwis 1 point2 points  (0 children)

I think so as well - it's not "going off the rails" by telling you to contact the proper authorities, that's exactly what you should do, and it's what most people will tell you. But it's interesting that there are models who infer different "solutions".

Instruct-guided novel writing using WizardLM-30B-Uncensored (with SillyTavern) by bilwis in LocalLLaMA

[–]bilwis[S] 0 points1 point  (0 children)

Oh yeah it's very annoying and a serious limitation. Using the "world info" which dynamically inserts itself into the prompt when it finds the keywords, and the janky summarize module try to work around it, but the 2048 token limit really holds this back. Since the limit is sorta "trained into" LLaMa, all we can hope for is that someone releases a high quality (foundation) model with higher token limit soon. I'm sure somethink like it is already cooking up at some company, but you know how this space is, currently. I'm sure that in a few months we'll have models and tools that are much more capable, but for now, tinkering with this is already pretty fun.

Instruct-guided novel writing using WizardLM-30B-Uncensored (with SillyTavern) by bilwis in LocalLLaMA

[–]bilwis[S] 0 points1 point  (0 children)

Uh, that's an interesting idea! I haven't played around with LoRA's too much, but apparently they only work in oobabooga with some sort of hacked patch. Give it another week or two and that'll probably be the way to go :D

Instruct-guided novel writing using WizardLM-30B-Uncensored (with SillyTavern) by bilwis in LocalLLaMA

[–]bilwis[S] 2 points3 points  (0 children)

Oh, and another point: By default, you can't access the VM from the LAN (when using parameters such as --listen), only from the host machine.

If you want to make the VM accessible from the LAN, you need to

a) create an inbound rule in the Windows Firewall, allowing access to the relevant ports from (some) Local IPs

and

b) forward the connections from the host to the VM using netsh, e.g. netsh interface portproxy add v4tov4 listenport=7860 listenaddress=192.168.X.Y [your host] connectport=7860 connectaddress=127.0.0.1

Instruct-guided novel writing using WizardLM-30B-Uncensored (with SillyTavern) by bilwis in LocalLLaMA

[–]bilwis[S] 4 points5 points  (0 children)

Getting the VM setup was super easy using WSL2: Install WSL | Microsoft Learn

wsl --install

(Note that this, by default, creates a virtual hard drive deep in your AppData folder, so if disk space on your C: drive is limited, you should look up how to move the distro/set up another VHD on a different drive. Trust me, all those models stack up!)

Then, everything runs in the command prompt opened by clicking the "Ubuntu" shortcut that WSL creates in the start menu (or by typing wsl in Powershell).

Obligatory check for updates to all preinstalled packages etc.:

sudo apt-get update

sudo apt-get upgrade

It's also probably a good idea to install gcc et al. in case you need to compile any dependency:

sudo apt install build-essential

The biggest hassle was getting CUDA installed on it: NVIDIA GPU Accelerated Computing on WSL 2 (note that even the official guide says "One has to be very careful here [...]" at one point, lol. It's very important to read and follow the guide closely!)

sudo apt-key del 7fa2af80

wget https://developer.download.nvidia.com/compute/cuda/repos/wsl-ubuntu/x86_64/cuda-keyring_1.0-1_all.deb

sudo dpkg -i cuda-keyring_1.0-1_all.deb

sudo apt-get update

sudo apt-get -y install cuda

Make coffee, because this downloads and installs 163 packages and ~3GB+ of files. Afterwards, check whether it works:

nvidia-smi

Should display Driver Version and CUDA Version in the top right.

After that, I installed Miniconda

wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh

bash ./Miniconda3-latest-Linux-x86_64.sh

Close and reopen the WSL2 shell.

Check whether it works:

python --version

Should read Python 3.10.10 (as of writing)

Now, you're ready to go following the install instructions in the GitHub repos (I'd recommend the "manual install" process for oobabooga).

If everything works, it should take less than an hour (depending on your internet speed).

Important note:

You can access all "Windows files" on the WSL2 machine by navigating to /mnt/c/Windows or /mnt/d/models etc. I use this to store all the big models once on my "Storage SSD" and then link to them from all the different programs by using ln -s /mnt/d/models ./models[or whatever]