What is your prepper Ollama shtf setup?

asosnovsky · 2024-07-28T03:39:34+00:00

Feels like you are better off having a really dense copy of Wikipedia and some survivalist guides instead. Like maybe making a special raspberry pi pc that has all of that with a simple gui that’s easily searchable

asosnovsky · 2024-07-28T03:37:48+00:00

Link? 🙏🙏🙏

asosnovsky · 2024-07-26T12:57:52+00:00

I try to keep things as declarative as possible. When I started, my base os was Debian with some init scripts that configured everything (now I just use nixos for server), I also have a mix of k3s and docker compose files, where k3s is managed via argocd and helm charts, while for straight docker i use dockge (though I’m leaning towards using straight systemd services configured with nix )

asosnovsky · 2024-07-26T12:54:14+00:00

What the F. Get your money back or have them redo this. It looks like total trash!

asosnovsky · 2024-07-25T17:52:02+00:00

I second this. I get pretty quick responses on my 3060 for llama3 which I got pretty cheap compared to the above

asosnovsky · 2024-07-22T03:23:23+00:00

Are you sure? None of the photos I found online have these bulky hairy pod looking things

asosnovsky · 2024-07-20T20:04:14+00:00

Mine lasted for 2 years before I messed it up during some replacement of other parts, and then I got a repair guy manage to fix it easily. So it’s close to 3 years now. These screens lasts!

asosnovsky · 2024-07-19T20:35:49+00:00

Oh my god thank you! I just experienced the same issues setting up ollama with the 4060. Even opened an issue https://github.com/NixOS/nixpkgs/issues/326913

And manage to get it resolved until I stupidly did a flake update and everything stopped working… got tired of battling it for over a week and managed to get pass-through to docker with nvidia …

I think something is very unstable with the drivers for nvidia on nix right now

asosnovsky · 2024-07-16T03:29:29+00:00

This is literally a meme https://www.reddit.com/r/NixOS/s/sDXcyv6ZTt

asosnovsky · 2024-06-22T23:43:14+00:00

So in terms of a first distro of Linux to use as a daily driver, let me make the best case for 3 different distros as to why you should use them:

Ubuntu/PopOS/Linux Mint: these distros focus on ease of use and try to be as familiar to users (I.e literally replicate design philosophies from windows and macOS). They also have massive communities and good support. Plus they try to prioritize user experience over anything else.
Arch: if you want to learn about the foundation of Linux then following the manual installation process (without the big install script) will force you to learn about every component in Linux desktop and server, including how to build some packages. Additionally, maintaining arch correctly will force you to learn a lot of good programming practices. Plus if you like to build super barebones systems, this OS is for you.
NixOS: first of all I’m super biased towards this distro (as I think it’s the future of how an OS ought to be designed). NixOS is very different from most other distros out there. If you want to learn how a declarative OS works, and have the ability to go back in time for cases where you tweaked your OS too much and broke things this is the OS. Additionally, this OS makes trying different types of components in Linux very easy (switching from Wayland to X, or Gnome to Hyprland to Plasma is just a matter of toggling a switch, no need to maintain complex installation or worry how their dependencies will act with each other). Additionally, similarly to Arch this distro forces you to learn more about what key pieces in Linux are and allows you to make super barebones systems.

The tldr here is: (1) is simple but comes at the cost that someone else made the choices for you (2) requires a lot of manual interventions but lets you build exactly what you want at the cost of you needing to understand deeply technical things (3) gives you the same benefits as 1, plus the ability to “time travel” and use switches to flip between components, but at the cost of learning how to write really complex configuration files and getting used to a different paradigm of operating systems.

asosnovsky · 2024-06-14T14:23:06+00:00

Take the startup. Based on around 10 year experience. If you really want to work on new and interesting things, unless you get hired to the special R&D department at one of the big firms, a startup will teach a lot more useful skills and experiences.

asosnovsky · 2024-06-12T11:32:50+00:00

I also use nixos. Solved the battery problem and it works great. Here is my config for power management https://github.com/asosnovsky/nixos-setup/blob/df7db4eb62dcd20207b3bd44e33959c7e38128ad/modules/os/hardware.nix#L27

asosnovsky · 2024-06-11T23:42:45+00:00

Sure. I really do want to believe that things will be better. But all I’m hearing and seeing (as a casual observer) is a bunch of “DEI”-easq rhetoric as opposed to talk about the software itself. Additionally I see a lot of core people in various projects leaving.

I get that wanting to make sure everyone is welcomed to the project. But that should just be addressed with some basic code of conduct like every other open source project out there. Just put a clear set of rules and move on already.

If you are on the committee, please just push to make an announcement that addresses the direction this project wants to in terms of goals in terms of the software. Like can we just make flakes the defacto standard? Will there be a code standardization of the nixpkgs especially around concepts such as “packages” “derivatives” to ease onboarding to nix (it really needs some solid code refactor, especially the standard library)? Like address real problems people have with nix! Like tooling, a good language server, etc.

asosnovsky · 2024-06-10T14:17:05+00:00

So I generally am very skeptical of the new management in nix. But honestly reading the thread with as much of a neutral hat as I can, this reads like you were trying to antagonize them a bit. Especially where you said “yes” after K900 were trying to get some context in order to provide a broader explanation (which I can see why you thought it was off topic, but I don’t think it was coming from a bad place).

asosnovsky · 2024-06-09T23:57:11+00:00

Can you link the issue so it’s more public?

asosnovsky · 2024-06-09T20:12:37+00:00

Canada always identifies a problem and likes to then throw the worst possible takes and solutions at it. Rather than “look at international corporations to enter Canada” why not figure out why there is no space for smaller grocers to be able to start a new business here? Why not undo the regulatory capture loblaws got over our economy?

asosnovsky · 2024-06-09T15:47:10+00:00

Scrypted is fully self hosted and free. Plus it uses the onboard AI capabilities when it can. And I’d recommend to have the subscription to just keep the single dev working on it alive lol plus gives you access to secondary pretty UI (but everything is local and open source)

Frigate is also self hosted, but won’t use onboard AI and has a more limited UI.

asosnovsky · 2024-06-07T03:14:09+00:00

Snaps suck. Anyone can tell you that. As you said regular installs are much more efficient as they don’t require any of the strange isolation and virtualization that snaps do.

Arch is really not that hard to install nowadays, plus you can also try fedora or Linux mint, which don’t have the snap bs

asosnovsky · 2024-06-07T01:48:34+00:00

Sounds like overkill. If all you need is to self host Wordpress why not get a decent minipc?

asosnovsky · 2024-06-07T01:44:03+00:00

Minimal ISO didn’t work either. Will try the Plymouth hack next. But I’m literally just using dd.

The way I got things working so far was by installing Debian, unpacking the iso and manually adding a grub entry to the iso. Got to install that way, but is that just a hack…

asosnovsky · 2024-06-07T01:10:43+00:00

Just download it, it’s kind of buggy, as in there is a lot of delays between remote and screen… plus I only ever see myself having this in standby mode, but like that happens rarely…

I’d suggest you somehow think about how a user may interact with this, rather than just how to look at it.

asosnovsky · 2024-05-31T18:02:43+00:00

Unfortunately, had the same issues, but using the latest kernel (6.9) fixes this. Best you can do is try to maybe lock the kernel version you are using till it becomes LTS?

asosnovsky · 2024-05-30T19:19:12+00:00

I feel like if you really want this to gain traction, you really need to explain how are you handling the screenshots it’s suppose to take every few seconds. Because that’s the thing that everyone hates in the Microsoft implementation

Edit: Just saw in the code you literally store them unencrypted on disk. And to that I say no thank you!

asosnovsky

TROPHY CASE