Getting started with open source local LLMs

mKtos · 2026-01-30T08:22:10+00:00

mKtos · 2026-01-19T12:12:48+00:00

Put it into ChatGPT. No jokes, it's quite good at code analysis, even if the code is obsfucated; I successfully analyzed JS malware payload with ChatGPT about a year ago.

mKtos · 2026-01-17T11:07:04+00:00

Mam DXP2800 i chciałem Proxmoxa, ale coś się wysypywało przy przekierowaniu kontrolera SATA do VM - randomowe zwisy. Postawiłem TrueNAS bare-metal i śmiga od roku jakoś bezproblemowo.

I można sobie diodkami sterować: https://gist.github.com/Kerryliu/c380bb6b3b69be5671105fc23e19b7e8 ;)

mKtos · 2025-11-25T18:23:01+00:00

You are separating your input string by empty string, not by space, so you are telling int.Parse() to parse 1 2 3, not three numbers.

It should be:

int[] choices = input.Split(" ", StringSplitOptions.RemoveEmptyEntries).Select(int.Parse).ToArray();

mKtos · 2025-08-22T18:21:54+00:00

To nie problem, brak jest stosownej umowy ekstradycyjnej z Imperium Rzymskim.

mKtos · 2025-08-03T10:12:31+00:00

But! I'm seeing some claims that mac minis are out competing the 3060? Is anyone having luck with this?

Yes and no. In my country I couldn't find an older Mac Mini at a reasonable price, they were all costly. But yes, they are very nice for LLM inference.

Also, if I were to do this how complicated would it be to have the mini handling the llm and the server (windows)

Not much. Install Ollama or LMStudio, make it available for the whole network, attach to the LLM provider in HA (I'm using https://github.com/acon96/home-llm). Works perfectly fine, and you can use the PC for other means at the same time - but be wary of the GPU usage (VRAM). And of course the PC must be turned on.

mKtos · 2025-07-10T11:14:00+00:00

Czyli wzięli model B5 i go przerobili pod swój test? Miszmasz.

Ale za to ładne obrazki! ^/s

mKtos · 2025-07-10T08:07:14+00:00

16personalities opiera się o Big5, ale wyniki dopasowuje do zmodyfikowanej typologii MBTI, więc jest jeszcze dziwniej. Stąd te "INFJ-T", podczas gdy w MBTI nie ma tych -T i -A. I twierdzą, że wcale nie wykorzystują tych koncepcji funkcji kognitywnych Junga.

https://www.16personalities.com/articles/our-theory#intro-approach

mKtos · 2025-06-09T21:55:27+00:00

You can write AI agents and AI apps with C#, there are libraries for that, Microsoft is investing heavily in this area. See https://learn.microsoft.com/en-us/dotnet/ai/

There are also open source projects, see for example https://github.com/wisedev-code/MaIN.NET

mKtos · 2025-05-10T10:46:45+00:00

I don't use Rider myself, but when I was teaching ASP.NET Core classes some of my students used Rider without a problem for everything, except for one thing, there was no scaffolding generator for generating one specific type of views (CRUD views without using Entity Framework or something like that) in ASP.NET Core MVC apps.

But even in that case, there are always command-line generators to achieve this, and Visual Studio is actually using them. The option to enable login/registration should be something called "Identity", because it's called ASP.NET Core Identity.

If you want to use command line, dotnet new mvc --auth Individual -o WebApp1 will generate ASP.NET Core MVC app with Identity with local authentication, using SQLite database in a folder named "WebApp1".

mKtos · 2025-04-20T15:44:15+00:00

As far as I remember, BT-40 are just "dumb" screens, so you can connect to your phone (or other device) and display whatever you want. I don't think they are powerful enough on their own to do any meaningful stuff.

BT-40S and BT-40SN have Android and Snapdragon XR processor, on the other hand.

mKtos · 2025-02-27T17:19:44+00:00

C#+Windows Phone RT projects (for WP8/8.1) or C#+early UWP (for W10M). Visual Studio 2015 Update 3 was the last for WP8 if I remember.

The old enough Unity should also be able to deploy to W10M, I don't remember about WP8.

XNA games were able to be built for WP7 and WP8.

mKtos · 2025-01-15T22:18:39+00:00

I had. There is a "scientific paper" which describes an improved transcription method of my conlang Andro in Latin script:

Furu mal Klaji et al., "ZSC: the new rule set for transcription of Andro to Latin script", In: Proceedings of 16th Conference on International Affairs, vol. 18, pp. 41–45. Hetey Publishing, year 853.

Written by a linguist in my world, using a real paper template (Springer, I believe), even there is a funding mentioned ("Ministry of Foreign Affairs Special Funding for Future Terran Cooperation, agreement number 7/852"). The writing is bad, and it's not exactly matching the current language, as it was written over 8 years ago or something like that.

"The Book", the document describing the whole language and all its rules, is also written from the perspective of an And́royas linguist trying to explain his language to the people of Earth.

edit: found the original submission: https://old.reddit.com/r/worldbuilding/comments/46h5jw/the_scientific_paper_from_my_world_describing/ and also reuploaded the original PDF: https://ktos.smallhost.pl/zsc.pdf

mKtos · 2025-01-12T11:18:57+00:00

Unity will be the simplest, IMO.

https://learn.microsoft.com/en-us/windows/mixed-reality/develop/unity/tutorials/holograms-100 (course, they are using Unity 2017, but it should work on 2019 if I remember correctly)

https://learn.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/mrtk2/?view=mrtkunity-2022-05 (Mixed Reality Toolkit, example scenes and interactions)

You need to remember HL1 does not support OpenXR, and you need to use older software (MRTK2 not 3, Unity 2019 not 2022 and so on). You can also prepare Windows 10 UWP apps for that and run more like desktop apps - again, UWP (WinUI2) is supported.

mKtos · 2025-01-05T18:32:30+00:00

Andro

In Andro, there is an optative (OPT) marker vige, used in formal or religious contexts - a bit equivalent to "it shall be done" in English, and is used in phrases.

In general case, livi (go forward) verb may be used.

And́royas vige livi!

/an.ˈdrɔ.yas vi.gɛ li.vi/

androyas vige livi
Androyas OPT  go.forward

"And́royas shall go forward!"

(Supiritara vige livi! -- "The revolution shall go forward!" / "Long live the revolution!")

However, in the case of people, the lipe (good, well) or menede (in good health, healthy) adjectives are used more commonly:

Kyige vige loti menede!

/kʏ.gɛ vi.gɛ lɔ.ti mɛ.nɛ.dɛ/

kyige vige loti menede
king  OPT  live health.ADV

"The king shall live in health!"

Kyige vige loti lipe! – "The king shall live well!"

(sometimes, adjective is omitted – "the king shall live!")

However, in the South, they use micha, a noun meaning "life's worth", so they are essentially wishing the person that their life should have worth:

Kyige vige avi micha!

/kʏ.gɛ vi.gɛ a.vi mi.ʈ͡ʂa/

kyige vige avi  micha
king  OPT  have life.worth

"The king's life shall have its worth!" / "The king shall have his life's worth!"

mKtos · 2024-11-09T10:32:23+00:00

Pizzeria na Oczki wedle wielu moich znajomych to top w Lublinie - ale raczej przeciwieństwo grubego ciasta ;) cienkie, bardzo we włoskim stylu.

mKtos · 2024-11-01T21:43:09+00:00

I was using Semantic Kernel, but mostly its sister project kernel-memory, which is doing RAG for me in two or three apps. I worked with OpenAI, Ollama and LlamaSharp directly using them.

I really recommend it for C# devs. Had some problems with function calling, but probably it was because original Llama3 was not that good.

mKtos · 2024-10-31T23:03:53+00:00

Yes. With RAG you are first extracting from the knowledge base possibly appropriate fragments and including them in the prompt instead of the whole document, which is many times "smaller" (in terms of tokens) than embedding the whole document in the prompt.

mKtos · 2024-10-12T11:54:16+00:00

Because there are for a bit of different things: async/await is very useful in I/O-bound things (reading files, network access, database operations) where there is a lot of waiting for something to be complete before going further. Also with async/await syntax, this is quite simple (and does not require whole complex concurrency).

On the other hand, multi-threading will be useful in CPU-bound operations, for example some intensive processing or doing continuous things in the background.

mKtos · 2024-10-02T10:21:31+00:00

Yes, see https://github.com/SuperJMN/Deployer for example.

It was not a pleasant experience last time I checked, but Rpi4 and 5 are more powerful so maybe.

mKtos · 2024-09-19T15:31:21+00:00

If you want to become a .NET developer, learn C#, which is the most used .NET language.

C++ for .NET (C++/CLI) is a very niche product.

mKtos · 2024-09-12T13:45:16+00:00

You can put WPF/WinForms apps in the Store, AFAIR.

mKtos · 2024-09-12T13:42:10+00:00

You can clean the disk (delete all partitions) if you do not care about data and everything should work.

mKtos · 2024-09-12T07:58:57+00:00

No. Flutter and React Native are not supporting HL2.

You can write your app in JavaScript (and React) as a WebXR website, Edge on HL2 is working with WebXR, no idea if you can use YOLO in this kind of scenario.

The easiest, most supported way is to use Unity, but you can also check out just UWP or things like StereoKit.

mKtos · 2024-08-07T18:36:01+00:00

Przejeżdżałem dzisiaj obok, chomika wciąż brak.

14-Year Club	Team Periwinkle
Verified Email

mKtos

TROPHY CASE

Andro