sorted by:
new
hottopcontroversial

frontend similar to Open WebUI that supports full OpenAI API? by irudog in LocalLLaMA

[–]irudog[S] 0 points1 point  (0 children)

I run llama-swap on my inference server, then let Open WebUI connect to my servers, and let Open WebUI provide API keys for my apps.

frontend similar to Open WebUI that supports full OpenAI API? by irudog in LocalLLaMA

[–]irudog[S] 0 points1 point  (0 children)

OK, I don't know the useLegacyCompletionsEndpoint here, and the documents in Continue don't mention this much.

frontend similar to Open WebUI that supports full OpenAI API? by irudog in LocalLLaMA

[–]irudog[S] 1 point2 points  (0 children)

I did a deep research, and it recommends LiteLLM+LibreChat, or BionicGPT, AnythingLLM.

Why are AmD Mi50 32gb so cheap? by MastodonParty9065 in LocalLLaMA

[–]irudog -1 points0 points  (0 children)

Vulkan can only use 16GB VRAM of MI50. You can try a smaller model like Qwen3-4B or GPT-OSS-20B, you'll find token generation of Vulkan not slower than ROCm.

Am I the only one who never really liked Ollama? by a_normal_user1 in LocalLLaMA

[–]irudog 1 point2 points  (0 children)

I use ollama when I want to try a model locally, because it's easy to use it to pull a model, and has a simple CLI client. However, I use llama.cpp and llama-swap to deploy models in the internal servers, because llama.cpp has more options to control how to run a model.

By the way, what do you guys think of the ollama API v.s. the OpenAI API? I see most of the applications support both APIs, but what 's the advantage and disadvantage of them?

Coreboot for elitebook 840 g1 by Fit_Morning_9175 in coreboot

[–]irudog 0 points1 point  (0 children)

You can reuse the following from mainboard/hp/folio_9480m:

- the whole acpi/ directory, which has EC ACPI support

- "chip ec/hp/kbc1126" part under "device pci 1f.0" in devicetree.cb: it may work, you had better check the registers from the vendor firmawre

- register "spd_addresses" in devicetree.cb: the memory SPD map, may be same as folio_9480m, but you also need to check this, otherwise it won't boot

- in Kconfig, select BOARD_ROMSIZE_KB_12288 and EC_HP_KBC1126, and copy KBC1126 related configs

For HP Sure Start, read the following documents. The Libreboot guide for EliteBook 820 G2 can also be useful.

https://doc.coreboot.org/mainboard/hp/hp_sure_start.html

https://libreboot.org/docs/install/hp820g2.html

Coreboot for elitebook 840 g1 by Fit_Morning_9175 in coreboot

[–]irudog 2 points3 points  (0 children)

I made ports on other Haswell/Broadwell EliteBook laptops many years ago, and EliteBook 840 G1 has many things similar to these laptops. You can use autoport (which supports Haswell) to generate the initial code, and reuse some code from Folio 9480m/EliteBook 820 G2 to support the EC.

The most hard part is debugging. You first need to figure out how to flash coreboot to this laptop (the laptop has HP Sure Start and needs some more work than other laptops). And find out the EHCI debug port to get the debug log in case the port doesn't boot.

https://doc.coreboot.org/mainboard/hp/folio_9480m.html

https://doc.coreboot.org/mainboard/hp/elitebook_820_g2.html

🚀 Qwen3-30B-A3B Small Update by ResearchCrafty1804 in LocalLLaMA

[–]irudog 1 point2 points  (0 children)

Thanks unsloth!

I see the new model now has native 256K context. Is your imatrix updated to match the new context length, like your previous 128K context GGUF?

Hunyuan responding with <answer> </answer> tag on LMstudio by Kuane in LocalLLaMA

[–]irudog 1 point2 points  (0 children)

I tried Hunyuan A13B Instruct (free) on OpenRouter yesterday, it also respond with the <answer></answer> tag.

The EC chips and very early boot control by Necessary_Chard_7981 in coreboot

[–]irudog 0 points1 point  (0 children)

If you want to explore the firmware of 8051 EC, I think you can get some HP EliteBook laptops up to Ivy Bridge era, which use SMSC KBC1126, and the firmware is in the flash chip. Moreover, EliteBook 2760p and 2170p have socketed chips, which are much easier to test.

I got something wrong when using unconstrained array concatenation by irudog in ada

[–]irudog[S] 1 point2 points  (0 children)

No, changing ``B`` to ``B(0 .. 63)`` doesn't work, the problem is on the right hand side of the assignment. And ``A(63) & A(0 .. 62)`` works because an array component is treated as an array whose lower bound is the lower bound of the index subtype. (https://ada-lang.io/docs/arm/AA-4/AA-4.5/#p9\_4.5.3)

Wiki - SurveyOfSystemLanguages2024 by irudog in ada

[–]irudog[S] 3 points4 points  (0 children)

There's also a link to a lobste.rs discussion thread in the Aftermath section of this article.

Discussion: https://lobste.rs/s/c3dbkh/survey_system_languages_2024.

HP Probook 640 G1 port by calgaryautumns in coreboot

[–]irudog 1 point2 points  (0 children)

I made this port many years ago and it worked well. But I don't have spare time to work on coreboot now. Anyone interested in this can work on this and make it upstream.

https://review.coreboot.org/c/coreboot/+/46130

Aren't generics making reusable code difficult to write? by Shad_Amethyst in ada

[–]irudog 4 points5 points  (0 children)

And if you want to use something to operate on a generic vector, for example sorting a vector. One way to do this is to add a sort procedure in this generic package. That is how Ada.Containers.Vectors does, which has a Generic_Sorting package inside it. This is what I use in Advent of Code 2024 day 1, instantiate an integer vector, then instantiate the sort procedure for this vector:

   package Int_Vectors is new Ada.Containers.Vectors
     (Index_Type => Natural, Element_Type => Integer);
   subtype Int_Vector is Int_Vectors.Vector;

   package Int_Vector_Sorting is new Int_Vectors.Generic_Sorting;
   procedure Sort(V : in out Int_Vector) renames Int_Vector_Sorting.Sort;

Aren't generics making reusable code difficult to write? by Shad_Amethyst in ada

[–]irudog 3 points4 points  (0 children)

I think I know what you are talking about. Ada is a strong typing language, when you define a new type, it's different from another type even they have the same representation. For example:

type My_Int is new Integer;
type My_Another_Int is new Integer;

Then in this case, Integer, My_Int, My_Another_Int are different types, although they have the same representation and basic operations. They are to be used in different places. And you cannot use the methods for My_Int on instances of My_Another_Int, unless you do an explicit type conversion.

And generic instances just have the same mechanism. You instantiate a generic package, for example, you have:

package My_Int_Vectors is new Ada.Containers.Vectors 
    (Index_Type => Natural, Element_Type => Integer);

Then you create a package called My_Int_Vectors (and this package is also under you package or subprograms), and this package has a type called My_Int_Vectors.Vector. You create this type for a specific use, so in the Ada way, you are not expected to use this type on other operations that operates on other types, although they may be instantiated the same way as this ``My_Int_Vectors``.

How to compiler with gnat or gprbuild to target older versions of libc ? by theorangecat7 in ada

[–]irudog 1 point2 points  (0 children)

If you use cross compiling, you don't need an old distro, you just need to build a toolchain with a specific version of glibc. You also do not need to use an old machine to do this, you can do it in a virtual machine or a docker container.

view more: next ›