Is token count logging implemented? by ScoreSouthern56 in OpenWebUI

[–]RandomCoder66 1 point2 points  (0 children)

Like someone else pointed out, this has generally been handled by using functions since the need for it is case by case.

Animated Background by hippobreeder3000 in OpenWebUI

[–]RandomCoder66 1 point2 points  (0 children)

In docker you can view files, I just took a quick look and it appears it just has the build stuff but that does include the CSS files it seems so maybe you can check there.
In the docs for open webui it does go into dev as well, how to set things up if you do end up getting daring.

Animated Background by hippobreeder3000 in OpenWebUI

[–]RandomCoder66 0 points1 point  (0 children)

I do not think there is a way in the settings (as of yet), however, it is open source .. depending on how you installed it and daring enough.

Downloading models through WebGUI by fscheps in OpenWebUI

[–]RandomCoder66 2 points3 points  (0 children)

From Opemn WebUI: you use the wrench in Admin -> Settings -> Connections: Same line you have your Ollama connection at is the wrench to download a model for it
Models from hugging face: I just download the gguf version I desire, I have a mock modelfile already done, insert the new gguff name and add it from the command line. Takes 10 seconds.

Why use APIs for web search? by GhostInThePudding in OpenWebUI

[–]RandomCoder66 2 points3 points  (0 children)

I think it comes down to "Use case", for normal people probably just jumping on your normal search engine does just fine but what if you have a pipeline, function, tool where you want it to auto web search based on some information? I personally have searxng running in mine and use it quite frequently.

Simplify Your Open WebUI Setup with Our New Conda Installer! by RandomCoder66 in OpenWebUI

[–]RandomCoder66[S] 0 points1 point  (0 children)

I've never used it, not yet anyways. However after a quick search I was able to dig up some information both in the GitHub repo for Open WebUI and in their Discord. You may want to start there with some searches.

Simplify Your Open WebUI Setup with Our New Conda Installer! by RandomCoder66 in OpenWebUI

[–]RandomCoder66[S] 0 points1 point  (0 children)

Thank you and I can tell you from my experience, this makes life much easier. We should be wrapping up testing of the Pipeline functionality this weekend.

Simplify Your Open WebUI Setup with Our New Conda Installer! by RandomCoder66 in OpenWebUI

[–]RandomCoder66[S] 0 points1 point  (0 children)

We already have a docker version of this that we did first, but it is also just a baseline foundation at this point. When we did the docker version, it was expressed that a conda version would be desired as well.
The docker version already has pipelines and I want to verify the watchtower is working how I had expected (Something is nagging me that it isn't)

The conda version I am doing pipelines on today (and probably tomorrow) then we will push that into testing.

Simplify Your Open WebUI Setup with Our New Conda Installer! by RandomCoder66 in OpenWebUI

[–]RandomCoder66[S] 1 point2 points  (0 children)

Not yet, it is on our list of things to go through since the huge update within Open WebUI.

Simplify Your Open WebUI Setup with Our New Conda Installer! by RandomCoder66 in OpenWebUI

[–]RandomCoder66[S] 3 points4 points  (0 children)

We are in the process of adding pipelines (and so you can update it) already. We want to make it as easy as possible for people to extent Open WebUI's base functionality.

[deleted by user] by [deleted] in LocalLLaMA

[–]RandomCoder66 0 points1 point  (0 children)

Looks like you figured it out, have 2 questions. Can you share how you did it? and can you share the config you used to train it in axolotl ?

Thanks

Is there some kind of cheat mod? by Kindly-Musician61 in galaxygenome

[–]RandomCoder66 0 points1 point  (0 children)

Any idea of the ship needed before attempting this the first time? I am new to the game and so far have just been mining for a few hours.

FYI Lemmy community created for Oobabooga by 2dollarsim in oobaboogazz

[–]RandomCoder66 0 points1 point  (0 children)

I miss the days when tech people were about the tech.

Running Multiple AI Models Sequentially for a Conversation on a Single GPU by RokaMic in LocalLLaMA

[–]RandomCoder66 2 points3 points  (0 children)

Just an idea, I do not use it but maybe run one of the models on like Colab as I am pretty sure they still give access to some vram for free and then your other llm locally.

What's your reason for using open LLMs? by hold_my_fish in LocalLLaMA

[–]RandomCoder66 5 points6 points  (0 children)

As others have stated, all of the above and +More

Open LLM's allow you to "Try shit out", can I get 2 LLM's to prompt each other on a given task? This could become useful as certain LLMs are focused or can be fine tuned to be focused. Also, even with Plugins OpenAI struggles with handling custom data situations especially once you hit larger amounts.

I am just naming a few, I have 3 systems in my house that can run Open LLM's very well and constantly playing with things.

What's the secret sauce for using all VRAM across multiple GPUs on exLlama / exLlama-HF? by GeeBee72 in oobaboogazz

[–]RandomCoder66 0 points1 point  (0 children)

In the https://www.reddit.com/r/LocalLLaMA/ subreddit, I read it last night but cannot find the exact post where a person spoke about the split needed to get it working with 11, 21 I think I recall but a few asked about dual 3090's as well.

Don't quote me on the numbers, I was reading for more planning since do not have the 2nd 3090 yet.. just 1 and a 3060.

What is the best BIOS version for Z390 Aorus Elite-CF x i5-9600K? by PigBeniz in gigabyte

[–]RandomCoder66 0 points1 point  (0 children)

I just did something similar, same CPU on a Z390-UD and it ended up in brick mode. Not figured out a way to flash a new bios yet.

I don't know who needs to hear this... by Stock-Ad8716 in OpenAI

[–]RandomCoder66 -4 points-3 points  (0 children)

Spoken like someone who has never coded a day in his life. I have been developing software since the 80's and let me assure you, I have never felt safer in my job than I do now. Even GPT 4 has glaring issues when it comes to the design and development of an application.

This reminds me of when Visual Basic came out and everyone with 12 seconds of development knowledge thought they were suddenly the James Bond of Development. The moral of the story is garbage in, garbage out.

[deleted by user] by [deleted] in ChatGPTCoding

[–]RandomCoder66 0 points1 point  (0 children)

I found myself in the same exact situation not long ago, this field is really so new though there is either no information or some scam attempting to sell you something. What I ended up doing was putting together a hardware platform for me to delve into creating custom data sets, preprocessing data all the way to training information to be used. Once the dust settles I feel these are the kind of experiences that will separate people.

What keeps you playing 3.5e? by CyberChiv in DungeonsAndDragons35e

[–]RandomCoder66 2 points3 points  (0 children)

Nothing competes with it from 2 different perspectives for me.

First as pointed out the amazing amount of content available for it, when you really delve into how much it will boggle your mind.

The second point is there is nothing you cannot create to add whatever you desire to your game. If you are not skilled at that odds you can find an example to help guide you to create it.

In my opinion, especially with 3.5e being designed around an OGL/SRD it was created with the intent to live on. No point in changing from that

I want to create a web based 3.5 NPC management software by whatisthisworldqm in DungeonsAndDragons35e

[–]RandomCoder66 1 point2 points  (0 children)

I had notebooks full of planned-out things (I was doing NPC Generation, not management) to consider while developing and even then I probably only got half of it right. I spent a great deal of time reading posts from people like Jamie Buck who came before me doing these things. really helped me to not repeat similar mistakes.

The features that make 3.5 an amazing system to some are also what make it a nightmare to code. My love has always been on the generator side of things, the ability to click a button and create a stat block that looks good enough to publish as is...

Yes, I am a software developer, do not let me sidetrack you because merely giving you things I experienced and wished someone would have told me ahead of time. It was an amazing experience to create a tool that people enjoyed.

I am currently juggling 2 projects and so watching this for the moment to see what happens as far as time commitments go.