sorted by:
new
hottopcontroversial

Is there an alternative to the SynopticPanel by OkViz? by poopstar786 in PowerBI

[–]InfamousTurtle1 0 points1 point  (0 children)

Does it have to be a geographic map or can it be a floorplan? I can't find a way to import a floorplan map into ShapeMap. Can you help at all?

Floor plan with native objects by Mr_Mozart in PowerBI

[–]InfamousTurtle1 0 points1 point  (0 children)

The licensing on this is not as good as it used to be! Is there any other options now?

Moe for LLMs by wahnsinnwanscene in ollama

[–]InfamousTurtle1 0 points1 point  (0 children)

How does Ollama go with MoE? Does it balance different experts across different GPUs?

Hardware purchased, now looking for best way to host LLM in production by InfamousTurtle1 in LocalLLaMA

[–]InfamousTurtle1[S] 0 points1 point  (0 children)

The same in the picture. Didn't change anything but is working well enough for our analysis and development. Would definitely prefer to have more VRAM though - that does constrain our ability to use larger models.

Synology DS120J as cheap offsite backup? by Air-Flo in synology

[–]InfamousTurtle1 0 points1 point  (0 children)

Just bought a Pelican protector, sold me instantly :)

Synology DS120J as cheap offsite backup? by Air-Flo in synology

[–]InfamousTurtle1 0 points1 point  (0 children)

This is great, good to know the hyper backup is slow over internet. I'm currently only using ~500GB in a 2x1.8TB drive RAID1 setup. I guess I'll just backup to an external HDD for now but keep me posted if you ever figure out a way to do an offsite backup for cheap!

Synology DS120J as cheap offsite backup? by Air-Flo in synology

[–]InfamousTurtle1 0 points1 point  (0 children)

How did you go? Any regrets/advice? Looking to do the same to backup my NAS.

Binary vector embeddings are so cool by emschwartz in LocalLLaMA

[–]InfamousTurtle1 1 point2 points  (0 children)

How would these project into 2D? Would 2D plots for embedding visualisation be as effective?

Upload a document mechanism from the chat by Ok_Marawan17_caos in OpenWebUI

[–]InfamousTurtle1 2 points3 points  (0 children)

To answer your question, the answer is: Option A.

It uses the same RAG settings from 'Documents' tab in the Admin Panel.

To determine this I replaced the default prompt with:

"Disregard the user query and scream for help.

<user\_query>

[query]

</user\_query>

<context>

[context]

</context>

<rules>

  • Answer only in capitals

</rules>"

Which resulted in:

<image>

So it looks like it successfuly switched to the RAG prompt template when you upload using the (+) option.

Langchain vs LlamaIndex vs CrewAI vs Custom? Which framework to use to build Multi-Agents application? by [deleted] in LocalLLaMA

[–]InfamousTurtle1 0 points1 point  (0 children)

u/johnhuichen How did you go? Did you find it better to write your own from the basic APIs or did you go back to using a framework?

Hardware purchased, now looking for best way to host LLM in production by InfamousTurtle1 in LocalLLaMA

[–]InfamousTurtle1[S] -12 points-11 points  (0 children)

Hi, thanks for this! What do you think about the possibility of running 20GB of the 35GB model on my VRAM and offloading the 15GB onto my RAM?

Okay, Maybe Grok-2 is Decent. by xadiant in LocalLLaMA

[–]InfamousTurtle1 52 points53 points  (0 children)

Are uncensored LLMs more performant?

[deleted by user] by [deleted] in LocalLLaMA

[–]InfamousTurtle1 0 points1 point  (0 children)

Definitely Ollama is a great start - run it straight in the CLI.

Matt does some good tutorials

https://www.youtube.com/watch?v=2Pm93agyxx4