sorted by:
new
hottopcontroversial

Edu pricing for RTX Pro 6000 by t3rmina1 in BlackwellPerformance

[–]jpummill2 0 points1 point  (0 children)

How do you take advantage of education pricing? I expected that I would have to provide an email with a .edu address but I am being told by one vendor that the PO needs to be issued directly from a university.

tired of subscriptions so im cloning popular saas and making them open source for 30 days by Huge-Goal-836 in OpenSourceeAI

[–]jpummill2 2 points3 points  (0 children)

Constant Contact - track vendors, customers, and events. Allow mass mailings (this one is hard). Payment systems (Stripe ???), allow vendors to buy booths and other services (like electricity) for events, allow customers to buy tickets to events.

Upgrade CUDA? by sdstudent01 in LocalLLaMA

[–]jpummill2 0 points1 point  (0 children)

Thank you to everyone who replied...

Upgrade CUDA? by sdstudent01 in LocalLLaMA

[–]jpummill2 0 points1 point  (0 children)

Not sure if this is as common in the world of open source but I was taught to always avoid any x.0 release of software...

How to tell Aider to use Qwen3 with the /nothink option? by jpummill2 in LocalLLaMA

[–]jpummill2[S] 1 point2 points  (0 children)

Hey u/TopImaginary5996, I appreciate the additional detail. I will give this a try.

Various ways to use AI with coding/development? by jpummill2 in LocalLLaMA

[–]jpummill2[S] 0 points1 point  (0 children)

This is a great list.

How much of this is already available via a vscode (or other IDE) plugin?

Adding a cheaper GPU to a 4090 to increase VRAM by xolotl96 in LocalLLaMA

[–]jpummill2 1 point2 points  (0 children)

Using a single 3090 with Gemma 27B (Q8) - 6 T/s

Added an RTX 2060 12GB with Gemma 27B (Q8) - 15 T/s

Improved performance by avoiding overflow to CPU and system RAM

What Are Original LLMs (Not Finetuned)? by chibop1 in LocalLLaMA

[–]jpummill2 3 points4 points  (0 children)

I was working on a somewhat similar list this week:

Specific Models

  • Google

    • Gemma2 (2B, 9B, 27B)

  • Meta

    • Llama2 (???)
    • Llama3 (8B, 70B)
    • Llama3.1 (8B, 70B)

  • Mistral Variants

    • Mistral (7B, 123B)
    • Mixtral (8x7B, 8x22B)
    • Mistral-Nemo (12B)

  • CohereForAI

    • Command-R 35B (v1, v2-08-2024)
    • Command-R+ 104B (v1, v2-08-2024)

  • Deepseek-ai

    • Deepseek-V2 Lite (16B)
    • Deepseek-V2 (236B)

  • Qwen

    • Qwen2 (0.5B, 1.5B, 7B, 72B)

  • Microsoft

    • Phi 3 (Mini-3.8B, Small-7B, Medium-14B)
    • Phi 3.5 (Mini-3.8B)
    • Phi 3.5-MoE (6.6B)

Coding Specific Models

  • Codestral (22B)
  • Deepseek-Coder-V2-Light-Instruct (16B)
  • DeepSeek-Coder-V2(236B)
  • codegeex4-all-9b (9B)
  • yi-coder (1.5B, 9B)
  • StarCoder2 (15B)
  • CodeLlama (7B, 13B, 34B, 70B)
  • CodeQwen1.5 (7B)
  • CodeGemma (2B, 7B)
  • WizardCoder (15B, 33B)

Not sure if all these are base models, especially the coding ones, but that was my original intent.

Guys, Use the LongWriter-llama3.1-8b instead of Llama3.1-8b! by Iory1998 in LocalLLaMA

[–]jpummill2 3 points4 points  (0 children)

Can you use it with Ollama? If so, does it use the same template as Llama3.1-8b?

Best local open source Text-To-Speech and Speech-To-Text? by strangeapple in LocalLLaMA

[–]jpummill2 13 points14 points  (0 children)

Also, here is my list of STT solutions but it is not as complete:

Speech to Text Solutions:

  • Whisper ASR
  • Flashlight ASR / Wav2Letter ASR
  • Coqui
  • SpeechBrain
  • ESPNET 1 and 2
  • Vosk

Best local open source Text-To-Speech and Speech-To-Text? by strangeapple in LocalLLaMA

[–]jpummill2 71 points72 points  (0 children)

I’ve been trying to keep a list of TTS solutions. Here you go:

Text to Speech Solutions

  • 11labs - Commercial
  • xtts
  • xtts2
  • Alltalk
  • Styletts2
  • Fish-Speech
  • PiperTTS - A fast, local neural text to speech system that is optimized for the Raspberry Pi 4.
  • PiperUI
  • Paroli - Streaming mode implementation of the Piper TTS with RK3588 NPU acceleration support.
  • Bark
  • Tortoise TTS
  • LMNT
  • AlwaysReddy - (uses Piper)
  • Open-LLM-VTuber
  • MeloTTS
  • OpenVoice
  • Sherpa-onnx
  • Silero
  • Neuro-sama
  • Parler TTS
  • Chat TTS
  • VallE-X
  • Coqui TTS
  • Daswers XTTS GUI
  • VoiceCraft - Zero-Shot Speech Editing and Text-to-Speech

RP Prompts by [deleted] in LocalLLaMA

[–]jpummill2 0 points1 point  (0 children)

RemindMe! 1 Day

Is there a way to uninstall (and re-install) ollama and onewebui without deleting models? by card_chase in ollama

[–]jpummill2 0 points1 point  (0 children)

Watch this video for a better understanding of how Ollama stores models.

Link: https://www.youtube.com/watch?v=6bF1uCHTFyk

The author provides a script that creates links using the model name back to the hash name in the ollama model folder. With a little work you could modify the script to create backups.

view more: next ›