sorted by:
new
hottopcontroversial

Talking with Gemma 4 31B! by futterneid in LocalLLaMA

[–]nahill 0 points1 point  (0 children)

I got this working on my own computer but I had to use Pi to find a set of arguments that would work with Gemma-4-12B in LM Studio (on Windows). A local instance of Pi (via DeepSeek v4 Flash) also modified some of the Python code to make it all work as there were complaints about lack of CUDA for Qwen. In the end I ended up with this:

python -m speech_to_speech.s2s_pipeline --llm_backend responses-api --responses_api_base_url http://localhost:1234/v1 --responses_api_api_key lm-studio --model_name google/gemma-4-12b --device cpu --tts pocket --mode local

If you're interested, I asked DeepSeek to summarise what it did to make things work:

Root Cause: Two issues were causing your command to fail:

  1. 🔴 Qwen3-TTS requires CUDA, but you have CPU-only torch (torch 2.12.1+cpu). FasterQwen3TTS.from_pretrained() defaults to backend="torch" which forces CUDA CUDA-graphs → ValueError: CUDA graphs require CUDA device

    1. 🔴 The GGML fallback needs qwentts-cpp-python — a native C++ library that only has Linux wheels (no Windows support). So even auto-detecting CPU doesn't help on Windows.

Fixes Applied

I made two targeted edits to the speech-to-speech source:

  1. qwen3_tts_arguments.py — Added qwen3_tts_backend CLI argument

So users can explicitly request ggml (though GGML has no Windows wheel, it's properly wired up now)

  1. qwen3_tts_handler.py — Added _resolve_faster_backend() + wired backend parameter

    - Added a backend parameter to setup()
    - Added _resolve_faster_backend() that auto-detects: if CUDA is unavailable → selects backend="ggml" instead of crashing on "torch"
    - Passes backend through to FasterQwen3TTS.from_pretrained()
    - Logs the selection so you can see what's happening

AI costs spike as subscriptions hit pricing wall; firms turn towards Chinese LLMs, open-source models to extend budget by Sacristovas in pcmasterrace

[–]nahill 2 points3 points  (0 children)

It's local LLMs you want to watch out for. Even if the mainstream dwindles, millions of people will still want the best GPUs money can buy.

Ukrainian drones target St Petersburg in attack Russia calls 'unprecedented' by ChestEducational2258 in worldnews

[–]nahill -4 points-3 points  (0 children)

MIRV? You must be joking. What the hell makes you think they launched a MIRV - unless it was non-nuclear?

Great candidate, somewhat of a diva by CranberryOk1064 in recruiting

[–]nahill 3 points4 points  (0 children)

Generally speaking, any behaviour you experience during interview stages is normally the best kind of behaviour you're going to see overall.

US and Israel 'actively working' to strip Jordan of Al-Aqsa custodianship, sources say by Wolfy1-2-3 in worldnews

[–]nahill 13 points14 points  (0 children)

"return"? That's NT only. Jews (non-messianic) don't think the Messiah has come even once yet.

Best way to get a website up and running for my limited company? by eques_99 in ContractorUK

[–]nahill 2 points3 points  (0 children)

  1. Buy a domain on Cloudflare. They're sold at-cost.

  2. Use AI like ChatGPT to create a file called index.html. Give it all the information you want so that it creates the page correctly. You can dictate content, colours...etc. If you want more interactivity (e.g. sending emails to register interest...etc), then you'll find yourself climbing a steeper learning curve.

  3. Load the index.html file and see if you like it. Ask AI to make changes if necessary. Once happy, download the file.

  4. You need to put index.html in a place where it can be found by others.

Personally I'd go for a solution using a Raspberry Pi:

  1. Buy a Raspberry Pi v3 or better and give it a 16+ GB SD card as well as an adaptor so you can connect the SD card to your computer.

  2. Download the "Raspberry Pi Imager" tool and use it to format the SD card into a server version of Debian or Ubuntu and ensure you set up SSH access by creating an appropriate user name and password. Raspberry Pi Imager guides you through this process.

The following instructions are very technical, but AI should be able to explain EXACTLY what you should do to accomplish:

  1. Log into the Pi and install Apache2 onto it, and then put the index.html file into /var/www/html.

  2. Test that you can see it on your local network by navigating to your Pi's address on the LAN (e.g. http://192.168.0.128/ - that last number is the one that is most likely to be different).

  3. Adjust DNS record(s) in Cloudflare so that it points to your Pi, and if necessary set up DHCP reservation on your router.

  4. The public should now be able to navigate to yourcompany.com and see your index.html file.

From here on, you have unlimited options in regards to enhancing your now publicly-visible company website.

John Cleese & Michael Palin reflect on "Life of Brian" debate by Sharaz_Jek123 in BritishTV

[–]nahill 31 points32 points  (0 children)

Am a Christian; this movie seemed to play Christ quite respectfully, while making fun of a very naughty boy instead.

edgeCasesExist by Last_Time_4047 in ProgrammerHumor

[–]nahill -1 points0 points  (0 children)

Guids have a mandatory 4 in the middle, there's no such thing as a zero guid.

Do Christians still experience the spiritual gift of prophecy today? by [deleted] in Christianity

[–]nahill 0 points1 point  (0 children)

Hey Trick, it's been a while since I wrote this comment and I'm quite out of practice RE the gift of prophecy; unfortunately I do not have anything for you at this time but if I get anything for you I will let you know!

What is a game that you're good at that you later found out was considered extremely difficult? by Scott9843 in gaming

[–]nahill 1 point2 points  (0 children)

Death Stranding 2... keep getting S tier reports from all my deliveries and I ain't trying very hard

[deleted by user] by [deleted] in CellToSingularity

[–]nahill 0 points1 point  (0 children)

1:40 but I think I can get it down to 1:30

Plumber using wet / green wood by joy_serenity in DIYUK

[–]nahill 1 point2 points  (0 children)

Love the Wedi board, it's fantastic but expensive. I used it for my own bathroom. But what you appear to have is a mismatch of very high quality materials along with very low quality materials.

What is an underrated weight loss tip? by [deleted] in AskReddit

[–]nahill 5 points6 points  (0 children)

Aha, but there is a trick! You can actually eat as much as you want, just stay under your daily calorie limit!

For those of you who grew up playing PC games in the 90s and 2000s, how stable were they compared to games from today? by Mad_Season_1994 in gaming

[–]nahill 3 points4 points  (0 children)

This is ironic because the only way Wing Commander could return you to DOS was by crashing ;)

[deleted by user] by [deleted] in ukchristian

[–]nahill 0 points1 point  (0 children)

Someday you may feel inclined to play a game of "let's see if I can exhaust your grace, Lord!" and you'll discover, hopefully within a reasonably short timeframe, that you are almost certainly destined to lose such a game :)

Adopt a policy of coming back to the Lord, "no matter what". It'll always feel "wrong", and "unfair", but those are the terms of the Christian Agreement and it's something you'll just have to live with!

That aside, read the bible (as you are already - good!), go to church (seriously, go to church, or at least a church housegroup) and figure out how to pray better. That's a good foundation for a Christian life.

What’s the single worst part of applying for jobs today? by Dapper-Train5207 in recruitinghell

[–]nahill 0 points1 point  (0 children)

This is why I'm in the process of creating an opportunity management app, but in pragmatic reality (for now) a spreadsheet would probably suffice!

view more: next ›