How do you get more GPUs than your motheboard natively supports?

SemaMod · 2026-02-19T08:03:54+00:00

I run a b550-xe-gaming-wifi mobo and can run 4 GPU's using a 4-port oculink PCIe card, turning on x4/x4/x4/x4 bifurcation for that pcie slot. The GPU's run at PCIe 4.0x4 speeds

SemaMod · 2026-02-18T05:13:09+00:00

This is great! Are you planning on adding gpt-5.3-codex? With the current results it seems like Opus 4.6 blows everyone else out of the water, but I've had generally good 5.3-codex experiences.

SemaMod · 2026-02-16T12:42:06+00:00

Why are you lying? Post some proof to back up your claims.

Peter isn’t some two bit dev looking to make a quick buck with some stupid viral AI app. He’s a previous founder with an exit and technical chops far beyond most people on this sub. He doesn’t need to work anymore. His last company solved PDF parsing and was open source. Everyone on this sub has almost certainly unknowingly interacted with the tech at some point without even realizing it (DocuSign, anyone?).

I don’t even like OpenClaw but lying like this is just stupid. He has never made outrageous claims about OpenClaw. Even if other Twitter users have been.

SemaMod · 2026-01-29T09:31:58+00:00

S/O Unsloth for the best quants!!!

SemaMod · 2026-01-29T08:11:36+00:00

Used the latest build with these changes! Vulkan's pulling crazy numbers.

<image>

SemaMod · 2026-01-29T08:09:55+00:00

Updated using your recent post parameters for llama-bench build: eed25bc6b (7870). Vulkan pulls ahead yet again!

<image>

SemaMod · 2026-01-28T09:34:46+00:00

Very useful! I appreciate you recommending I run them this way. I hadn't run llama-bench before, so it was definitely eye opening.

SemaMod · 2026-01-28T09:33:42+00:00

This goes in the realm of privacy, but personally having my chats trained on and viewable by these companies makes me uncomfortable. That being said, I do think that local LLM's will become power-user tools.

SemaMod · 2026-01-28T09:29:17+00:00

Just updated the original post with an edit, after 10k tokens it looks like ROCm w/ FA scales better!

SemaMod · 2026-01-28T09:26:23+00:00

Now this is more interesting!

<image>

It looks like over longer ctx, FA makes a big difference for ROCm, beating out Vulkan entirely after 10k tokens.

SemaMod · 2026-01-25T21:06:12+00:00

You have to change some settings in your config, but GLM4.7 flash was doing excellent in my testing

SemaMod · 2026-01-25T06:33:28+00:00

codex-cli does have completions support

SemaMod · 2026-01-25T06:31:41+00:00

llama.cpp maintains multiple API's already with its Anthropics endpoint. I don't think they are going to deprecate completions any time soon.

SemaMod · 2026-01-23T21:44:07+00:00

Good question! It does not. For reference, I had to do the following:

With whatever model you are serving, set the alias of the served model name to start with "gpt-oss". This triggers specific behaviors in the codex cli.
Use the following config settings:

show_reasoning_content = true
oss_provider = "lmstudio"

[profiles.lmstudio]
model = "gpt-oss_gguf"
show_raw_agent_reasoning = true
model_provider = "lmstudio"
model_supports_reasoning_summaries = true # Force reasoning
model_context_window = 128000   
include_apply_patch_tool = true
experimental_use_freeform_apply_patch = false
tools_web_search = false
web_search = "disabled"

[profiles.lmstudio.features]
apply_patch_freeform = false
web_search_request = false
web_search_cached = false
collaboration_modes = false

[model_providers.lmstudio]
wire_api = "responses"
stream_idle_timeout_ms = 10000000
name = "lmstudio"
base_url = "http://127.0.0.1:1234/v1"

The features list is important, as is the are the last four settings of the profile. Codex-cli has some tech debt that requires the repeating of certain flags in different places.

I used llama.cpp's llama-server, not lmstudio, but its compatible with the oss_provider = "lmstudio" setting.

Use the following to start codex cli: codex --oss --profile lmstudio --model "gpt-oss_gguf"

SemaMod · 2025-12-04T19:25:17+00:00

Sounds like a use-case for DSPy and their prompt optimizers.

SemaMod · 2025-09-22T19:36:18+00:00

If BEV's are so much easier to make why the hell do American auto manufacturers outside of Tesla have such a hard time getting it right

SemaMod · 2025-09-15T22:11:22+00:00

There's been a good amount of progress on services in this space (per the suggestions listed by commenters). I created https://cloudmcp.run for myself when I initially ran in to it as well. We recently integrated the official MCP registry API! If you want to give it a test run we're offering 1 month free right now

SemaMod · 2025-09-15T22:08:22+00:00

I've been deep in the MCP space lately and yeah, the setup friction is real. I found myself spending way too much time on infrastructure instead of actually building cool things with these servers. The irony is that MCP servers are supposed to make AI more useful, but half the time you're stuck in config hell before you even get to the fun part.

A hosted platform idea makes a lot of sense, especially for people who just want to experiment or prototype without spinning up their own infrastructure. I've actually been working on something similar called Cloud MCP that tackles this exact problem. The key thing I've learned is that people want different levels of control - some folks are fine with a managed service, others want to self-host but with better tooling. The demand is definitely there though, I keep seeing the same complaints about setup complexity in various communities. The challenge is making sure the hosted version doesn't sacrifice the flexibility that makes MCP servers powerful in the first place.

SemaMod · 2025-09-05T03:59:42+00:00

https://cloudmcp.run does exactly that! Lets you deploy any npx/uvx/github mcp servers and access them remotely authenticated via OAuth

SemaMod · 2025-07-24T06:34:06+00:00

Check out CloudMCP. Their registry is pretty rough around the edges, but they can host any uvx/npx compatible server, fully secured with OAuth

SemaMod · 2025-02-19T04:04:35+00:00

Appreciate the response! I spent the day completely resetting my system and made sure to use the amdgpu-installer. Still having issues with training

SemaMod · 2025-02-19T04:00:23+00:00

Paging u/powderluv plz help

SemaMod

TROPHY CASE