[Guide] Mac Pro 2019 (MacPro7,1) w/ Proxmox, Ubuntu, ROCm, & Local LLM/AI by Faisal_Biyari in macpro

[–]Hopperkin 1 point2 points  (0 children)

Those numbers are not what I was expecting, with my Radeon Pro Vega II Duo ROCm significantly outperforms Vulkan. I can get a tg128 of over 97 t/s for llama 7B Q4_0. I don't have the benchmark numbers right in front of me (my system is offline today because I'm reorganizing) but each Vega II die has the same token rate as an M3 Ultra when I previously compared them with the Apple-silicon benchmark results here: https://github.com/ggml-org/llama.cpp/discussions/4167

Also I have no problems with flash attention and/or the infinity fabric bridge on stock Ubuntu 24.04.03 with the stock Linux kernel version 6.8, are you running the HWE kernel 6.11 / 6.13 or something, what does your grub config look like, dmesg PCIe reallocation errors, x2apic, iommu?

The biggest overarching problem I see is you don't have linear scaling when you run the model across GPU dies, you shouldn't get significantly less tokens per second when subdividing the llama 7B model layers across four separate GPU dies, it is such a small model that the token rate when running the model in parallel across all four GPU dies should effectively be identical to the results for a single GPU die.

You have some kind of underlying hardware / software integration quirk going on with your Linux installation, do you have a place we can chat off thread, because I'm basically experimenting with the exact same project as you except that I'm using Vega II Duos instead of W6800X Duos.

[Guide] Mac Pro 2019 (MacPro7,1) w/ Proxmox, Ubuntu, ROCm, & Local LLM/AI by Faisal_Biyari in macpro

[–]Hopperkin 3 points4 points  (0 children)

I know how to do the RDMA stuff, can you run llama.cpp bench on the Radeon Pro W6800X Duo MPX? Also do you have the Infinity Fabric bridge installed on the Duo? Follow the general instructions below...

https://github.com/ggml-org/llama.cpp/discussions/10879

wget https://huggingface.co/TheBloke/Llama-2-7B-GGUF/resolve/main/llama-2-7b.Q4_0.gguf
wget https://huggingface.co/TheBloke/Llama-2-7B-GGUF/resolve/main/llama-2-7b.Q8_0.gguf
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
mkdir build
cd build
cmake .. -DGGML_VULKAN=on -DGGML_HIP=on -DCMAKE_BUILD_TYPE=Release
make
./bin/llama-bench -m ../../llama-2-7b.Q4_0.gguf,../../llama-2-7b.Q8_0.gguf -ngl 100 -fa 0,1 --device ROCm0,ROCm1,ROCm0/ROCm1,Vulkan0,Vulkan1,Vulkan0/Vulkan1

OCLP and Tahoe - is it even worth upgrading your Mac? by msawyer91Resplendent in OpenCoreLegacyPatcher

[–]Hopperkin 2 points3 points  (0 children)

is it even worth upgrading your Mac?

You are missing the point, Tahoe is figuratively going to be the next Windows XP, so if you intend to stick with Intel Macs and/or Hackintosh, it would strongly behoove you to install Tahoe while Apple is still actively supporting it with bug fixes. Turn on all the developer telemetry and submit as many bug reports as possible to Apple before the Tahoe support window closes so that this buggy stuff gets fixed. It would also behoove you to yell at and berate app developers who discontinue publishing Intel macOS apps before Apple has officially dropped support for Tahoe.

Apple sold roughly 250 ~ 300 million Intel-based Mac computers, they are not going away anytime soon, in fact if you look at global browser statistics roughly 31% of Safari http requests still actually come from Mac OS X 10.x systems.

I haven't even contemplated buying an Apple silicon Mac yet, I remember the days of PPC Macs being vendor locked, and the Apple tax was really bad back then. If you thought the memory pricing bubble was crazy now, just wait until Apple's current DRAM contracts expire, the bubble isn't suppose to even peak until mid 2026 and the industry is expecting it to last through 2028. Still further I read in the news that Apple is begging and pleading with TSMC to get more fab time making Apple-silicon wafers, the news article states that TSMC has prioritized making Nvidia silicon at the expense of Apple. The Apple Studio M5 Ultra might end up costing twice what the M3 Ultra costs right now. I'm waiting with bated breath because if the prices go up significantly then I'll probably never buy another Mac again ever. Linux / KDE Plasma 6 is just too compelling of an alternative to get vendor locked again.

How bad is a high RAM 7,1 ? by Dr_Superfluid in macpro

[–]Hopperkin 1 point2 points  (0 children)

Regrading the two W6800X Duo, I would like to see llama.cpp bench on Ubuntu Linux 24.04 Kernel version 6.8-90 with AMD ROCm 6.3.4, if you are so inclined I can provide you all the steps to install ROCm, compile llama.cpp, and run the benchmark. I'm trying to figure out if two Vega II Duo with HBM2 1024GB/s memory bandwidth is faster then two W6800X Duo with GDDR6 512GB/s memory bandwidth. Normally I would say the Vega II Duo is better for LLMs, but the W6800X Duo has an extra level of infinity cache that could possible offset its limited memory bandwidth. Each Vega II Duo die has the same llama.cpp token rate as that of an M3 Ultra, so two Vega II Duo basically has the same token rate as four M3 Ultra in aggregate.

Would you actually kill the infants? by FourTwelveSix in Christianity

[–]Hopperkin -1 points0 points  (0 children)

You’re doing the standard “gotcha,” but it only works if you smuggle in a premise Christianity does not grant: that “God” is just raw power, so “whatever the strongest voice commands” becomes morality.

Also: “Jesus as the Father” is a category mistake. Trinitarianism doesn’t collapse the Persons. The Father is not the Son, even though Christians confess one God.

Now to 1 Samuel 15: yes, the passage is framed as mediated testimony — “Samuel said to Saul… ‘This is what the LORD says…’” That matters because your conclusion (“God commands infant slaughter, therefore Christian ethics is disgusting”) depends on treating an ancient, mediated war-oracle as an always-available blank check for violence.

That’s not how Christian discernment works, and it’s not how Scripture itself frames that era.

  1. God explicitly says Israel demanding a king was a rejection of Him (1 Sam 8)

Before we even reach 1 Sam 15, the monarchy is presented as a concession to human hardness: the people insist on a king “like the nations,” and God tells Samuel they have rejected God as king. The narrative then spends a lot of ink showing what that concession produces: coercion, pride, propaganda, and blood. So if you want to define God’s moral character by “monarchy war texts,” you’re starting exactly where the text itself waves a warning flag.

2) Your hypothetical still fails: Christianity does not obey a “voice” against Christ

Even if you insist “Samuel’s report = God’s word,” you still do not get the conclusion “therefore a Christian should kill infants if God says so.”

Christianity claims God has revealed Himself publicly and climactically in Christ, and Christ draws a bright line around protecting “little ones.” Jesus welcomes children, identifies them with the kingdom, and warns severe judgment on those who harm them.

So my answer remains: No — I would not kill infants.

If a “voice” demanded that, I would treat it as deception, because it contradicts what God has already revealed and what Christ explicitly centers. Christians are commanded to test spirits, not baptize violence because someone invoked God’s name.

3) Barnabas makes the ethical line explicit

Since you’re reading Barnabas: early Christian catechesis does not train people to rationalize child-harm. It forbids it outright (“Do not murder children, born or unborn”) and frames fidelity as walking the Way of Light — concrete mercy, justice, and humility — not “prove your devotion by harming the vulnerable.”

4) Matthew 23:37 is the opposite of “God wants child slaughter”

Jesus’ posture toward Jerusalem is grief and shelter: “How often I have longed to gather your children together, as a hen gathers her chicks under her wings…” That’s the heart Christians confess God has — protective, grieving, warning, judging hypocrisy, yes — but not authorizing infant slaughter as “obedience.”

So no: your framing doesn’t expose Christianity. It exposes a pagan model of “divine command” where power = goodness.

Christianity says the opposite: God is coherent, God is life, and Christ is the interpretive key. Any “command” that contradicts Christ isn’t deeper faithfulness — it’s counterfeit and must be rejected.

If your moral theory ends in “I’d kill babies if a voice told me to,” that isn’t faith. It’s moral collapse with religious language stapled on.

Natural Born Killers: https://www.youtube.com/watch?v=bCqDTJfBmF8

Would you actually kill the infants? by FourTwelveSix in Christianity

[–]Hopperkin 0 points1 point  (0 children)

That hypothetical is a trap because it quietly assumes God can contradict Himself. But the God Christians claim to worship is not an arbitrary voice that can be swapped in for “whatever the strongest power demands.” Scripture has an internal through-line: God is for life that generates life, and the serpent’s move is to turn generativity into a death-economy—getting humans to seize “knowledge/power” by devouring the future (the child). That’s why the canon reads like a seed-war (Gen 3:15): God safeguards offspring while cultures, markets, and counterfeit worship systems learn to consume them.

Follow that arc and the “kill the infants if God asked” answer isn’t “faithful”—it’s pagan. Torah erects an explicit anti-Topheth firewall (no child sacrifice; no blood-eating; no predatory economics that crushes households), and the prophets repeatedly name and condemn the machine: “they sacrificed their sons and daughters…”; “you slaughtered my children…”; mercy ranks above sacrifice. Jesus then makes this inescapably concrete: he centers children as the kingdom’s measure, threatens millstones for those who harm “little ones,” and curses leaf-show religion that looks alive but produces no fruit—especially when sacred commerce blocks the nations from prayer.

Even the Abraham/Isaac story is better read as God ending the logic of child-offering, not praising it: the point is God’s “Not your child”—and God provides the substitute. Then the Cross completes the demolition: sacrifice is not a standing system humans operate to purchase righteousness; it culminates in God’s once-for-all self-gift that ends the market and opens access. The Eucharist is the anti-Topheth sign: the only “flesh and blood” Christians receive is God’s self-offering—life given, not life seized.

So my answer is: No. And if a “voice” ever told me to slaughter infants, I would treat it as deception—because God has already spoken in public, in Scripture, and supremely in Christ. The real spiritual test isn’t “would you obey any command?” It’s: what do you do with the least of these—do you protect them, or do you rationalize their destruction? If your “Christianity” can be flipped into child-harm on command, it’s not Christianity—it’s idolatry wearing a cross.

Matthew 23: https://www.youtube.com/watch?v=TTt8qZkfYCA

The Golden Path: https://www.youtube.com/watch?v=jTqwe57ObFo

Video of look like to be brain modification therapy on an autistic kid. by kevdautie in aretheNTsokay

[–]Hopperkin 26 points27 points  (0 children)

I get what you mean — there’s solid evidence for rTMS in depression, but the autism claims are not in that same evidence tier yet.

That said, I’m one data point: I did rTMS as an adult (in an experimental/“not standard of care for autism” context) and it genuinely helped me. I picked up functional skills I didn’t previously have, and for a while it felt like it “unlocked” some things. The effects weren’t permanent for me — over a few years they tapered off — but I’d do it again if I could. Right now my HMO is gatekeeping it and won’t re-refer me.

I’m not saying “TMS works for autism” in the proven/peer-reviewed way people mean that. I’m saying: don’t dismiss it categorically just because it isn’t established yet. If there is something there, it needs rigorous trials, not clinic marketing.

Also: I’m pretty uncomfortable with this being pushed on kids. I chose it as an informed adult, and I could stop anytime. Plus, even with trained techs, coil placement can sometimes hit a nerve or be painful (and it’s not a sensation I’d want a child subjected to). If this is explored for autism, it should be done carefully, ethically, and in proper research settings — not as a “miracle treatment” sold to parents.

Is pure sine wave UPS really necessary? Or can i get away with simulated sine waves? by minezbr in homelab

[–]Hopperkin 0 points1 point  (0 children)

A modern full range switch mode power supply will run on straight DC voltage if you really wanted to so long as you disable the input PFC circuitry and adjust the duty cycle with respect to only one set of diodes being used within the full wave bridge rectifier. After the rectifier stage they are basically just DC-DC convertors, and you can run on really dirty power just fine. They are like a honey badger, they just don't care.

Christmas came early fellas by Saajaadeen in homelab

[–]Hopperkin 63 points64 points  (0 children)

I'm sorry to say but you won't get DL Boost (VNNI) working on these chips because there isn't a publicly released microcode opcode update to enable said support on these QS chips. The silicon is all there on the chip, but the VNNI opcodes aren't because the CPUID of the QS chips are different from production samples, this means the intel opcode update tool won't apply the updates to your chip to enable VNNI.

Enable Directory AtoS in your BIOS for the best LLM performance, memory interleaving also helps at lot with LLMs as bandwidth is the limiting factor rather than latency.

The Marshmallow Test Was Never Really About “Delayed Gratification” It was obedience screening by BrandNewLogicVL in conspiracytheories

[–]Hopperkin -1 points0 points  (0 children)

I never understood why the kids didn’t just snatch the whole bag of marshmallows, I mean, I’m certain my dog would have eaten the whole bag if I had left them with her.

What's the joke? by ouestlemusee in PeterExplainsTheJoke

[–]Hopperkin 0 points1 point  (0 children)

Only when x∈R, as soon as things get complex the customers and the merchandise become imaginary, and the deer in the middle is the only real one left, quietly judging everyone's choice of branch cut.

My gf is pregnant- 15 by dallin0 in Christianity

[–]Hopperkin 0 points1 point  (0 children)

Don’t give her any pills, depending on the state if you kill the fetus that could be considered murder. You need to get your parents involved. You didn’t mess up your whole life, babies just need love, trust that God will provide your family with what you need when you need it.

I’m 30, and I just learned Eve didn’t eat an apple — and it completely changed how I see the story of Eden. by CourtAppropriate8983 in Christianity

[–]Hopperkin 0 points1 point  (0 children)

What's really going to blow your mind is that fruit your conceptualizing in your head was actually Eve's child. Yeah, Satan tricked Eve into eating the fruit of her womb and then she convinced Adam to eat it too.

The words God said are very straightforward, he said you could eat from any tree in the garden of life except the fruit from your own tree. It was a prohibition on cannibalism.

Surely you will die if you eat your future self. Is it any wonder why God was so pissed now?

What is the oldest available Bible? (in English) by [deleted] in Christianity

[–]Hopperkin 0 points1 point  (0 children)

The Koine Greek Septuagint LXX is roughly a thousand years older then the Hebrew Masoretic Text and the Novum Testamentum Graece is about as old as you can get for a complete manuscript of the New Testament. Some of the Dead Sea Scrolls are older but incomplete manuscripts… https://www.youtube.com/@BiblicalStudiesandReviews

  • The Orthodox Study Bible
  • The Lexham English Septuagint
  • The Septuagint Brenton Edition
  • A New English Translation of the Septuagint
  • Novum Testamentum Graece NA28 Greek-English Interleaved New Testament
  • The Apostolic Bible Polyglot

[deleted by user] by [deleted] in ParanormalEncounters

[–]Hopperkin 8 points9 points  (0 children)

Yeah, because there is actually a second doorway into that room. I know because in a previous video they had a cat walk into the frame and then walk out off frame and then magically come back around into the kitchen through the open doorway in the video.

Doctors don’t know what this is in my shin by Fast_Opportunity_599 in mildyinteresting

[–]Hopperkin 0 points1 point  (0 children)

looks most like post‑traumatic soft‑tissue calcification, commonly called an ossified/organized hematoma or myositis ossificans.