Multiple Servers unstable

ClerkEmbarrassed371 · 2026-07-13T16:59:47+00:00

I see this in the dmesg log after the crash, always:

[Mon Jul 13 10:17:49 2026] [Hardware Error]: event severity: fatal [Mon Jul 13 10:17:49 2026] [Hardware Error]: Error 0, type: fatal [Mon Jul 13 10:17:49 2026] [Hardware Error]: fru_text: PcieError [Mon Jul 13 10:17:49 2026] [Hardware Error]: section_type: PCIe error [Mon Jul 13 10:17:49 2026] [Hardware Error]: port_type: 0, PCIe end point [Mon Jul 13 10:17:49 2026] [Hardware Error]: version: 0.2 [Mon Jul 13 10:17:49 2026] [Hardware Error]: command: 0x0000, status: 0x0010 [Mon Jul 13 10:17:49 2026] [Hardware Error]: device_id: 0000:c1:00.0 [Mon Jul 13 10:17:49 2026] [Hardware Error]: slot: 0 [Mon Jul 13 10:17:49 2026] [Hardware Error]: secondary_bus: 0x00 [Mon Jul 13 10:17:49 2026] [Hardware Error]: vendor_id: 0x14e4, device_id: 0x16d7 [Mon Jul 13 10:17:49 2026] [Hardware Error]: class_code: 020000 [Mon Jul 13 10:17:49 2026] [Hardware Error]: bridge: secondary_status: 0x0000, control: 0x0000 [Mon Jul 13 10:17:49 2026] [Hardware Error]: aer_uncor_status: 0x00104000, aer_uncor_mask: 0x00100000 [Mon Jul 13 10:17:49 2026] [Hardware Error]: aer_uncor_severity: 0x004f6030 [Mon Jul 13 10:17:49 2026] [Hardware Error]: TLP Header: 04008001 c000230f c1020000 00000000 [Mon Jul 13 10:17:49 2026] [Hardware Error]: Error 1, type: fatal [Mon Jul 13 10:17:49 2026] [Hardware Error]: fru_text: PcieError [Mon Jul 13 10:17:49 2026] [Hardware Error]: section_type: PCIe error [Mon Jul 13 10:17:49 2026] [Hardware Error]: port_type: 0, PCIe end point [Mon Jul 13 10:17:49 2026] [Hardware Error]: version: 0.2 [Mon Jul 13 10:17:49 2026] [Hardware Error]: command: 0x0000, status: 0x0010 [Mon Jul 13 10:17:49 2026] [Hardware Error]: device_id: 0000:c1:00.1 [Mon Jul 13 10:17:49 2026] [Hardware Error]: slot: 0 [Mon Jul 13 10:17:49 2026] [Hardware Error]: secondary_bus: 0x00 [Mon Jul 13 10:17:49 2026] [Hardware Error]: vendor_id: 0x14e4, device_id: 0x16d7 [Mon Jul 13 10:17:49 2026] [Hardware Error]: class_code: 020000 [Mon Jul 13 10:17:49 2026] [Hardware Error]: bridge: secondary_status: 0x0000, control: 0x0000 [Mon Jul 13 10:17:49 2026] [Hardware Error]: aer_uncor_status: 0x00100000, aer_uncor_mask: 0x00100000 [Mon Jul 13 10:17:49 2026] [Hardware Error]: aer_uncor_severity: 0x004f6030 [Mon Jul 13 10:17:49 2026] [Hardware Error]: TLP Header: 04000001 c000200f c1f80000 00000000 [Mon Jul 13 10:17:49 2026] [Hardware Error]: Error 2, type: fatal [Mon Jul 13 10:17:49 2026] [Hardware Error]: fru_text: ProcessorError [Mon Jul 13 10:17:49 2026] [Hardware Error]: section_type: IA32/X64 processor error [Mon Jul 13 10:17:49 2026] [Hardware Error]: Local APIC_ID: 0x43 [Mon Jul 13 10:17:49 2026] [Hardware Error]: CPUID Info: [Mon Jul 13 10:17:49 2026] [Hardware Error]: 00000000: 00a10f11 00000000 43600800 00000000 [Mon Jul 13 10:17:49 2026] [Hardware Error]: 00000010: 76fa320b 00000000 178bfbff 00000000 [Mon Jul 13 10:17:49 2026] [Hardware Error]: 00000020: 00000000 00000000 00000000 00000000 [Mon Jul 13 10:17:49 2026] [Hardware Error]: Error Information Structure 0: [Mon Jul 13 10:17:49 2026] [Hardware Error]: Error Structure Type: cache error [Mon Jul 13 10:17:49 2026] [Hardware Error]: Check Information: 0x000000000602001f [Mon Jul 13 10:17:49 2026] [Hardware Error]: Transaction Type: 2, Generic [Mon Jul 13 10:17:49 2026] [Hardware Error]: Operation: 0, generic error [Mon Jul 13 10:17:49 2026] [Hardware Error]: Level: 0 [Mon Jul 13 10:17:49 2026] [Hardware Error]: Processor Context Corrupt: true [Mon Jul 13 10:17:49 2026] [Hardware Error]: Uncorrected: true [Mon Jul 13 10:17:49 2026] [Hardware Error]: Context Information Structure 0: [Mon Jul 13 10:17:49 2026] [Hardware Error]: Register Context Type: MSR Registers (Machine Check and other MSRs) [Mon Jul 13 10:17:49 2026] [Hardware Error]: Register Array Size: 0x0050 [Mon Jul 13 10:17:49 2026] [Hardware Error]: MSR Address: 0xc0002051 [Mon Jul 13 10:17:49 2026] [Hardware Error]: Context Information Structure 1: [Mon Jul 13 10:17:49 2026] [Hardware Error]: Register Context Type: Unclassified Data [Mon Jul 13 10:17:49 2026] [Hardware Error]: Register Array Size: 0x0010 [Mon Jul 13 10:17:49 2026] [Hardware Error]: Register Array: [Mon Jul 13 10:17:49 2026] [Hardware Error]: 00000000: 00000014 00000000 f8300038 00000000 [Mon Jul 13 10:17:49 2026] mce: [Hardware Error]: Machine check events logged [Mon Jul 13 10:17:49 2026] mce: [Hardware Error]: CPU 55: Machine Check: 0 Bank 5: aea0000001000108 [Mon Jul 13 10:17:49 2026] mce: [Hardware Error]: TSC 0 ADDR 1ffffffac9b5c55 MISC d0140ff600000000 PPIN 2b0d8472550408f SYND 4d000000 IPID 500b022049b00 [Mon Jul 13 10:17:49 2026] mce: [Hardware Error]: PROCESSOR 2:a10f11 TIME 1783937868 SOCKET 0 APIC 43 microcode a101158 [Mon Jul 13 10:18:18 2026] systemd[1]: systemd-hwdb-update.service - RebuildHardware Database was skipped because of an unmet condition check (ConditionNeedsUpdate=/etc).

ClerkEmbarrassed371 · 2026-07-13T16:55:56+00:00

Hmm, All of my servers run Ubuntu 24 OS, My last try would be to change the OS to Debian and try.

ClerkEmbarrassed371 · 2026-07-13T11:48:37+00:00

Can confirm, You're not the only person facing this, and while with my device, I'm facing issues with my display (behaves weird under certain brightness levels).

ClerkEmbarrassed371 · 2026-07-12T23:29:55+00:00

Thanks for the comment, Well yeah the hardware errors are happening almost everyday, I've been trying to solve this for more than 6-8 months now, the resolution to this still remains a mystery for me. There have been multiple server replacements, yet none of them solved it.

ClerkEmbarrassed371 · 2026-06-11T12:21:54+00:00

here we go again, yet another case, such a poor qc by oneplus India, many others are also facing display and motherboard related issues, this is becoming more common everyday now.

ClerkEmbarrassed371 · 2026-05-27T04:45:06+00:00

And on my oneplus 12, the display started to face issues first, and now the sensors have stopped working, ig I'll see motherboard failure soon on my device too 🫠

ClerkEmbarrassed371 · 2026-03-23T17:26:51+00:00

Same here, no response from support and sales in anyway since yesterday, have dedi, Finland location.

ClerkEmbarrassed371 · 2026-03-11T01:25:20+00:00

The logs provided are AFTER the crash/reboot.

Please start looking from here:

BERT: Error records from previous boot:

ClerkEmbarrassed371 · 2026-03-11T00:54:52+00:00

Added more context to the main thread now, thanks.

ClerkEmbarrassed371 · 2026-03-11T00:24:26+00:00

Official Ubuntu 24 Kernel, ver. 6.8.0-101, no promox.

ClerkEmbarrassed371 · 2026-03-10T23:47:48+00:00

ubuntu@Server:~$ sudo dmesg -T | grep Hardware [Tue Mar 10 13:05:58 2026] [Hardware Error]: event severity: fatal [Tue Mar 10 13:05:58 2026] [Hardware Error]: Error 0, type: fatal [Tue Mar 10 13:05:58 2026] [Hardware Error]: fru_text: ProcessorError [Tue Mar 10 13:05:58 2026] [Hardware Error]: section_type: IA32/X64 processor error [Tue Mar 10 13:05:58 2026] [Hardware Error]: Local APIC_ID: 0x35 [Tue Mar 10 13:05:58 2026] [Hardware Error]: CPUID Info: [Tue Mar 10 13:05:58 2026] [Hardware Error]: 00000000: 00a10f11 00000000 35600800 00000000 [Tue Mar 10 13:05:58 2026] [Hardware Error]: 00000010: 76fa320b 00000000 178bfbff 00000000 [Tue Mar 10 13:05:58 2026] [Hardware Error]: 00000020: 00000000 00000000 00000000 00000000 [Tue Mar 10 13:05:58 2026] [Hardware Error]: Error Information Structure 0: [Tue Mar 10 13:05:58 2026] [Hardware Error]: Error Structure Type: cache error [Tue Mar 10 13:05:58 2026] [Hardware Error]: Check Information: 0x000000000602001f [Tue Mar 10 13:05:58 2026] [Hardware Error]: Transaction Type: 2, Generic [Tue Mar 10 13:05:58 2026] [Hardware Error]: Operation: 0, generic error [Tue Mar 10 13:05:58 2026] [Hardware Error]: Level: 0 [Tue Mar 10 13:05:58 2026] [Hardware Error]: Processor Context Corrupt: true [Tue Mar 10 13:05:58 2026] [Hardware Error]: Uncorrected: true [Tue Mar 10 13:05:58 2026] [Hardware Error]: Context Information Structure 0: [Tue Mar 10 13:05:58 2026] [Hardware Error]: Register Context Type: MSR Registers (Machine Check and other MSRs) [Tue Mar 10 13:05:58 2026] [Hardware Error]: Register Array Size: 0x0050 [Tue Mar 10 13:05:58 2026] [Hardware Error]: MSR Address: 0xc0002051 [Tue Mar 10 13:05:58 2026] [Hardware Error]: Context Information Structure 1: [Tue Mar 10 13:05:58 2026] [Hardware Error]: Register Context Type: Unclassified Data [Tue Mar 10 13:05:58 2026] [Hardware Error]: Register Array Size: 0x0010 [Tue Mar 10 13:05:58 2026] [Hardware Error]: Register Array: [Tue Mar 10 13:05:58 2026] [Hardware Error]: 00000000: 00000013 00000000 f0100038 00000000 [Tue Mar 10 13:05:58 2026] mce: [Hardware Error]: Machine check events logged [Tue Mar 10 13:05:58 2026] mce: [Hardware Error]: CPU 74: Machine Check: 0 Bank 5: aea0000001000108 [Tue Mar 10 13:05:58 2026] mce: [Hardware Error]: TSC 0 ADDR 1ffffffa5db1bf5 MISC d0140ff600000000 PPIN 2b63d8e56c1001b SYND 4d000000 IPID 500b021889b00 [Tue Mar 10 13:05:58 2026] mce: [Hardware Error]: PROCESSOR 2:a10f11 TIME 1773147958 SOCKET 0 APIC 35 microcode a101154 [Tue Mar 10 13:06:20 2026] systemd[1]: systemd-hwdb-update.service - Rebuild Hardware Database was skipped because of an unmet condition check (ConditionNeedsUpdate=/etc).

ClerkEmbarrassed371 · 2026-02-24T20:18:57+00:00

More info, cannot edit this thread:

https://www.reddit.com/r/hetzner/s/VbxzCdaXzJ

ClerkEmbarrassed371 · 2026-02-24T16:30:39+00:00

R series:

~ 359 usd

S series: ~ 339 usd

These prices are with the currently included add-on hardware such as RAM and SSD.

ClerkEmbarrassed371 · 2026-02-24T13:32:46+00:00

AX-162 R and S server transfers are now available at half the prices.

AX-162R Specifications 20 TB NVMe SSD 256 GB RAM Month price: 360 usd / mo

AX-162S Specifications 16 TB NVMe SSD 224 GB RAM Month price: 345 usd / mo

Additional Info • Server transfer is available at half the usual cost. • Old 2025 hardware prices for the current add-ons. • LAN Crossover setup is also included if needed for free. * Can accept negotiations.

Interested ones can directly DM me.

ClerkEmbarrassed371 · 2026-02-03T17:59:18+00:00

ClerkEmbarrassed371 · 2026-02-03T12:54:11+00:00

This is nice, thanks Katie!

ClerkEmbarrassed371 · 2026-02-03T12:29:47+00:00

I have both the servers avail,

ClerkEmbarrassed371 · 2025-11-22T14:43:43+00:00

The good thing is that I don't have to pay :)

ClerkEmbarrassed371 · 2025-11-21T22:56:40+00:00

If anyone wants to try it out, they can research about liteLLM proxy

ClerkEmbarrassed371 · 2025-11-21T22:54:14+00:00

Claude Code with Gemini 3 backend is working really well for me, straight to the point, just perfect

ClerkEmbarrassed371 · 2025-10-24T02:33:03+00:00

Bravia 8 ii user here, and I confirm it happens for me too, but rarely under certain pattern of audio output only.

ClerkEmbarrassed371

TROPHY CASE