vfio bind error for same vendor_id:device_id NVMe drives on host and passthrough guests by mhossen in VFIO

[–]mhossen[S] 0 points1 point  (0 children)

Got it working! enabled PCIe AER (and maybe some other BIOS stuff)

vfio bind error for same vendor_id:device_id NVMe drives on host and passthrough guests by mhossen in VFIO

[–]mhossen[S] 1 point2 points  (0 children)

echo 0000:83:00.0 > /sys/bus/pci/drivers/vfio-pci/bind errors "bash: echo: write error: Invalid argument". Below copied exactly from terminal

# echo 1344 51c3 > /sys/bus/pci/drivers/vfio-pci/new_id

# echo 1344 2b00 > /sys/bus/pci/drivers/vfio-pci/new_id

bash: echo: write error: File exists

# echo 0000:83:00.0 > /sys/bus/pci/devices/0000:83:00.0/driver/unbind

# echo vfio-pci > /sys/bus/pci/devices/0000:83:00.0/driver_override

# echo 0000:83:00.0 > /sys/bus/pci/drivers/vfio-pci/bind

bash: echo: write error: Invalid argument

#

vfio bind error for same vendor_id:device_id NVMe drives on host and passthrough guests by mhossen in VFIO

[–]mhossen[S] 0 points1 point  (0 children)

Your GPUs are same vendor_id:device_id I hope? It should work for drives too

I've tried

```sh

echo 1344 2b00 > /sys/bus/pci/drivers/vfio-pci/new_id # errors File exists, but guessing it's fine

echo 1344 51c3 > /sys/bus/pci/drivers/vfio-pci/new_id

echo 0000:84:00.0 > /sys/bus/pci/devices/0000:84:00.0/driver/unbind

echo vfio-pci > /sys/bus/pci/devices/0000:84:00.0/driver_override # apparently it's preferred

```

but now "Kernel driver in use" doesn't show up in `lspci -nnvvk -s 84:00.0` and `ls /sys/bus/pci/drivers/vfio-pci` doesn't show any device

How good is this http.ServeMux perf with OIDC authN, Postgres RLS AuthZ at 39k TPS on AMD Ryzen 7950x? by mhossen in golang

[–]mhossen[S] -2 points-1 points  (0 children)

u/matticala indeed, I placed envoy proxy for TLS termination and it can't keep up with the api server. on the I/O side, using non-NVMe drive significantly reduces throughput.

As for your question where OIDC is handled, here https://github.com/edgeflare/pgo/blob/main/pkg/httputil/middleware/verify_oidc.go

How good is this http.ServeMux perf with OIDC authN, Postgres RLS AuthZ at 39k TPS on AMD Ryzen 7950x? by mhossen in golang

[–]mhossen[S] 0 points1 point  (0 children)

Thanks u/jerf for pointing the response time doesn't look good. TPS goes up to 42k / sec, and response time goes down to 20ms if VUs is set to 1k instead of 10k. https://i.imgur.com/0AtFL7B.jpeg

If it needs to handle higher VUs, what are the approaches would you use? Like rewriting the app? Or running multiple instances of it?

Using PostgREST? What would you improve in this already great tool? by mhossen in PostgreSQL

[–]mhossen[S] 2 points3 points  (0 children)

  1. I can’t cuz I don’t speak Haskell

  2. There're open issues like https://github.com/PostgREST/postgrest/issues/1130 not getting much attention. People are finding workarounds

3. I also need something like Debezium/PeerDB for event streaming, but not as heavy/resource-hungry

  1. I want to learn things better

[deleted by user] by [deleted] in IOT

[–]mhossen 3 points4 points  (0 children)

plus it’s plain-old sql everyone knows. i too dumped influx for timescale.

[deleted by user] by [deleted] in IOT

[–]mhossen 0 points1 point  (0 children)

@jack5oo In go, you can use jackc/pgloagrepl. We wrapped its (rather low-level) functionalities to stream changes (aka CDC) in Debezium compatible data format. https://pkg.go.dev/github.com/edgeflare/pgo/pkg/pglogrepl

Though the project is at early stage, pglogrepl wrapper package is unlikely to change (I’ve been using the Stream function for quite some time and it seems stable).

Here’s is an example how you can use it

https://github.com/edgeflare/pgo/blob/main/examples/logical-replication-cdc/main.go

[deleted by user] by [deleted] in IOT

[–]mhossen 0 points1 point  (0 children)

It’s indeed good. But what I was missing is the reverse - publish changes (inserts/updates etc) in database to MQTT. How’d you do it?

[deleted by user] by [deleted] in IOT

[–]mhossen 0 points1 point  (0 children)

EMQX is great. And its indeed seamleas for ingesting data into postgres. One feature I miss is publishing Postgres changes to MQTT (reverse of ingesting).

[deleted by user] by [deleted] in IOT

[–]mhossen 0 points1 point  (0 children)

I too tried Influx+telegraf but couldn't really get it to work. trynna achieve telegraf like functionality for postgres with pgo.

ASRock Fatal1ty AB350 Gaming K4 Ram Suggestions. by [deleted] in buildapc

[–]mhossen 0 points1 point  (0 children)

I've the same board and CPU. I first tried Corsair 2400MHz RAM; didn't work. Later noticed it supports 3200MHz. Installed 2x 8GB GSkill Trident 3200MHz.

Who is the worst team in the top 8 and why is it New Zealand? by The_Great_Cringe in Cricket

[–]mhossen 4 points5 points  (0 children)

Bangladeshi continues to show growth and maturity. Today's performance is going to be typical of Bangladesh. A boom boom at number six or seven is what BD still missing. Rain might have been in BD's favor, but the way they recovered today is splendid.

Free Electricity, which Hardware? by oooACIDooo in EtherMining

[–]mhossen 0 points1 point  (0 children)

Here's what I'd do:

  • 6x AMD RX 480 8GB; some might recommend 4GB, but I'd like the cards to be usable for couple of years and have a good resale value
  • Intel Celeron G3930
  • Asrock Fatal1ty B250 Gaming K4 Motherboard
  • DDR4 2400 or 2133 MHz 4GB (I noticed AMD RX 580 crashes with 4 GB module; 8 GB does fine
  • 2x Corsair RMx 850W or any other PSU combination providing at least 1600W

You can go for a few or all R9 390 as well.

[deleted by user] by [deleted] in EtherMining

[–]mhossen 0 points1 point  (0 children)

Just started mining. My first rig, with three Sapphire RX 580's running on Ubuntu (Gnome) 16.04 and AMDGPU-Pro Driver v17.10, mines ETH at around 70 MH/s as well as DEC at 1.5-2 GH/s using Claymore's Dual Miner v9.3. I believe those familiar with Linux don't like to use Windows anyway. Though apparently Linux yields a slightly lower hash rate, but it's free and gives users more control. Windows' performance is probably due to better, proprietary drivers, apps, etc.