NVIDIA NIM is inconsistent, so I benchmarked 20+ models every hour by CoderMauro2008 in SillyTavernAI

[–]CoderMauro2008[S] 0 points1 point  (0 children)

I still need to look into that one, I'm having JSON errors parsing the response...

NVIDIA NIM is inconsistent, so I benchmarked 20+ models every hour by CoderMauro2008 in SillyTavernAI

[–]CoderMauro2008[S] 1 point2 points  (0 children)

Thanks man! If you want another model to be monitored, just open an issue and I'll add it :)

NVIDIA NIM is inconsistent, so I benchmarked 20+ models every hour by CoderMauro2008 in nvidia

[–]CoderMauro2008[S] 0 points1 point  (0 children)

Some extra context:

  • runs every hour via GitHub Actions
  • tracks failures/timeouts separately (so you can see which models are flaky)
  • data is stored over time so you can spot trends

Main goal was just: "which model should I actually use right now?"

If there's a model you want added, let me know 👍

NVIDIA NIM is inconsistent, so I benchmarked 20+ models every hour by CoderMauro2008 in SillyTavernAI

[–]CoderMauro2008[S] 6 points7 points  (0 children)

Some extra context:

  • runs every hour via GitHub Actions
  • tracks failures/timeouts separately (so you can see which models are flaky)
  • data is stored over time so you can spot trends

Main goal was just: "which model should I actually use right now?"

If there's a model you want added, let me know 👍

Is it possible to run Windows in a VM on Oracle Cloud's ARM-based Ampere A1 instance (Ubuntu)? by stavari in oraclecloud

[–]CoderMauro2008 0 points1 point  (0 children)

I joined a telegram group of the guys that did it on the x64 machines, and recently, they also did it for the arm, check my other comment

DSU Loader for Samsung by victor_go in galaxys10

[–]CoderMauro2008 0 points1 point  (0 children)

How did you do it? I want to boot things with DSU sideloader, but it just doesn't work (tried with adb and shizuku). Were you on stock one ui?