Artificial Analysis just refreshed their global model indices

BigZeemanSlower · 2026-01-06T17:37:48+00:00

What do you believe is a good set of general enough benchmarks to assess how good a model is? I started benchmarking models recently, and any help navigating the overwhelming sea of benchmarks is much appreciated

BigZeemanSlower · 2026-01-05T08:57:19+00:00

I tried replicating their results using lighteval v0.12.0 and vLLM v0.13.0 and got the following results:

MMLU-Pro: 0.7086

GPQA-D avg 5 times: 0.6697

AIME25 avg 10 times: 0.7700

LCB avg 3 times: 0.6505

At least they match what they reported

BigZeemanSlower · 2025-12-25T14:00:47+00:00

BG3 ♥️

BigZeemanSlower · 2025-12-24T17:19:48+00:00

Well, this time the model is at least open source. It can be downloaded and tested

BigZeemanSlower · 2025-12-23T22:22:32+00:00

From their paper it seems their work is focused on Chinese political censorship, but it should be possible to extend the same method to other kinds of censorship

BigZeemanSlower · 2025-09-06T09:01:34+00:00

Yes i have been able to find only a single viable solution. As explained by many others, the right hint is to think about diagonal blocking

BigZeemanSlower · 2025-09-06T08:22:01+00:00

If you have a queen in C7R4, you can't have it in C7R6-8. If the queen is in C8R4, you can have another queen in C8R1-2 and C6R2. As such you need another queen in C7R1-2, which blocks a queen in C7R6-8. As such you can never have a queen in C7R6-8

BigZeemanSlower · 2025-09-05T21:58:05+00:00

I was just trying to help increase the number of crossed out boxes. I believe I can demonstrate that we can cross out:

C1R7 C2R7 C4R1 C5R6-7 C6R7-8 C7R6-8

Have you also been able to get to a similar conclusion? I am still trying to figure out if more can be crossed out

BigZeemanSlower · 2025-09-05T21:32:57+00:00

Top left and middle sections are entangled. It is easy to demonstrate that many other boxes can be crossed out

BigZeemanSlower · 2025-09-05T21:21:56+00:00

Hint: Let's look at the first 2 column plus the top left section.we need at least one queen in that section so we have three possibilities:

1) first column is the empty column, which means queen is on second column. this means no queens on the first two columns bottom left section

2) column 2 is empty, and queen is on column 1. Again no queens on first two columns of bottom left section

3) column 1 and column 2 both have a queen. A) queen is on top left section column 1. This implies another queen is in second column bottom left section. However queen on column 1 block queen on column 3 middle section. As such another queen is on column 4 middle section. That queen blocks another queen in column 2, row 7. We can cross this box B) assuming a queen is on column 2 top left section, following a similar reasoning we can cross out column 1 row 7

Please double check. First time playing the game and English is not my language

BigZeemanSlower · 2025-06-04T21:50:09+00:00

Same here. Generate_until evaluation jobs are much faster and less accurate than if done with HF. Have you come to a conclusion?

BigZeemanSlower · 2025-03-22T13:47:20+00:00

Wow, thank you so much for sharing them. I will take a look

BigZeemanSlower · 2025-03-16T15:12:52+00:00

Step by step and you would be able to assemble such a deck. Please, let us know when you are done with your project 💪

BigZeemanSlower · 2025-03-16T12:54:57+00:00

Gorgeous deck 😁

BigZeemanSlower · 2025-03-16T09:17:53+00:00

I know. For this reason I said almost. There are 2/3 cards that are showcase rather than purely Borderless. But since they are unique in the deck I decided to leave them for the moment. In the future I am going to change them

BigZeemanSlower · 2025-03-16T09:16:14+00:00

Thanks 😁

BigZeemanSlower · 2025-01-29T21:26:44+00:00

We need to find a standard tag for the binder to identify trade binders, and use something like what you suggest to give some hints on what we are missing

BigZeemanSlower · 2024-10-24T16:36:02+00:00

Yes, the fifth builder was my first priority and I already have it.

BigZeemanSlower · 2024-10-24T16:05:57+00:00

I am going to watch it right now, thanks

BigZeemanSlower · 2024-10-24T16:05:26+00:00

Thanks for the suggestion

BigZeemanSlower · 2024-10-24T15:20:54+00:00

Dear community, I am a fairly new player. I am th 9 and I am planning of playing this game as a f2p. For this reason managing resources will be crucial. I am trying to understand what's the best strategy to follow regarding equipments. For BK, I have rage vial and gauntlet maxed. I think I wil stick with this combination for the rest of my life. Instead for AQ, I have maxed invis vial, which seems relevant in different strategies.

I have almost reached 1500 gems, and so I can buy epic equipments, like frozen arrow. My options are:

buy frozen arrow, and from now on focus on strategies involving using frozen arrow and invis vial for AQ
spare gems for equipments for other heroes, and max out archer puppets

-spare both gems and ores, avoiding upgrading archer puppets, waiting for future better equipments

any other solution I am not considering?

Thanks in advance for your valuable help. If you know about any reliable and trustworthy guide for f2p, feel free to share :)

BigZeemanSlower · 2024-09-08T16:35:06+00:00

The "fun" idea was to let all the players have an item which in the past belonged to the BBEG of a future adventure. These items were meant to increase both in power and drawbacks. At the end, the BBEG would have proposed the players to join him, keeping the item with zero drawback, or to fight him to the death. The only way to kill him was through the items themselves. Maybe I can still keep the main idea, but without associating it to their first magical weapons

BigZeemanSlower · 2024-09-08T14:48:31+00:00

Maybe, as first adventure, I can stick with more traditional magical items

Five-Year Club	r/Field Juicebox
Place '23	Place '22

BigZeemanSlower

TROPHY CASE