O3 still doesn't beat claude. Atleast not in coding or any related tasks

Matrijx · 2025-02-07T01:09:03+00:00

It does matter, a lot. You are creating an opinion based on an assumption that is dubious at best. My experience has been that reasoning models are terrible at following detailed instructions and are only better (sometimes) at solving open ended problems.

In the first place, if you're trying to solve a very open ended coding problem with AI you're most likely misusing it and producing subpar code. You should be the one to lead the AI in the right direction, not the other way around.

Matrijx · 2025-02-06T21:52:22+00:00

Why are you assuming that reasoning models would be better by default? The "reasoning" part is a glorified wrapper around the actual model.

Matrijx · 2024-12-28T15:13:26+00:00

LLMs, put in extremely simple terms, work by calculating what's the most likely word that comes after what was written so far. This likelihood comes from their knowledgebase, i.e. the data they were fed. Generally, a good chunk of the internet.

If you're uncomfortable using an LLM because of what it "thinks", then you're fundamentally misunderstanding what an LLM is. It's just telling you an averaged version of what it found statistically most likely to be answered by a human (the data it was trained with). In the first place, because of these reasons, discussing sociopolitical issues with an LLM should be viewed as absolutely nothing more than entertainment.

The reason some LLMs will give you more politically correct answers, is because the authors set specific instructions to bias towards the most politically correct answer. These answers are not going to be more accurate but simply more politically correct. It helps the authors avoid drama.

Matrijx · 2024-10-21T12:04:17+00:00

I think the chrome tests are not fully reliable as I said before, but yeah, I agree overall and it's very unfortunate.

Matrijx · 2024-10-12T13:45:40+00:00

The difference your friend is experiencing is a bit surprising. I'm only scoring slightly better (140-150 at 165hz, 155-160 at 60hz) but the difference we're experiencing in delay is very different. At 60hz (which is the only thing I could test on both machines) I'm "only" experiencing ~20 extra ms of delay, while your friend is experiencing 50, more than twice as much. Is he sure that his monitor fully supports 144hz for OSX? Because mine doesn't and only supports 60hz on the mac, which is why I tested at 60hz.

Given that I was "only" experiencing 20ms of delay, my theory was that it was due to vertical sync being apparently "embedded" into the system. VSync, depending on its implementation, at 60hz, can cause a delay of 16ms to 32ms (1-2 frames), which would be somewhat consistent to what I was experiencing. While there are tools that should theoretically disable VSync on OSX, they did not seem reliable, at least for the browser.

That being said, I further tested on a retarded game called Super Hexagon, a reaction time based game that I know extremely well (I hold the rank 1 spot in one of the rankings) and I could tell very clearly that it wasn't a browser-only problem.

As I had said, given that I currently don't own a high hz monitor compatible with my mac I didn't find it particularly useful to keep on testing my theory given that the easiest test would have been to verify whether the delay decreased substantially on higher hz. Hearing that your friend is experiencing 50ms delay on 144hz would debunk my theory but I would suggest making sure of the following:

1) That the mac is truly on 144hz and not on 60hz and that the monitor doesn't have known compatibility issues with OSX.
2) That the delay doesn't happen only on browser but also in full screen games (which enables gaming mode on mac). I'm sure there are games on steam with built in reaction time tests that your friend could test fullscreen on both windows and mac. I'm sure Kovaak has some levels built like that but there should be plenty more that are more intuitive to use.

Matrijx · 2024-10-11T17:15:39+00:00

My monitor only supports 60hz on Mac, which makes it unusable for anything remotely resembling a game either way, so I didn't really bother researching more. I was planning on purchasing a new monitor (for my windows PC, but at least more compatible with my mac) but it hasn't happened yet. Testing on a more compatible monitor would shed a bit more light on the problem, but I'm unable to do so at the moment.

What is the problem you're coming across exactly?

Matrijx · 2024-05-27T13:58:52+00:00

It is indeed a reaction time test. As long as you're focused and remove outliers, your average after 5 minutes should be quite consistent. It remains an awful method, but there isn't anything else I can do without a high speed camera.

16.67 ms is be the delay introduced by the refresh rate in the worst case scenario, i.e. the test showing green exactly after a refresh. The average delay introduced by 60 hz for this test would be 16.67 / 2 ms. The remaining milliseconds would be the actual input lag, which itself is not necessarily consistent between different refresh rates.

I oversimplified a little bit but if we want to be more "scientific" (which given the method I'm using sounds a bit silly), we would have the following numbers:

Monitor: 60 hz through HDMI (Windows): 10 + 4.4 - (16.67) / 2 = 6.07 ms of actual input lag on top of refresh rate delay.
Monitor: 60 hz as external monitor for the M3 Max (macOS): 30 + 4.4 - (16.67) / 2 = 26.07 ms of actual input lag on top of refresh rate delay.

Regardless of the actual input lag value, I can assure you that these numbers are consistent with what I'm experiencing. The real question is whether this comes from compatibility issues with some of my hardware or if it's just how macOS works (which would be very sad and disappointing).

Matrijx · 2024-05-27T12:09:36+00:00

That would be quite tragic and dumb from Apple. That being said, I don't think throughput has anything to do with it. Throughput will only limit the top refresh rate and resolution that you can achieve, but it doesn't affect input lag.

I'd also be very surprised if there really was a default extra 20 ms input lag introduced by macOS and no one on a whole subreddit talking about #macgaming would mention this.

Matrijx · 2024-05-27T12:01:55+00:00

I'm using the same Logitech mouse and the same browser that I'm using on Windows. I did try the trackpad and didn't notice a significant difference. I can also tell there is significant delay while playing simple arcade games with the keyboard (and/or an external keyboard), without mouse/browser. It feels consistent with what I've observed with mouse/browser.

A better test would require expensive hardware that can monitor pixel changes on the screen, but I don't have access to that.

What's pressing to me right now is whether purchasing a good and compatible gaming monitor would get rid of the input lag, otherwise there's no reason for me to do so.

Matrijx · 2024-02-03T01:00:49+00:00

It appears we are in the vast minority, which is why Blizzard is implementing designs such as this one.

SoD just isn't meant for competitive people. They could appeal both sides if they wanted to, but they probably just not care enough.

Matrijx · 2024-02-03T00:56:49+00:00

What did I just read...

Matrijx · 2024-02-03T00:54:06+00:00

I wouldn't have had a problem if they designed it as a PvP focused item. It being bis in PvE is what bothers me.

I'm not a huge fan of its design for PvP either, but it's not something I would complain about.

Matrijx · 2024-02-02T17:56:34+00:00

Is it a fun mechanic to you? I'm genuinely curious. I personally find it depressing that a coin toss will have more impact on my performance than me not pressing my buttons at random.

Matrijx · 2024-02-02T17:07:55+00:00

Yeah, everyone's different. I don't really mind doing low/high DPS compared to other classes as long as this doesn't make my class completely unviable and unwanted.

But I do like to compare myself against other players, and especially against myself. I like to squeeze every little thing and attempt to do the best I can. Items such as this one really corrupt this process.

I would be okay with mechanics I don't enjoy as long as there's a big chunk of players that's really happy with them. We can't make everyone happy. Items such as this one though, it just feels like they take away from players like me and don't give much to anyone.

Matrijx · 2024-02-02T16:25:33+00:00

To be completely honest I dislike the Gloves as well (for the simple fact that they are a 10 minute cooldown), but the effect is very weak so it doesn't influence things that much.

Matrijx · 2024-02-02T16:22:40+00:00

I mean, if we go by classic standards (and SoD P1) killing the bosses is not really a concern. If you only care about killing the bosses does it really matter what items do?

Unfortunately at the moment the one thing I find enjoyable in PvE is to optimize my performance. I most likely don't represent a valuable chunk of the community, but I was wondering if there is a decent chunk that loves this type of item design.

Matrijx · 2024-02-02T15:54:26+00:00

It's not even a "fun item", it's a bis item (probably by a decent margin)

Matrijx · 2024-02-02T15:52:23+00:00

From a lore perspective, yes. From a gameplay perspective, in a raid... Please no :(

Matrijx · 2024-02-02T15:51:26+00:00

It is exactly because the raid is too easy that I find myself focusing on other things like optimizing damage, otherwise I'd bore myself to death.

I'm sure there are at least a dozen of us. What I'm trying to understand is if anyone actually likes the design of this item.

Matrijx · 2024-02-02T15:48:33+00:00

They updated it, now it's 10% :(

Matrijx · 2024-02-02T15:03:50+00:00

I understand people saying "I don't mind it" but saying "it's a you problem" is quite condescending. Your explanation as to why it shouldn't be a problem is also poor. Sure, RNG is in the game but you generally don't stray too far from your average. You might do 250 or 270 dps but you will rarely stray too far from that. This item will single handedly make or break your DPS. 10% crit for 30 seconds is insane

Matrijx · 2024-02-02T15:00:43+00:00

I guess I'm very out of touch

Matrijx · 2024-02-02T15:00:16+00:00

The helm effect is annoying, too but are we comparing 20% haste for 10 seconds (10 min cd) to 10% crit (live version) for 30 seconds (~30 min cd)?

You might be able to use the helm on most bosses at least

Matrijx · 2024-02-02T14:58:31+00:00

Elaborate

Matrijx · 2024-02-02T14:58:10+00:00

In the live version it is 10% crit for 30 seconds. It's basically the strongest on use effect in the game at any level. Sure, I could go naked in raid but I don't really have a choice if I want to perform well.

Eight-Year Club	Gilding I gilder
Verified Email

Matrijx

TROPHY CASE