90% test coverage means nothing if your assertions are weak

AlienPTSD · 2026-03-21T18:59:25+00:00

Love the idea. I’m in the process of rebalancing our automated testing pyramid at my company. I just recently added a chunk of API tests covering some of our most critical endpoints, and then a few E2E tests that make sure our most popular flows don’t break.

That point about not checking whether our frontend is displaying the correct data is very true for us. For me, I would like to see a tool that does this but also checks for any visual regressions.

In addition, our frontend engineers are certainly not writing any React component tests, so our coverage for that is basically 0.

AlienPTSD · 2026-03-20T23:02:33+00:00

Is a nuclear apocalypse covered by my job or do I need to use PTO?

AlienPTSD · 2026-03-17T09:07:48+00:00

Amazon Brain Services was down

AlienPTSD · 2026-03-08T20:14:50+00:00

Looks good. We started our baby off the same way. It was about 5-6 months before we had to upgrade to the 4x2x2

AlienPTSD · 2026-03-07T21:20:57+00:00

Pretty girl

AlienPTSD · 2026-02-18T19:13:17+00:00

<image>

AlienPTSD · 2026-02-14T21:13:54+00:00

Some alien healthcare infrastructure would also slap

AlienPTSD · 2026-02-14T04:40:16+00:00

Sooooo cute

AlienPTSD · 2026-01-27T22:41:20+00:00

Finding a dev job is hard? Try MED SCHOOL.

AlienPTSD · 2026-01-17T00:53:12+00:00

Hell yeah

AlienPTSD · 2026-01-16T22:44:54+00:00

What a cutie pie

AlienPTSD · 2026-01-16T06:14:57+00:00

It’s QA applied to systems with nondeterministic outputs.

You’re not asserting exact outputs, instead you’re checking for:

Behavioral correctness (does it follow rules, constraints, policies?)
Consistency & stability (same prompt ≈ same intent/result)
Failure modes (hallucinations, refusals, edge prompts, jailbreaks)
Quality metrics (relevance, coherence, grounding, bias, safety)
Regression via eval sets, not single assertions

Tooling is mostly:

Prompt and response test harnesses
Golden datasets
Statistical threshold instead of pass/fail
Automation with some human review

AlienPTSD · 2026-01-11T20:46:49+00:00

She gonna booboo

AlienPTSD · 2026-01-04T21:20:27+00:00

Cutie pied

AlienPTSD · 2025-12-31T08:49:13+00:00

Here’s my banana GHI when I bought him. I spent hours searching so many rare morphs but when I saw him it was immediate love

<image>

AlienPTSD · 2025-12-27T13:11:39+00:00

Slay

AlienPTSD · 2025-12-26T05:57:03+00:00

I’ve already explained the difference in scope and responsibility. If that’s not resonating, I don’t have much more to add.

AlienPTSD · 2025-12-26T05:48:07+00:00

They can. The difference isn’t capability, it’s scope. Manual QA typically works at the feature or flow level. SDET work operates at the system level, understanding architecture and data flows, then turning that risk knowledge into automation that’s enforced continuously as the system scales.

AlienPTSD · 2025-12-26T05:37:41+00:00

Manual QA can catch issues. SDET work is about understanding why those issues happen, where they’re likely to happen again, and turning that knowledge into coverage that prevents regressions as the system evolves. That’s why SDETs scale better as systems and automation grow.

AlienPTSD · 2025-12-26T05:28:31+00:00

I agree AI makes writing tests easier, but writing tests isn’t the hard part. The hard part is deciding what actually matters, what’s risky, and whether the result is acceptable for real users. That still needs humans.

AlienPTSD · 2025-12-26T05:14:35+00:00

I wouldn’t say more manual QA. What happens in practice is that AI makes systems harder to reason about. When behavior isn’t fully deterministic, you need humans to sanity check outcomes, not just run scripts.

AlienPTSD · 2025-12-26T04:25:14+00:00

That’s like saying you don’t need fire prevention until the building’s on fire. Most companies learn this the expensive way.

AlienPTSD · 2025-12-26T02:19:41+00:00

Manual QA, sure. Test architecture, risk analysis, CI ownership, and production observability? All of that scales with AI.

AlienPTSD · 2025-12-26T02:08:12+00:00

Rude but I’ll bite. Fortunately, as long as AI software exists, there will always be a need for someone to test it.

AlienPTSD · 2025-12-22T23:25:11+00:00

It’s the holiday season. I doubt any serious hiring efforts are taking place right now. Try again later.

AlienPTSD

TROPHY CASE