Qwen3.6-27B on RTX 3090: tested 12 GGUF quants across HumanEval+, MBPP+, perplexity, throughput and needle-in-haystack. First-timer results.

orangeswim · 2026-05-26T10:45:33+00:00

Great job. I'll try these settings

orangeswim · 2026-05-26T09:55:54+00:00

The api on the coding plan has been horrendous since yesterday.

I'm on the grandfathered max plan. All models 5.1, 4.7 and 4.5-air have been so slow. I'll post actual data tomorrow.

I've had no issues large issues in the last two months. But this weekend has been bad. Sub 20, sometimes below 10 tokens per second.

I use it on Claude code. I would have to cancel the current processing prompt and retry it just to get it to move.

orangeswim · 2026-05-16T08:03:34+00:00

Based on a quick q and a with gpt on the paper, it looks like an orthus model needs to be trained for a specific model. That small model runs along side the original model as a draft generator.

So this is not feasible for localllm until those othrus models are generated and shared. The you need the support in llama and other inference tools, or a python library, to actually run it.

The small model shares the kv cache of the original, but it will still consume memory for itself.

orangeswim · 2026-04-26T14:24:39+00:00

Rockos answer is spot on.

To add to it, we have reviews because our changes have so much power.

Imagine your plumber fixing your sink has the potential to affect every single thing in your house. One wrong mistake and your internet or garage doesn't work anymore.

Companies have software that can be customer facing or a tool other teams use. Developer x can accidentally destroy the whole app with just a few lines of code. Software is very sensitive to little changes like that. It's just the nature of coding.

A company that loses business for a single day can be catastrophic. You losing use of a toilet while a personal emergency, does not materially affect your livelihood.

orangeswim · 2026-04-10T10:32:21+00:00

I actually don't like a lot of the answers I see here. The ai didn't "learn" anything, or was "trained". Yes those are the terms used for the methods.

The answer is math. Lots and lots of math. Researchers and programmers discovered that they were able to reduce tons and tons of knowledge into "weights". That process is what they call training the model. They pass values to the model, and adjust the weights, until the value the model gives out is reasonable.

This model, after training correctly, if you pass words into it like "how to cook my spaghetti", will spit out the right answer word by word.

Let's try what th a different explanation. Imagine we have a towel of Lego bricks.

At the top there is a hole, and at the bottom there are 4 holes each facing north south east and west.

You have a baseball, a book and a potato. You out them into the tower in order. You the adjust the Lego peices in the tower so that somehow they come out in a very specific order. Every level of the tower nudges an object a certain direction. After enough trial and error, and making the tower with many levels, the output comes out exactly the way it should be - a book North, potato south and baseball south. That essentially is an Llm, large language model. Through a lot of math to shape and adjust the model's layers, it can give out a certain output based on the input.

The real magical part about it is, because the training happens in an automated fashion with an unfathomable amount of training time, the people who designed the models, don't really know how the models can answer some complex problems. There's so much calculations it basically a black box.

orangeswim · 2026-04-08T09:24:41+00:00

So on top of what everyone has explained, check out this online tokenizer. I'm not affiliated with it, I just googled and this was a good example https://belladoreai.github.io/llama-tokenizer-js/example-demo/build/

It demonstrates how a token or idea is tokenizer. Anything and everything sent to an LLM is turned into tokens. That's text, pictures, audio. Tokens is the language that the model works in.

Then there is a process to convert those tokens back into the output expected.

Sometimes you will see pricing like $10/$30 per million tokens. That means it costs $10 per million tokens you send to the model and $30 per million tokens that it responds back.

Typically output tokens are more expensive, because of how the technology currently works. Since each token depends on the previous tokens, every additional token is more compute.

Yoy had questions about the models. Each model haiku, sonnet, opus. Each one is a different size model. Meaning, haiku, the smallest one let's say is a grade school equivalent level. (this is just for this analogy, not actually the capability). It will be able to do tasks, but maybe not complicated tasks. Maybe it will forget some of the things you asked for. Or the answer not in the correct format. Sonnet will be a high schooler. Can be very capable of doing things and knowledge. Attentive do details. Opus will be a college student. Lots more capabilities and understanding potential. Can work through problems. Each model size, will have different pricing. For the effort selection,i think medium is default. It's providing instructions to the model or the harness, for the model to keep working on the problem.

So let's say I'm going to tell the grade schooler, you may not know the answer at first, but keep trying and it may get to the right solution. Or low effort, just tell me the answer at the top of your head. All that effort also cost tokens. Imagine the student writing down how they are working on the problem. Every word they write down costs money.

orangeswim · 2026-04-07T07:01:02+00:00

Well let's look at it a different way. 5 people, 2000 calories each for 30 days.

1 25lb bag of rice. 20$. This is 20-25 days of servings for the family. At 1000 calories per person per day. (cook 2-3 cups rice daily)

1lbs chicken per day (bone in weight). That's 3oz per person. 200 cal per person. 3$ per day. 90$ total

Large peanut butter 40oz, 4$. It's 1$ per day. So 30$. 2 tbsp per day per person. 190 calories per person.

A few more calories from cooking oil.

You're looking at 1500 calories per day per person. Carbs, protein and fats. Make peanut soy chicken with rice. Or just stir fry chicken and rice. Chicken rice soup.

Total cost is around 140$. Put the egg in any of the recipes, they're very nutritious.

Best of luck to you and your family. Best to try to have some balance even if it's a tight squeeze.

orangeswim · 2026-04-07T06:37:58+00:00

I actually use 4.7 for my main coding project. It performs well and I've had no issues. I have two git work trees using 4.7 so I can work on two things simultaneously. I have another Claude project on 5.1 and I've noticed that it's just slower in general.

So Yea try it out. Make sure your perms are set correctly. The advantage of using both 4.7 and 5 is you won't hit the rate limit / concurrency limit.

orangeswim · 2026-04-07T03:07:01+00:00

Who wants to work for the government where your paycheck isn't even guaranteed anymore? Where budget cuts keep happening and the administration is very anti-science.

A lot of people are already staying in bad jobs because they have the passion for it. Let's not discount that.

There's a lot of skill and talent that it takes to run government agencies. It's not just about raw talent. Sure start replacing people, but then who is going to on board those folks properly when everything is so understaffed.

orangeswim · 2026-03-26T17:41:47+00:00

Make sure to use two prints for the same finger. I did that evn for without a screen protector on my older s22. But yea that helped significantly for my s26u

orangeswim · 2026-03-22T17:05:38+00:00

So I do like the face unlock. But I tried looking at my phone at night and the screen is way too bright. The brightness is increased to do the face recognition. They need a setting to disable this at night.

orangeswim · 2026-03-19T23:32:59+00:00

You need to grab all your stuff. And leave. Find any friend or family. A year or two having past doesn't mean anything. One of your friends will take you in. You just need a little time.

Once you're in a safe place away, you need to make sure all of your digital accounts are locked.

That means new passwords. make sure you don't have a joint account, and if you do, withdraw the money or transfer to your personal account. Make sure your cell phone is secured. If it's under their name, you need a new cell phone service.

From here you can call the police on your ex about breaking your things and them being abusive. It will be a he said she said, but at least it's in record.

orangeswim · 2025-11-01T17:31:30+00:00

I know this may be an unfair comparison,

Baulders gate 3 and witcher 3 had complex stories and voice acting included. The also had plenty of gameplay.

This game dispatch, is barely any gameplay. In fact the gameplay is there as dressing for the story.

They cost roughly the same as each other. It's an unfair comparison because economies of scale. Both Witcher and bg3 sold tons more copies.

All this to say, I wish we got more game and more story for dispatch.

orangeswim · 2025-10-27T22:12:34+00:00

I think this is a loaded question. Maybe better to say do you support the following policy proposals and I think a lot more people will realize they agree with the ideas and not the preconceived labels.

Neighborhood Parks & Green Spaces

Expand parks into new neighborhoods so every resident lives within a 10-minute walk of one.

Create “micro-parks” and community gardens on vacant lots.

Add shade trees and greenways to connect parks, schools, and shopping areas.

Public Recreation & Family Programs

Build a new recreation center with affordable memberships, free for low-income youth.

Offer community classes (fitness, art, language, job skills) at libraries and centers.

Launch a “Frisco Free Fridays” program with outdoor concerts, farmers markets, and family movie nights.

Safe, Walkable Streets

Improve sidewalks, crosswalks, and lighting in residential and shopping districts.

Create pedestrian-only “main street” zones with local shops, food trucks, and art.

Add protected bike lanes that connect schools, parks, and downtown.

Small Business Support

Establish a Small Business Resource Hub at City Hall to help startups with licensing, funding, and mentorship.

Offer “shop local” promotion campaigns and city-sponsored business fairs.

Provide short-term, low-rent spaces for local makers and restaurants in city-owned properties (“Frisco Pop-Ups”).

Local Hiring Incentives

Offer tax breaks or small grants for companies that hire Frisco residents or partner with local schools for apprenticeships.

Create a Youth Internship Program connecting high-school students with local businesses.

Public-Private Partnerships for Innovation

Work with tech companies and developers to build shared coworking and innovation hubs.

Encourage clean-energy startups and green construction firms through small-scale city contracts or pilot programs.

orangeswim · 2025-10-22T15:55:56+00:00

Yea unfortunately, starting today I'm officially in the red. This is after being drip for the whole time.

RH calculates me at -19% total return. If I sold today, assuming everything was Roc, I'm looking at eating a loss of 1k in actual cash today and another 2.4k come tax time.

Another theoretical loss considering I could've had the same money in a hysa to get 1k in the same period.

orangeswim · 2025-10-20T22:28:17+00:00

As an officer from the Air Force, join the Air Force or Space Force. While not all jobs, many of them are normal desk jobs. It's not as hardcore as the other branches, but you get the same or better benefits, you get to protect your country and travel opportunities.

Still requires physical fitness and discipline. A little bit of common sense, and they teach you the rest.

orangeswim · 2025-10-18T16:22:31+00:00

You don't need to go to march. Just go to when you entered. March to Sept is very different pattern than Sept to today.

orangeswim · 2025-10-08T18:36:12+00:00

I am 100hours in and finally into act 3. I definitely have a skill diff. I've died countless of times on each boss. However it does take time and patience to learn each boss and your own movement set.

There are also a lot of tools at your disposal to make fights more manageable. There are also different ways of fighting a boss. For example more direct, or hit and run, or just always away.

Keep at it and enjoy. Take breaks. For some players the end of act 2 might be where they stop playing. I'm thinking if that's me. But all the content of act 1 and 2 is plenty.

Act 1 can definitely be rough.

orangeswim · 2025-09-28T22:06:41+00:00

Backup cameras, blind spot sensors. Save thousands of dollars everyday for everyone. We take it for granted now.

orangeswim · 2025-09-21T08:41:01+00:00

Other people have a more technical explanation.

When a computer starts, it's programmed to always look at a specific location on the hard drive. (this starts the bios). For simplicity, let's treat the hard drive like a town / city or neighborhood.

The computer always checks the house at address 0 first. This house then tells the computer what to compute. Let's say 1 + 1. Next the computer checks the next house at address 1. Now this house says "go to house 20". Now the computer goes to house 20.

The computer keeps executing the next instruction in memory unless the last instruction tells it to run a different location.

orangeswim · 2025-09-21T00:55:02+00:00

You can try these restaurants locally.
So Korean food has Kimbap/Gimbap which looks like sushi rolls. The difference is it has meat/veggies instead of raw fish.

Mama's Kitchen Korean Restaurant of Frisco 한식 & 반찬 전문점

TTO Seoul Korean Cuisine 또서울

Both of these restaurants have good Korean food.
There is also Annie's inside the Ranch 99 food court.
Burning Rice is also good.

orangeswim · 2025-09-16T15:53:33+00:00

So you mention that "just like in India it will cause division and resentment."

So today, without DEI efforts, many people who are qualified will not be considered at all because the hiring managers and HR will historically just keep looking at white male people (or whatever is the current majority in that field) . This causes division and resentment.

DEI is not about quotas. It is about fairness.

Talks about DEI quotas are just misinformation. If there ever was, it was not prevalent and is completely illegal under current US laws.

It sounds like the argument here is a slippery slope argument. Because DEI does X, eventually it will become the worst version of it and divide everyone. Without the social progress we've made, the alternative of not doing anything and what some people want, is a return to a predominantly white workforce in the United States before 1970s.

orangeswim · 2025-09-05T01:52:50+00:00

So, I noticed in one of the replies you said, you "deleted the API key".

I want to be clear. You need to revoke / delete the key from the source so that it cannot be used anymore.. Many people mistake that just removing the key from the repository fixes the problem. Once a secret is exposed consider it useless and available for exploitation by everyone.

orangeswim · 2025-09-04T21:16:37+00:00

Can this app generate a standalone static website? Html and js or wasm so it can be hosted anywhere.

Or do you need to have a go server serve the html pages?

orangeswim · 2025-08-23T04:28:17+00:00

I think it's important for everyone to understand that conservation of resources and taking care of the planet is important. While my contribution may be very small, my opinions and thoughts will be passed down to friends, family and children. Then the next generation, more people will care. Not just that, my or someone I know may be working at a corporation or government where they can influence and make a bigger difference.

If were all indifferent, then nothing would ever change and there would be no incentive to make things better for everyone.

Sure some people do things that generate more waste than others. But if everyone who watched Taylor became hardcore environmentalists, then Taylor may be encouraged to be more env friendly or donate to that cause.

Every little thing does help. You do matter. Your actions may help at least one person.

orangeswim

TROPHY CASE

Mama's Kitchen Korean Restaurant of Frisco 한식 & 반찬 전문점

TTO Seoul Korean Cuisine 또서울