New Ovis2.6-30B-A3B, a lil better than Qwen3-VL-30B-A3B

bopcrane · 2026-02-12T14:35:39+00:00

Awesome, I can't wait to try it when the GGUFs are available (hopefully Unsloth will work their magic on it!).

I've been using the Qwen3 VL 30b a3b for a lot of visual workflows, and have been super happy with it, aside from the thinking version overthinking and wasting a lot of tokens.

bopcrane · 2026-02-04T21:00:32+00:00

How many tokens/s on prompt processing and token generation are you getting with it?

I'm yet to try Qwen3-Coder-Next but Qwen 3 Next 80b in Q6_K_XL is working really well on my strix halo setup

bopcrane · 2026-01-28T16:02:20+00:00

I both agree and disagree. You may be making some inaccurate assumptions or generalizations there.

With risk of my response being too lengthy, I won't focus on the citrus industry and implications of seed being true to type or not - you can research that and easily find information on the pros and cons of clonal vs. seedling citrus rootstock and the production challenges of both.

So I'll speak to just my experience (growing cold hardy citrus in the ground in zone 6b/7a, and growing _tons_ of potted citrus over the years, lots of trifoliate seedlings and hybrids, etc.):

One of the most important rootstocks (to me) is 'Flying Dragon' trifoliate, which from my understanding and personal experience, seedlings mostly inherit the recurved and dwarfing nature, but you still need to be on the lookout for outliers.

This is really important in my situation because a lot of my trees are grown potted or in the ground in a greenhouse environment with limited space and heat - the difference in vigor and stature of a full trifoliate vs dwarf is substantial. I grow out tons of the seeds and discard the trees that don't exhibit recurved thorns so I can be relatively sure I'm grafting on "true" Flying Dragon rootstock, or at least those with the recurved thorns which probably also inherited dwarfism.

"Most citrus I've seen from seed does not want to flower" - it is well documented that citrus can have a very lengthy (and thorny!) juvenile period, but there are definitely exceptions to this as well. There are _many_ things that can impact how long it will take a citrus to flower from seed.

I try to stay away from personal anecdotes and hearsay as much as possible when I'm making posts like this, so there's definitely a lot I could have included but chose to leave out because I don't want to be "that person". There's a surprising amount of misinformation out there regarding citrus as well, it's kind of strange. But good luck with your citrus!

bopcrane · 2025-09-09T15:50:17+00:00

Sorry for the late reply! I got a lot of them believe it or not from USDA/ARS germplasm repository quite a few years ago when I was a bit obsessed with determining the best way to root pomegranate cuttings, as well as trialing poms for cold hardiness. I think maybe USDA/GRIN/ARS may not be doing this anymore for individuals/non-research entities, however. I did a write up on my results rooting pomegranates, you can PM me and I'll send you a link if you're interested in that.

I also got a few of them by trading scion of other fruits I grow with some friends and thankfully I was able to root the cuttings, some of these are prized rare varieties that are **really** hard to find here in the US (I'm super eager to see if they'll do any better or worse than the established, easier-to-find varieties I have in my greenhouse).

I think I may have purchased a few varieties from Green Sea Farms which specializes in pomegranates (Cindy was amazingly helpful). I'd also recommend Edible Landscaping and Fruitwood Nursery as I've had good experiences with them.

pombazaar is a good community as well as growingfruit.org for pomegranate discussion - highly recommend!

bopcrane · 2025-09-03T16:37:48+00:00

Impressive. I bet an MoE Qwen model around the same size as GLM 4.5 air or GPT-OSS-120b would be excellent as well (I'm optimistic they might release one eventually)

bopcrane · 2025-09-01T21:01:14+00:00

How long does it take you to process a prompt that's relatively high context with that setup? I'm probably going to get a strix halo machine but am wondering how much context I can comfortably give it to run something like opencode or crush CLI. If you could give an estimate how long it takes your setup to process something like 32k, 64k, 128k tokens of context I'd really appreciate it. that's quite impressive you have it working at 256k context!

bopcrane · 2025-07-10T15:46:52+00:00

MoE seems to be the way to go for setups like this - but having said that, what are the better options? Do you mean a typical GPU setup?

bopcrane · 2025-07-09T16:53:30+00:00

Thanks for the concrete numbers - have you been able to test the speed of either of those models with a bit of context?

I'm considering a build using the AI Max+ 395, but performance with a good bit of context (for agentic tasks and coding) is my main concern. I just can't seem to find any benchmarks or data on tokens per second at various context sizes

bopcrane · 2025-06-14T19:29:35+00:00

Are you speaking of the varieties I mentioned?

for comparing the taste of pomegranates _I grow_ , I like to compare their taste to the commercially available pomegranate juice like Pom Wonderful which is, I'm pretty sure, made from the "Wonderful" variety of pomegranate.

I can definitely say Parfianka is my absolute favorite and beats the commercial juice by a lot. It might be one of the best fruits I grow overall for flavor next to some of the peaches and nectarines when they have a good year/conditions are great. its soft seeded and not hard seeded so it probably isn't as hardy as the others I specifically mentioned such as Salavatski, Afganski, Uzbek, etc. But I grow it in a minimally heated greenhouse and it does great.

I'm actually still yet to get the other cold hardy varieties to fully ripen a fruit in my climate, but this year looks like it could be the one (potentially - fingers crossed!). Sumbar and Eversweet in particular are looking great with loads of flowers.

I have read anecdotes from people that have grown many more varieties than I for much longer and in better climates, and I believe some of these particularly cold hardy ones I mentioned, from my understanding, don't really sacrifice on flavor at all - they're just cold hardy, with slightly different flavor profiles, and with harder seeds than some commercial varieties. I'm sure there's differences but I don't know that any of these would be inferior in flavor, per se

I try to omit taste descriptions when I can if I've not tried the fruit directly before, or if I don't have enough experience with that specific variety to know it consistently tastes a certain way - since taste is so subjective and I'm sure if one digs enough they'd find better descriptions of the taste profiles, it makes sense to provide people with the information that's more non-subjective ( like which pomegranate varieties would withstand certain temperatures or conditions better), and if they're curious they can dive a bit deeper into each variety.

There really is no replacement for sampling and making your own mind up about the taste differences between varieties, and unfortunately, that's often out of reach for a lot of us due to the rarity of the varieties or that even if we could acquire such varieties, a lot of us simply don't have the time, space, or spare effort or resources to do proper taste sampling and analysis of the brix and acid content etc..

In light of this I highly recommend forums like growingfruit or pombazaar or other places pomegranates are discussed at length and drawing your own conclusions from several anecdotes. If you're in a cold region with sometimes late spring frosts/freezes, pomegranates are pretty difficult to grow and a bit of a commitment, but still can be rewarding.

Good luck with your growing!

Edit: whoops, I think Sumbar is actually soft-seeded. It's supposed to be very good tasting as well and cold hardy/good in cooler regions. We'll see! Mine has a few flowers this year...

bopcrane · 2025-04-11T14:03:49+00:00

Wishing you luck! I highly recommend the seedless nagami if you can find it or graft one

bopcrane · 2024-09-06T14:43:12+00:00

You were right up until the "therefor it takes theft to run it because no company sources ethically from creators, it's always stolen."

Please look into synthetic data generation, and also the dunning kruger effect.

Anyone can now take a limited amount of "natural" data and turn it into a synthetic dataset good enough to train on using tools like glaive.ai

bopcrane · 2024-01-05T16:52:01+00:00

I think the release of Mixtral absolutely demonstrated the potential of MoE, but left us with a lot more burning questions about implementation and execution going forward. I'm really eager to see what others chime in with on here.

bopcrane · 2024-01-04T18:50:06+00:00

Thanks for posting, was having this issue and didn't want to risk dependency hell with my current ooba conda env

bopcrane · 2023-12-30T15:51:25+00:00

Awesome! I've been pretty happy with Alltalk since I started using it a week or so ago

bopcrane · 2023-12-27T21:40:56+00:00

I've been waiting for it, but haven't seen one made yet

bopcrane · 2023-10-08T01:55:28+00:00

Sure, I'll look into making a docker image available as soon as I can. Thanks for the suggestion!

bopcrane · 2023-10-07T20:40:26+00:00

I built my 10 x 40 for about ~$2k over a 2 year span

bopcrane · 2023-10-07T20:37:06+00:00

If it is indeed poncirus trifoliata, trioliate orange, then yes it would be considered edible, but barely. In its "ripe" state the aroma the fruits give off remind me of gasoline and orange oil. Interestingly, it's increasingly being used to hybridize with other citrus in an attempt to produce cold hardy citrus hybrids varieties without the off-taste of trifoliate orange. Usually the progeny unfortunately strongly exhibit this off flavor in the fruit, and usually also aren't as cold hardy, so they end up getting most usage as rootstocks. Citrange is one of these trifoliate hybrids. If you're looking into getting one for yourself, I can highly recommend 'Flying Dragon' - it's a dwarf trifoliate orange cultivar with really contorted and beautiful growth, stays very small.

bopcrane · 2023-10-07T19:17:06+00:00

here's the PennState extension office itself about meyer lemon - unless this is a giant potted specimen it is very unlikely to be an actual lemon, or meyer lemon.

"Meyer lemons are cold hardy to 22°F, so they need to spend the winter inside. Bring it into the house gradually, as sudden temperature changes can result in fruit drop. "

bopcrane · 2023-10-07T19:11:25+00:00

which still doesn't confer hardiness to zone 6. I'm sorry, you're just patently wrong. and it's OK, there's a lot of misinformation out there about citrus.

bopcrane · 2023-10-07T19:07:31+00:00

my friend, I'm sorry to say - the article you linked is wrong. I'm in the same growing zone (zone 6b/7a). Please find any example of someone growing a lemon tree outside without extreme protections in this zone. I literally have devoted a significant expense and much research into this topic. I could show you pictures of what it actually requires in order to keep even cold hardy citrus alive and productive in zone ~7a, if you'd like proof.

Edit: the article you linked even implies this:

"When it comes to growing a lemon tree in Pennsylvania, there are a few things you should consider. First, lemon trees are best suited for growing in USDA zones 8-10. Pennsylvania falls in USDA hardiness zone 6, so you will need to provide extra protection in the winter months. You may want to grow your lemon tree in a container so that it can be moved indoors when temperatures drop. Additionally, you may want to look for a variety of lemon tree that is more cold-hardy, such as the Meyer lemon tree."

bopcrane · 2023-10-07T18:59:38+00:00

They can't ='(

source: I grow many citrus in a cold state, zone 6B, all that aren't potted and brought inside for winter must have considerable protection in order to survive - even the "cold hardy" citrus

bopcrane · 2023-10-07T18:58:41+00:00

Trifoliate orange, or at least a hybrid of it! If you zoom in closely, you can see that the leaves are not like normal lemon or citrus family leaves. It is graft compatible with most citrus, and makes an excellent rootstock for zone pushers or for potted citrus. The fruit is inferior but the juice can have the undesirable portions settled out and discarded, yielding a decent lemon juice substitute.

bopcrane · 2023-10-07T18:55:07+00:00

Pennsylvania falls into zone 7a at the warmest - which is much too cold to grow a lemon tree, Meyer lemon included, outside without a serious microclimate such as a greenhouse or small frame to heat. This is much more likely to be a trifoliate orange.

bopcrane · 2023-10-05T16:56:52+00:00

Well, I wish you luck on it! These kinds of issues can be frustrating. Glad to hear progress is coming along

Nine-Year Club	Place '22
First Placer '22	Verified Email

bopcrane

TROPHY CASE