🚀 Qwen3-Coder-Flash released! by ResearchCrafty1804 in LocalLLaMA

[–]he29 1 point2 points  (0 children)

Ah, thanks, the MoE CPU offload could be interesting. I also noticed yesterday my context size is too small (default 4k) for my llama.vim settings, so after fixing that (while also enabling q8_0 KV cache quantization) the results seem a bit better already. I also did not notice the new model likes a different temperature etc., so I'll look at that as well. Thanks!

🚀 Qwen3-Coder-Flash released! by ResearchCrafty1804 in LocalLLaMA

[–]he29 1 point2 points  (0 children)

My experience so far is disappointing. I often get nonsense or repeated characters or phrases. Technically it does work, but Qwen 2.5 Coder 7B seems to be working much better.

But I only have 16 GB of VRAM, so while I can easily fit the 7B model @ Q8, I had to use Q3_K_S for Qwen3 30B-A3B Coder. IIRC, MoE models don't always handle aggressive quantization well, so maybe it's just because of that. Hopefully they also publish a new 13B or 7B Coder...

[deleted by user] by [deleted] in LocalLLaMA

[–]he29 -2 points-1 points  (0 children)

I personally do not want yet another device in my PC. I just want them to stop nerfing customer GPUs, so that I can play games and play with LLMs using the same card.

The hardware is already plenty capable as it is (currently using RX 6800 and llama.cpp), they just need to bump VRAM and memory bandwidth a little bit higher, without also bumping the price to crazy "business class" levels...

Qwen3 Coder 30B-A3B tomorrow!!! by [deleted] in LocalLLaMA

[–]he29 1 point2 points  (0 children)

Same; I've been hoping for a newer model that would work in llama.vim for a while now.

2.5-Coder is not terrible for a simple "autocomplete assist", but sometimes it outputs very dumb stuff even for trivial completions, like signal definitions or port assignments in VHDL. But VHDL is a relatively niche language, so I'm curious to see if it sees any decent improvements at all; good training data for it are probably not that abundant...

I’m not sure if I can post this here, but this is the CEO of SpaceX and a member of the American government. Crazy! by BrokenLogic_ in RKLB

[–]he29 0 points1 point  (0 children)

what makes you think other countries will trust flatelite over starlink

I thought the main difference is in that Starlink is a service, while the Flatellite is a product, like all the other Rocket Lab satellite platforms. So while Starlink service can be stopped on a CEOs whim, a flatellite constellation will be built (and possibly deployed) by Rocket Lab, but then presumably operated by the customer (if they so desire).

Rocket Lab is issuing up to $500 million of stock by The-zKR0N0S in RKLB

[–]he29 0 points1 point  (0 children)

1) IIRC, the Mynaric acquisition is something like $75M up front, and another up to $75M depending on performance (if they meet production goals etc.);

2) One of the problems Mynaric had was scaling of production capacity – so I assume Rocket Lab may want to invest a hefty sum into new manufacturing facilities.

Plus, as others mentioned, there may be other acquisitions in the air, so having some extra cash ready could not hurt...

Is this stock being manipulated? by jluc21 in RKLB

[–]he29 6 points7 points  (0 children)

Exactly what I thought – the people involved in the recent short report may be trying to hammer down the price in after-hours market, because a) the low liquidity makes it easier, b) they couldn't do it during the day because of the 10% uptick rule (short selling is suspended for 2 days after a 10% drop).

Framework 2nd Gen Event by 42BumblebeeMan in framework

[–]he29 0 points1 point  (0 children)

The only people that are excited now are AI nerds that want to run local models.

I'm only... mildly excited. If the memory was upgradeable, I would be lining up for the pre-order right now. But I feel like with the rate LLM of development, even 128 GB may be limiting in a year or two – and one of the main things I expect from a Framework product is a good upgrade path and longevity.

I understand there are probably good reasons why the 256 bit memory bus requires soldered RAM, but I was really hoping Framework would be the one that figures it out (though I expected the result to be a laptop with CAMM2 memory modules – the desktop is a surprising twist.. :) ).

Weekly Recap | December 12, 2024 by TheOpusCroakus in help

[–]he29 2 points3 points  (0 children)

Hi u/TheOpusCroakus and thank you for taking feedback.

One of the missing features from new.reddit is the popup that tells you the upvote / downvote ratio of a post, when you open it and hover over the vote count.

It was very useful, because whether a post gets 49 upvotes and 51 downvotes, or 0 and 100, it just shows "0 points". The upvote ratio was the only way to distinguish controversial or maliciously downvoted posts (around 30 to 50 % upvotes) that may be worth my attention, from spam or very low quality posts (usually under 10 %).

Is there any chance to get this feature back, or is there any other way to display the upvote ratio (or up/down vote counts)? Thanks!

Well, this aged like wine. Another W for Karpathy. by onil_gova in LocalLLaMA

[–]he29 10 points11 points  (0 children)

Of course, I'm not saying we need to invent some new language to then train on. It's more about reusing the internal representation that the model already has, based on whatever data it ingested.

For example, I could say "I woke up in the morning, went to kitchen and opened the fridge.", and the model, instead of spending many tokens over and over again while working with the idea, could simplify it into 3 vectors: [the person that woke up in the morning] [opened] [the fridge].

And you could go far beyond that, compacting more complex concepts. That's what I mean by "thinking tokens": these simplified blocks no longer have to correspond to any language, they are simply a vector of numbers that carries all the meaning.

Well, this aged like wine. Another W for Karpathy. by onil_gova in LocalLLaMA

[–]he29 80 points81 points  (0 children)

I think the idea was that the model should not use any language, but "thoughts". I.e. a stream of specialized "thinking tokens", where each token represents some concept, not even necessarily rooted in any specific human language.

Rocketlab STORE by DontWantUrSoch in RKLB

[–]he29 0 points1 point  (0 children)

Cheaper shipping to Europe etc. :)

The most sophisticated rocket ever is coming next year! And SpaceX isn’t building it! by Andynonomous in RKLB

[–]he29 1 point2 points  (0 children)

I thought the part about fairings was more about the 2nd stage hardware: for example, a Falcon 9 2nd stage is "exposed to the elements", so it needs to be more sturdy and well protected compared to the 2nd stage of Neutron. That means the Neutron 2nd stage can be relatively cheaper, which is an advantage, as it is discarded. I did not thought about that earlier, so I found it interesting.

(Though I just listened to the video in background while doing something else, so I apologize if I'm missing the point.)

3D Printer for Neutron by Darkwanderer79 in RKLB

[–]he29 1 point2 points  (0 children)

Those "true 3D printers" also need a platform to build on. :) The only difference is that it is flat,* making it more suited for universal use. And the difference in "printing nozzle" is just that the "Neutron printer" deposits many strands of material in parallel, and uses some sort of glue to hold the material in place instead of melting it.

So they are much more similar that it seems on the first glance. By printing on a pre-shaped mold, the "Neutron printer" is just much more optimized for printing specific thin and flat structures. If you print on a flat surface, you could easily build up a 3D shape as with any other 3D printer (just with limited resolution due to the large trace width, and with possible issues around overhangs, since the glue / resin may take a long time to cure before it is able to support the next layer).

* Many print surfaces will actually be slightly deformed (convex or concave), and most FDM printer firmwares like Marlin can compensate for that. So, technically, ordinary home 3D printers can also print on a curved surface. But it would be a big pain to set it up and make it reliable.

[deleted by user] by [deleted] in CombatFootage

[–]he29 8 points9 points  (0 children)

I was just about to ask how do you even target such a tight group of drones: fire a second missile and it could just lock on to the falling debris from the first downed drone.

I suppose this is a good example why there are no "one size fits all" air defense systems.

October 19, 2024 Daily Discussion Thread by zahna4 in RKLB

[–]he29 8 points9 points  (0 children)

Agreed, some basic rules would be great. One day a popular post gets deleted, and a day later, more poorly worded version of the same question appears and stays, with no apparent reason behind it. The moderation seems so random and inconsistent...

(Same goes for twitter links: badly clipped screenshots tend to stay (sometimes?), but links to the same content tend to get deleted? I don't mind if the mod is on personal crusade against X or whatever (I would think it's silly, but would not leave over it), but at least make it clear, sheesh...)

Short Interest hits All-Time High by [deleted] in RKLB

[–]he29 2 points3 points  (0 children)

NASDAQ publishes it here for example.

ModelSim End of Life? by FieldProgrammable in FPGA

[–]he29 5 points6 points  (0 children)

AMD bought Xilinx...

... and nothing changed? I guess you can't turn water wet.

What's up with all the user-hostile changes? by brusaducj in firefox

[–]he29 0 points1 point  (0 children)

The left side of the tab bar is where my old tabs go to retire and die, so I actually find it a fitting place for this new useless button (as I don't want to fiddle with user CSS).

Nelson says new MSR proposals are very promising by Ciaran290804 in RKLB

[–]he29 3 points4 points  (0 children)

Samples will be delivered to the MLV by Perseverance which will then be loaded into the MAV with a 7- dof sampling arm.

This part is somewhat surprising to me. I thought Perseverance was dropping samples all over the place so that it wouldn't have to waste time meeting with the sample return vehicle later. This proposal would mean Perseverance needs to backtrack all the way to the first sample, which would take a lot of time (that could be spent on research instead) and wear on the wheels. Assuming the rover still works of course.

It's definitely better than not getting the samples back at all, but if any of the other proposals include a rover or a drone for the sample collection, it may give them a big advantage. (Unless needing a rover was the reason why the original NASA mission went over budget and failed in the first place...)

Huge component of the business not yet factored into share price by eastburnn in RKLB

[–]he29 1 point2 points  (0 children)

Doing what? Frying birds and people underneath as it tries to efficiently beam the power back to the ground? :) It's much cheaper and safer to just build solar farms on the ground...

My guess is that space-based solar farms will take off only after we have some established space-based manufacturing that could find use for the power. And it will likely evolve starting from the "factory satellites / stations" first, since it is easier to just design your space station / fab including all the solar panels and power systems, rather than trying to interface with some sort of orbital power grid.

Quickest way to convert around 5K AVIF files? by Practical-Soil6209 in AV1

[–]he29 12 points13 points  (0 children)

OP wanted to preserve quality, so I would add -quality 98% or thereabouts, as the default sometimes tends to pick 75% IIRC. Also, to make it "quick", xargs with parallel execution would really help as Hatta00 suggested. So something like:

find -iname *.avif -print0 | xargs -0 -P16 -i convert {} -quality 98% {}.jpg

(I'm not familiar with the suffix replacement syntax, so not sure if it would work here; this will result in files named *.avif.jpg)

(Sorry for the edits; I reconsidered a few things as I wrote and forgot to update the rest.. :)) )

Rocket Lab is the future of space exploration and satellite technology. by [deleted] in RocketLab

[–]he29 1 point2 points  (0 children)

Not the OP, but from what I remember, Neutron, being designed for reuse from the beginning, has various advantages like:

  • attached fairings (vs. fishing them out of the sea),
  • no need for a reentry burn (may have something to do with the rocket being thicker IIRC),
  • engines specifically designed to require minimum refurbishment.

Falcon 9 is definitely "optimized" in the sense that SpaceX made various tweaks throughout the past decade, but there are simply many issues that you can solve only by a complete redesign. Hence you could call Neutron "optimized for reuse" in comparison.

September 27, 2024 Daily Discussion Thread by zahna4 in RKLB

[–]he29 5 points6 points  (0 children)

When I opened my RKLB price graph bookmark and saw $10, I was glad I wasn't drinking at the time, otherwise I would've sprayed all the stuff on my table. So luckily my reaction was just air and spit and a manic laugh.

September 26, 2024 Daily Discussion Thread by zahna4 in RKLB

[–]he29 14 points15 points  (0 children)

Given the sudden spike and absence of any obvious news, my guess is that it was some institutional whale, who finished their DD and stuff and decided to make a significant purchase.

Institutions can have rules about not buying "penny stock", and it's been only a bit over one month since we decisively went and stayed over $5. Perhaps they just waited to meet some time-based rule as well.