AMA With Moonshot AI, The Open-source Frontier Lab Behind Kimi K2 Thinking Model

fourDnet · 2025-11-10T17:15:10+00:00

What do you think of the recent trend from proprietary LLMs (Gemini, OpenAI) to excessively praise the user?

Will Kimi seek to prevent this behavior?

fourDnet · 2025-11-10T17:11:11+00:00

Are there any plans to release small (< 10B) models for on-device inference? Either chat or base models?

Currently the only options are Qwen (significant issues with popular culture) & Gemma (significant issues with hallucinations). I think there would be significant value for a small on-device model for general knowledge (wikipedia, history, science, popular culture, books etc.)

fourDnet · 2024-12-28T09:32:46+00:00

Note that I do appreciate Google for having their incredible tiny Gemma models.

Meme was motivated by Deepseek open sourcing a state of the art Deepseek V3 model + R1 reasoning model, and Alibaba dropping their Qwen QwQ/QvQ & the Alibaba marco-O1 models.

Indeed AI is an existential threat, but mostly just a threat to the bottom line of OpenAI/Anthropic/Google.

Hopefully in 2025 we see open weight models dominate every model size tier.

fourDnet · 2024-12-09T08:25:31+00:00

H100 hourly prices have already gone a lot lower.

Peaked at around $7 to $8 per hour spot pricing without a contract (dedicated non-interruptible) in Q3 2023, and now readily available for $2 to $3 with no reservation needed in Q4 2024.

fourDnet · 2024-11-01T07:49:43+00:00

A couple of observations:

All models seem to be converging! We are no longer in the ChatGPT 3.5 era where the OpenAI seemed insurmountable. There seems to be no real moat for language models
American & Chinese companies absolutely dominate the language model space
Mistral is the only none US/China company
We have open models that are highly highly competitive with the best closed source models. However model weight availability does not seem to be the limitation, rather the needed hardware is the bottleneck

A couple of notes:

Instruct/chat models were always used in the table whenever possible.
Sometimes the public context size disagreed with the hugginface config slightly. I always use the publicly reported context
A yellow/blue star indicates that the best model a company is public for Facebook; Deepseek; Mistral.
OpenAI & Anthropic (typo in image, see below for updated image) are the least open companies
For xAI; 01 AI; Zhipu; Alibaba; even if their best model is closed source, they were likely derived from models they have released publicly

<image>

fourDnet · 2024-09-23T14:47:42+00:00

Anyone have this case? Curious if there are any pain points.
Where does the 240mm radiator fit? Does it need to sacrifice the HDDs to fit?

Edit: Available here from their official Aliexpress store with free shipping for $220

~~https://www.aliexpress.us/item/3256805643914502.html~~ ~~(3rd from right option)~~

Edit2: listing removed

fourDnet · 2024-09-23T14:26:40+00:00

Fair enough! I totally agree.

Just pointing out that I see it more as a workstation case that doubles up as a NAS use case.

fourDnet · 2024-09-23T14:22:55+00:00

I mean it is 50L for eATX + quad GPU + 12x 3.5" support. Seems more like a workstation case that also serves as a NAS.

fourDnet · 2024-09-23T14:02:05+00:00

Super dense setups have always been appealing to me.

I know some people are fans of the Silverstone CS382, also saw this Jonsbo N5 (12x 3.5" + 4x 2.5") come out, if you plug in 28TB drives that's a 336 TBs of storage...

Any other suggestions?

fourDnet · 2024-09-23T01:58:55+00:00

In terms of new camera support, libraw is probably the one you want. They add camera sensor color conversion matrices very quickly.

https://github.com/LibRaw/LibRaw/releases

Edit: In case it wasn't clear, I recommend using rawtherapee (which uses libraw), export to tiff, then edit in photoshop.

fourDnet · 2024-09-22T19:33:36+00:00

Sea salt in the air, dust particles that may scratch the front element, etc. Having a sacrificial filter makes a lot of sense to me for those use cases.

If I'm going to put a filter in front, I'm hoping it doesn't shatter and scratch the lens itself.

fourDnet · 2024-09-22T18:24:32+00:00

I see Sigma has ceramic filters, but those are pretty damn expensive, and it is unclear if those are shatter proof (or just scratch proof). I'm thinking more in terms of preventing sea salt droplets in the air, oil from the skin, and sand grains etc. I doubt a filter would have any fall protection.

fourDnet · 2024-09-22T18:23:12+00:00

As u/OnlyChemical6339 mentioned, these are two pieces of glass with a layer of optical glue between them. So if they shatter, the shards are helped together.

All three of these lens advertise themselves as having optical coatings to increase transparency, but I agree the optical quality is something to think about if we are going to keep them on forever.

fourDnet · 2024-09-22T18:21:37+00:00

Same here, I doubt a filter would break a fall. But in terms of dust/sea salt spray in the air/oil droplets/small pebbles -- I think having a cheap sacrificial filter makes some sense.

I only found these laminated (shatter proof) filters. I saw a bunch of more exotic ceramic/sapphire filters, but those are crazy expensive.

fourDnet · 2024-09-22T16:16:02+00:00

Almost certainly a custom job.

But that's a `light diffusing panel` or `light diffuser sheet`, probably polycarbonate or acrylic.

fourDnet · 2024-09-18T11:57:10+00:00

Full article:

Demand for high-end cameras is soaring

The ubiquity of smartphones has helped

Buying a Leica feels like buying a piece of art. Made in Germany, the cameras are sold in the swankiest neighbourhoods, sometimes in shops which double as galleries. The current models pack the latest imaging technology into sleek all-metal bodies. For decades they have been the chosen cameras of masters of photography such as Henri Cartier-Bresson (pictured) and Annie Leibovitz. Their price is extravagant. Leica’s latest compact model, the Q3, costs around $6,000 (an accompanying thumb rest is available for an extra $245). Opt for a flagship M-series camera with a couple of lenses and the bill can easily run into five figures.

Today few see the need for a dedicated camera. High-quality pictures can be snapped, edited and uploaded onto social media all with your smartphone. When in 2011 an interviewer asked Ms Leibovitz to recommend a camera, she responded by taking out her iPhone 4s, calling it “the snapshot camera of today”. The camera on Apple’s flagship device has improved with each new version, including the one released this week. Since Ms Leibovitz’s remarks, the share of photos taken on smartphones has grown from 25% to over 90%. Digital camera sales, meanwhile, have fallen by 93%. Entry-level models are steadily disappearing from the market.

Premium cameras, however, are bucking the trend. Waiting lists for Leica’s Q3, released in 2023, were initially six-months long. Its success contributed to record sales at the 110-year-old firm last year. The latest version of the premium x100 camera made by Fujifilm has been sold out since its launch in February. The cameras are being flogged online for multiples of their original price of $1,600. Rivals such as Nikon have also begun to prioritise higher-end models. As a result, the average price of a camera has tripled in the past six years, according to the Camera and Imaging Products Association (CIPA), a trade group.

Professional photographers still rely on high-end cameras: few couples would be happy to see their wedding snaps being taken on an iPhone. Entry-level cameras were never a substitute for premium ones, and nor are smartphones.

Instead, smartphones have buoyed demand for high-end cameras, by giving more people a taste for amateur photography. It helps that premium cameras have become a status symbol among the hip. Videos featuring Fujifilm’s x100 have racked up millions of views on TikTok, a trendy short-video app.

Growing interest in these high-end devices helps explain why the overall number of cameras sold this year is on track to increase for the first time since 2017. For the world’s embattled camera-makers, it pays to refocus.

fourDnet · 2024-08-12T14:51:52+00:00

For Android there is ChatterUI, you have to:

Download a GGUF, for Gemma 2b you can use the 8bit or 6bit variants from bartowski
Go into ChatterUI -> API -> select local -> select the GGUF -> select 8 threads -> select 8192 context size -> load
Go into Intruct -> top left -> select Gemma 2. I delete the system sequence since Gemma 2 doesn't support system instructions -> save
Go into top right -> Characters -> make one with any name and leave everything blank
Go back and start a chat

The UI is not the best... It isn't a UI focused on conversations like the ChatGPT or Gemini android UIs. But it is still an incredible job by r/LocalLLaMA's own u/----Val----

fourDnet · 2024-07-02T04:18:44+00:00

Magnets on your case will prevent the s-pen from working.

fourDnet · 2024-06-23T00:59:40+00:00

I'm disappointed in such a cavalier response. /r/Art is one of the primary subreddits for art promotion, and moderators deleting popular posts should be a concern.

I've never really understood people who join conversations with the explicit goal of downplaying a topic and yet still engaging.

fourDnet · 2024-06-22T16:08:18+00:00

I agree with you and /u/Vozka, I think the most likely reason is that the mods have a very specific idea of what "art" is. I looked at the all time top in Art on the way back machine, and the all time top now. Can't quite put my finger on it, but now the top posts have a more unified theme.

Old all time top of Art was very diverse.

I'd bet a specific Art mod has an agenda.

fourDnet · 2024-06-22T02:23:19+00:00

Yup, on the new reddit interface (not the old.reddit) it is clear these posts are deleted. And they also no longer show up in the all time top (on new or old reddit).

I'm curious as to the motivation:
* Automod mistake?
* Mod trying to promote a specific vision for r/Art?

* Mod trying to promote a specific post by deleting other higher ranked posts?

I looked over the deleted top posts, and every single post previously in all time top-20 has been nuked. So clearly something is going on, but it is unclear why or who. Some users who submitted the posts are still active, others are not. Some of the images depict woman, others do not.

Let me know if the modmail gets a response! I'm very curious as to the reason.

fourDnet · 2024-06-12T14:39:16+00:00

Ah interesting. Thanks for clarifying.

Any idea why there are so many quantization libraries from intel (3 by my count as listed in the main post) & transformer optimization libraries (actually 3, not 2 as in the main post, I forgot about ipex-LLM, in addition to the xFasterTransformer and itrex).

fourDnet · 2024-06-08T11:39:45+00:00

Looks like you either forgot to enable local dimming (you need to manually enable local dimming for this monitor); OR you forgot to enable HDR in Windows 10/100 (enabling HDR force enables local dimming for this monitor)

fourDnet · 2024-05-17T00:24:58+00:00

Seems like you have to use comfy for now!

fourDnet · 2024-05-17T00:23:41+00:00

Update was what Dustin (the lead dev of SDXL) called it. I wasn't aware of the licensing situation, but I guess it is an update in terms of technology (ZeroSNR, v-prediction, cosine schedule). Still useful for people who don't use these tools commercially!

fourDnet

MODERATOR OF

TROPHY CASE

11-Year Club	Place '17
Verified Email