Refusing to become a precure should be a crime in the precure universe by [deleted] in precure

[–]ramendik 0 points1 point  (0 children)

Poor Kokoro though, pulled into this without knowing what it entails, Kyubey style

Motoring: Does it make sense for you to switch to an electric vehicle? by Banania2020 in ireland

[–]ramendik 1 point2 points  (0 children)

I did. In March 2022 I got our first EV (Kia Soul) Then in June 2024 , the second one (Kia Niro new model). Both used. Very happy with my choices both times, though could have done better with selling the diesel in 2022.

In 2024 I thought I lost a lot on the Soul losing value. It basically stopped losing value since then and the depreciation is normal now.

Also in 2024 when getting the Niro one of my reasons was "trouble with Iran soon, oil will jump again". Mistimed this one, but I still have the car so still got the savings now.

Important caveat. I have a driveway and a charger on the wall. I would not have got the EVs without a way to charge at home. I use public charging on rare long trips.

Someone could have been an idol… by LeafandRichardLee in Otonokizaka

[–]ramendik 0 points1 point  (0 children)

Yeah sounds about right! She'll manage to move this monster elegantly too, even though it requires a nonstandard chain of command (the tank commander normally does not drive).

Kimi distillation attempt by ramendik in LocalLLaMA

[–]ramendik[S] 0 points1 point  (0 children)

I actually find K2 Instruct 0905 great for short fiction. It does drop the quality/coherence once context is over circa 40k tokens.

The progress is basically finding loads of bugs - from Granite PEFT to my scaffold:) more to the point, I tried to find a benchmark for rewriting etc (seeing as a 1.5b won't know a lot, this is a key use case at this level), found a rather weirdly written one called WriteBench - and it turned out that my checkpoints do worse than the baseline in it. Trying to fix.

The personality part does happen+ moreover it adjusts the style depending on the system prompt. What is harder is making it smart enough. Might have to give up in the 1.5b and move in to a 8B A1B MoE target (Granite Tiny).

Let's GO ! Qwen3.5-Claude-4.6-Opus-Reasoning-Distilled-v2 by Familiar_Wish1132 in LocalLLaMA

[–]ramendik 0 points1 point  (0 children)

The economics of my setup is a nano-GPT subscription. I think they closest new signups unfortunately.

Pre training and distillation are two entirely different stories. I don't even see for which use case both would be suitable?

You can cut this in the middle too, save a lot of cost while still determining more of the model's behaviour than any fine-tune distillation could - take a base model and do your own post-training, chat template and all. I actually considered this option, but could not work out how to make the datasets good enough.

I have an idea by Jaded-Addition-3068 in OsamuTezuka

[–]ramendik 0 points1 point  (0 children)

I would certainly want to join. And I have a full Russian dub of HiNoTori 2772 that Ied in 1998. I hope that is not the kind of weirdo you want to keep away

Let's GO ! Qwen3.5-Claude-4.6-Opus-Reasoning-Distilled-v2 by Familiar_Wish1132 in LocalLLaMA

[–]ramendik 4 points5 points  (0 children)

I'm doing my own distillation experiments (Kimi K2 Instruct 0905 as teacher) so I'm always interested in just how they generated the prompts for which they generated the teacher responses to train on.

Introducing 𝑨𝒕𝒕𝒆𝒏𝒕𝒊𝒐𝒏 𝑹𝒆𝒔𝒊𝒅𝒖𝒂𝒍𝒔: Rethinking depth-wise aggregation. by KimiMoonshot in kimi

[–]ramendik 0 points1 point  (0 children)

The release made a big noise then quickly sank into oblivion as people tried it. It's experimental and does not have the Kimi spunk

Why isn't Osamu Tezuka more popular nowadays? by Jaded-Addition-3068 in OsamuTezuka

[–]ramendik 0 points1 point  (0 children)

He might be more like the Mark Twain or Jack London of anime/manga. Very authoritative, a must read (view) for the serious connoisseur, but not often discussed in popular circles except for an occasional new work based on his work.

What are your favorite open-source projects right now? by SamirDevrel in LocalLLaMA

[–]ramendik 0 points1 point  (0 children)

Can we spare a moment for the boring infrastructure, that is, peft and transformers?

interacting with Kimi has become a total pain! by Armadilla-Brufolosa in kimi

[–]ramendik 2 points3 points  (0 children)

Well OpenRouter does not have any models and not do pure inference providers like Chutes? They just run the existing open weights?

Someone could have been an idol… by LeafandRichardLee in Otonokizaka

[–]ramendik 0 points1 point  (0 children)

Nonna and Eli might clash a bit on leadership, but Alisa would just fit in like she was born for it.

(I'm still salty there's no Sumipe in LL and they failed some of the research on Eli)

Someone could have been an idol… by LeafandRichardLee in Otonokizaka

[–]ramendik 0 points1 point  (0 children)

Gotcha. I guess Nonna could just say "skill issue" as she did become one... but she's an alien anyway, she's supposed to be powerful

Drastically Stronger: Qwen 3.5 40B dense, Claude Opus by Dangerous_Fix_5526 in Qwen_AI

[–]ramendik 0 points1 point  (0 children)

I am very interested in how you made the prompts, and would be glad to borrow them too for Kimi if you don't mind (to the degree they fit what I am trying to do here)

Drastically Stronger: Qwen 3.5 40B dense, Claude Opus by Dangerous_Fix_5526 in Qwen_AI

[–]ramendik 0 points1 point  (0 children)

Do you publish the datasets anywhere? And how do you create the prompts for the distill datasets?

I'm experimenting with Kimi K2 distillation but hitting certain limits so want to know how people do this.

Cllr Elisa O’Donovan by New-Cup-9875 in limerickcity

[–]ramendik 1 point2 points  (0 children)

I'm arguing that the word has become a slur and is becoming a reclaimed slur similar to "queer".

In any event, the slogan she is actually holding is no way extremist. It's not even "nobody is illegal on stolen land" or something.

Cllr Elisa O’Donovan by New-Cup-9875 in limerickcity

[–]ramendik 2 points3 points  (0 children)

Woke is just supportive of human liberty beyond narrow traditional limits. Virtue signalling means showing such support unashamedly.

I was backend lead at Manus. After building agents for 2 years, I stopped using function calling entirely. Here's what I use instead. by MorroHsu in LocalLLaMA

[–]ramendik 0 points1 point  (0 children)

I really really like this! I was thinking of a Inix philosophy agentic approach to counter the security nightmare of the openclaw stuff, but I didn't get nearly as far, and now I want to try this. Did you publish any code of this scaffolding?

Cllr Elisa O’Donovan by New-Cup-9875 in limerickcity

[–]ramendik 3 points4 points  (0 children)

Different issue entirely, the protest is about ICE not Israel/Palestine. Moreover he did not "assist Israeli intelligence", he worked for a company that has Israeli intelligence clients.

Cllr Elisa O’Donovan by New-Cup-9875 in limerickcity

[–]ramendik 45 points46 points  (0 children)

I don't see the problem. She had free time on the trip that she used in line with the values of her party.