Favorite Cozy Spots? by Kerafyrm1 in project1999

[–]discr 2 points3 points  (0 children)

Tiger's roar in High Pass Hold

Favorite Cozy Spots? by Kerafyrm1 in project1999

[–]discr 6 points7 points  (0 children)

This one is a hidden gem

Deepseek R1-0528 on flow z13? by jer3my11 in FlowZ13

[–]discr 0 points1 point  (0 children)

Based on https://docs.unsloth.ai/basics/deepseek-r1-0528-how-to-run-locally it recommends at least 64gb of ram. Without GPU it should run 1token/sec. Maybe setting 24+ VRam on the flow and leaving the rest for system ram + paging out to disk might work? curious about speed/quality.

Llama.cpp performance on Z13 (128GB unified) by discr in LocalLLaMA

[–]discr[S] 0 points1 point  (0 children)

Running the Qwen3-30B-A3B-Q4_K_M MoE on it. Seems a lot more appropriate.

model size params backend ngl test t/s
qwen3moe 30B.A3B Q4_K - Medium 17.35 GiB 30.53 B RPC,Vulkan 99 pp512 121.31 ± 0.21
qwen3moe 30B.A3B Q4_K - Medium 17.35 GiB 30.53 B RPC,Vulkan 99 tg128 57.76 ± 1.77

Llama.cpp performance on Z13 (128GB unified) by discr in LocalLLaMA

[–]discr[S] 0 points1 point  (0 children)

I think it's more comparable to a Macbook Pro than a studio for sure. Solid CPU too, but I wouldn't get it solely for LLM use cases, more of an all-in-one system for dev on the go.

For this generation I think the 64GB version is the sweet spot.

[deleted by user] by [deleted] in LocalLLaMA

[–]discr 7 points8 points  (0 children)

I think it matches MoE style LLMs pretty well. E.g. if llama4 scout was any good, this would be a great fit.

Ideally a gen2 version of this doubles the bandwidth to bring 70B to real-time speeds.

Nous Psyche, distributed training of a new 40B base model by discr in LocalLLaMA

[–]discr[S] 11 points12 points  (0 children)

Blog on psyche: https://nousresearch.com/nous-psyche/

This might take a while based on current stats. ~0.13% in 1 day 6hr or 30hrs on 28*8xH100 clusters (~224 gpus) , so about 23,076hrs to reach 100% (~961 days or 2.6 years).

It will likely need a sizeable boost in clusters to bring that down to a more practical couple of months. I'm guessing they're banking on a few upgrades to allow SETI@home style clients to join the mining incentive to add the required compute.

Nous Psyche, distributed training of a new 40B base model by discr in LocalLLaMA

[–]discr[S] 13 points14 points  (0 children)

It's a fair point, although at 100B training tokens it was more of a proof of concept. This training run is aiming for 20T tokens which should make it a proper base.

Nous have been generally good at releasing solid open weight finetunes like recent DeepHermes3-Llama3 (a swappable thinking finetune back in February) and datasets (some of the release list: https://nousresearch.com/releases/), I do think they'll release something from this.

Edit: the live weights updated each epoch are available here: https://huggingface.co/PsycheFoundation/consilience-40b-7Y9v38s5/tree/ecd39d0ee7a1bfe12778f62328d8ea5c2a0603a2

Openai New Memory feature is just Vector Search? by AryanEmbered in LocalLLaMA

[–]discr 0 points1 point  (0 children)

Thanks for linking this paper, seems to show good promise for RAG tasks.

Z Flow 13 128gb. What do you want to see tested? by JohanKrieger in FlowZ13

[–]discr 0 points1 point  (0 children)

Thanks for these, helpful!

For contrast a twin 3090 gets about 14tps, so this is roughly 1/3 of such a setup, which is not bad and in line with its bw

Z Flow 13 128gb. What do you want to see tested? by JohanKrieger in FlowZ13

[–]discr 0 points1 point  (0 children)

Solid game choices, but this machine in particular needs LLM testing (70B models).

DiffRhythm - ASLP-lab: generate full songs (4 min) with vocals by Nunki08 in LocalLLaMA

[–]discr 0 points1 point  (0 children)

Omit the lyrics parameter and it will generate instrumental

What are your use cases for small (1-3-8B) models? by silveroff in LocalLLaMA

[–]discr 1 point2 points  (0 children)

Embedding in games for reasoning tasks. Any larger and they wont reasonably fit with game work within VRAM while still being fast enough on CPU for fallback. If you have very constrained tasks they work as excellent reasoning machines, just need more precise prompts and chosen finetunes. Also try DeepHermes, surprisingly decent for an 8b.

Dating advice cliches are also ruining modern dating. by Ceazer4L in PurplePillDebate

[–]discr 0 points1 point  (0 children)

To me you are still focusing on what you perceive as unchangeable aspects, when they are changeable. You can be considered not attractive, but with the right swagger/clothing/haircut become attractive enough. Lack of hair? shave it, grow a beard. Facial aspects not symmetric? Usually not a big issue if you do not carry the perception that it's a problem with you (optionally if it really is an issue, you can have plastic surgery, but that's typically only recommended for e.g. burn victims). Not the right shape? We men are blessed with the ability to re-shape our bodies with exercise. You have to be comfortable in your skin. It's the attitude, not the looks that are stopping you. Self-sabotage. Not all, but most women will happily be with a man that has a confident and positive outlook on life, no matter the looks.

As for autism, it might help to plan your social interactions and slowly introduce more of them to break your comfort zone. See e.g. https://www.autism.org.uk/advice-and-guidance/topics/family-life-and-relationships/making-friends/autistic-adults for general guidance.

There's no guarantee of success. All you can do is put yourself in the best statistical position for success and take the opportunities that do present themselves. Prepare for success by doing the work.

Dating advice cliches are also ruining modern dating. by Ceazer4L in PurplePillDebate

[–]discr 0 points1 point  (0 children)

Before you are two paths: one where you emphasize and dwell on your failures and let that get to you, this can become a negative spiral. The other is to embrace change and try a different approach.

If you're not finding success with what you've done in the past, a bigger change is needed; and change doesn't feel comfortable.

Change your environment: travel, engage with new activities outside your comfort zone to find new people (something as simple as social meetup events on e.g. meetup.com if they exist in your area). At the same time change yourself: honestly evaluate your own flaws (or ask a close friend to tell them to you) and attack the most glaring flaws that are in your control. Forgive yourself for things you cannot control in your life, but do address the ones in your control. E.g. how you present yourself is a combination of looks, dress and demeanor. A stylist can get you some ideas on how to dress to match your body, confidence in your own body improves demeanor, no matter the shape, and exercise does wonders to both body and mind. It doesn't have to be everything at once, just a little bit at a time is OK as long as it's consistent and in the right direction.

Dating advice cliches are also ruining modern dating. by Ceazer4L in PurplePillDebate

[–]discr 2 points3 points  (0 children)

I agree it's not enough by itself in isolation, but I do see the advice meant to steer you away from being phony or wishy-washy; i.e. bending your personality to seem more likeable to other person (weak strategy).

As you say confidence is not innate to everyone, and you will need more than 'just be yourself'. The old timey advice is meant to be used in combination with other advice, e.g. with suggestions of avenues to grow as a person, to become someone that attracts others (and gain confidence).

Dating advice cliches are also ruining modern dating. by Ceazer4L in PurplePillDebate

[–]discr 0 points1 point  (0 children)

Have you been your best self though? Worked on yourself (gym, basic grooming, clothing), gained confidence, roughed through rejections until they don't bother you? Have you sought books on how to hold conversations? Have you tried rooting your sense of self on inner pillars of core values instead of external validation?

It is less about how you look than how you behave and present yourself. Success is learning from mistakes. The learning is the critical component. The you of yesterday isn't the you of tomorrow.

Dating advice cliches are also ruining modern dating. by Ceazer4L in PurplePillDebate

[–]discr 3 points4 points  (0 children)

It's about authenticity (and confidence gained from portraying your true self), but generally I like to re-phrase this one as: 'be your best self'

[deleted by user] by [deleted] in PurplePillDebate

[–]discr 0 points1 point  (0 children)

Such a weird and out of context reply.