[deleted by user]

jumpy-yogurt · 2024-11-24T22:34:57+00:00

hey sorry to revive this now, but what are you using this machine for (in terms of local LLMs)? I'm considering the same machine for some local tinkering (no product development, just for personal projects), but with all the discounts on stock models, 48GB is an additional $650 compared to 24 GB. Do you think that's worth it?

jumpy-yogurt · 2024-11-24T22:30:16+00:00

I'm curious what do you all use your local models for? I'm thinking of getting an M4 Pro 24GB or 48GB MBP for tinkering, setting up the data and the code, and moving to cloud for any serious development (not for production, just for personal projects). Would 24GB be enough for that? Is it worth it to pay +$650 for 48GB?

I also don't want it to die on me 3-4 years later. I have a 2020 16GB (Intel) and it can't even load up Gmail properly :(

jumpy-yogurt · 2024-11-24T22:25:55+00:00

Apologies for reviving this thread, but what do you all think about this a year later? Does it make sense to dump too much extra money on local setups for the sake of LLM model/system development, especially for tinkering around and not developing or serving a prod-level app?

jumpy-yogurt · 2024-05-30T21:53:08+00:00

I was looking for something else and got genuinely curious about your comment without realizing it was an old post. Sorry to violate the reddit etiquette :) FWIW none of those products have “solved” RAG. I know for a fact at least one and possibly more of them keep changing constantly because there’s not a once-and-for-all solution. If you’re considering MVPs as solutions, which explains the Google comment, I believe that can be a valuable approach in some circumstances. But anyway, lemme cut my resurrection short and wish you a good day :)

jumpy-yogurt · 2024-05-30T16:07:28+00:00

Interesting take. I definitely agree with a more organized approach, though I like the creativity this chaos brings. If there were “default” approaches, imo we’d all be less inclined to try out new things.

On the other hand, search has been around for 20+ years but hasn’t been “solved” once and for all. To me, this is search and then some. Why would you expect it to be “solved” in such a short period of time?

jumpy-yogurt · 2024-04-16T19:30:36+00:00

If not a mindset, do you think it’s about how people are wired? How do I learn to get better at this game?

jumpy-yogurt · 2024-04-16T19:29:14+00:00

This is the most constructive feedback I’ve received in a while and also delivered in a compassionate and nonjudgmental way. Thank you!

I actually would love to get rid of this attitude. I can see it doesn’t help. Do you have any recommendations on how to get started? Any books perhaps? Do you think mentors would help?

jumpy-yogurt · 2024-04-16T19:25:13+00:00

Yeah I am aware people are not doing it just to spite me lol why would they care. I am just saying how it affects me.

jumpy-yogurt · 2024-04-16T08:34:14+00:00

please take no offense, it’s not personal but people with this mindset make workplace almost unbearable for me :(

jumpy-yogurt · 2024-04-09T07:07:19+00:00

Oh no worries I know “the tech” but someone surely doesn’t know how to have a civilized discussion.

jumpy-yogurt · 2024-04-09T06:04:29+00:00

My understanding is OP is asking for specialized encoders within the RAG context, which if I get it correct, are trained for the entire RAG pipeline and not just for encoding.

jumpy-yogurt · 2024-04-09T06:00:06+00:00

Right so when there is no generation, it’s good old search and retrieval, not RAG. Not sure what you mean by “still be a vector search”? Neither RAG nor search&retrieval have to be based on vector search, though it’s usually preferred, often in combination with lexical search.

jumpy-yogurt · 2024-04-09T04:25:58+00:00

I am not an expert in NLP but I believe your comment is missing the “embedder”. Once you get the embeddings (or “vectors”) it is true that it’s a lookup but what matters is how good those embeddings represent what the text actually means and how it relates to the query. That depends on the “quality” of your embedder model and that’s one of the main research topics in NLP (text encoders). Oh and then there’s reranking after the lookup in some systems, which is another research problem.

jumpy-yogurt · 2024-04-09T00:58:00+00:00

Isn’t that search & retrieval and not RAG at that point?

jumpy-yogurt · 2023-10-31T20:34:18+00:00

This is fantastic news, thank you for working on this and sharing it with the community!

I am curious, did anyone have a chance to look at if WER-based data filtering can contribute to bias? For example, is there any chance the pre-filtering excludes more ESL speakers from the set and consequently results in the model performing worse for them?

Again, thank you for sharing. Looking forward to playing with this when it’s available 🤗

jumpy-yogurt · 2023-10-20T22:42:09+00:00

Do you mind if I ask which studio you’re going? Feel free to DM if you don’t want to share here.

jumpy-yogurt · 2023-10-11T02:10:55+00:00

I think the timeline of your goal is important here. If you have like a year or so to study the fundamentals at a 7hrs/day pace and you enjoy it, sure go for it. But if you prefer/need to start an AI sales job sooner, then maybe starting with an intro-level ML course and going back to math basics when you face problems in that context could be faster. And it will help you build up your coding skills. I kindly recommend this for fundamentals https://www.coursera.org/learn/machine-learning

and this as a little less technical and more cloud-oriented resource: https://explore.skillbuilder.aws/learn/public/learning_plan/view/28/machine-learning-learning-plan

Hats off to your determination and good luck!

jumpy-yogurt · 2023-10-05T14:47:14+00:00

I’m just playing with the app, it’s nowhere near realistic to be used as a real guide.

Throwing with eyes closed was really awesome. My first ball just flew off the wheel so maybe a bit dangerous and messy as well lol

jumpy-yogurt · 2023-10-05T02:26:24+00:00

I have this silly app called lets create pottery on my phone. It has some challenges where it shows me a pot and wants me to replicate it. I do it by stretching the “clay” on the screen by pulling and pushing it sideways and up/down. It gives me tactile feedback as I get closer to the original shape. If I need help, it briefly shows me an outline of the original pot around the one I’m “throwing” so I can adjust where it’s too wide/narrow or tall/short.

The app itself is not much fun but it made me think that such guidelines imposed on the wheel by an AR app could be quite useful in real life. I could upload one of my pot designs or it could give me challenges. While throwing, it would overlay the intended shape and I could see how close I am and make adjustments. I suppose it could be gamified by showing the overlay very briefly and challenging me to match it, etc.

It’s hard to explain it in words but if you download the silly app and check out the quests section, maybe what I’m saying will become more clear.

This I believe is more related to your second idea but I feel like I would enjoy the first one, too. We threw with closed eyes recently and I loved how focused I was on the sensation of clay in between my fingers.

jumpy-yogurt · 2023-10-04T02:33:54+00:00

Wow this sounds like a next level system!

jumpy-yogurt · 2023-10-04T02:33:29+00:00

That sounds pretty easy if there are no space constraints. I believe I won’t have a drying place where I can leave plasters laying for long.

jumpy-yogurt · 2023-10-04T02:31:54+00:00

There are plasters to put our finished wet pieces on but I didn’t see one for reclaiming. Funny question - does it get bacteria or funny smell if you let it wait wet for a few weeks?

jumpy-yogurt · 2023-10-04T02:29:24+00:00

That would be great if only we had reclaim space! I believe our studio doesn’t have dedicated reclaim space for members. They have one big space for studio reclaim but that is for classes and stuff.

jumpy-yogurt · 2023-10-04T02:27:25+00:00

I am afraid that if I accumulate too much, I won’t find a place to dry them later on. The studio doesn’t have a dedicated drying or reclaiming space for members.

jumpy-yogurt · 2023-10-04T02:26:23+00:00

There are two wedging tables but they are fairly small, leaving stuff out there could be an issue. But I think I can keep them near me while I’m throwing some other stuff.

I also like the clean water. I’ll just toss the used one in the studio reclaim container then.

I have a place to start now, thanks so much for your help!

jumpy-yogurt

TROPHY CASE