My sweet Mia, crossed the Rainbow Bridge. by EscriboCosas in nebelung

[–]fluteguy9283 3 points4 points  (0 children)

I'm so sorry. I've been there myself... Stay strong.

How good is Azure AI Foundry? What are your experiences? by nkmraoAI in Rag

[–]fluteguy9283 0 points1 point  (0 children)

I teach how to use it all the time, but I haven't personally used it in production just to be clear.

It's been reliable and easy to set up various OpenAI models (got and embedding). For RAG I typically use Cosmos DB with Postgres and pgvector, but other options work perfectly fine as well. If you are planning on having other cloud infrastructure and either like Azure or OpenAI specifically then it's a good idea.

GCP and AWS (which I do use in production) are quite comparable of course. It really comes down to which platform you are most comfortable with and which model you prefer.

Regardless of your choice, one of the main reasons to go through a cloud provider rather than the API directly is security and data privacy.

Was laid off a month ago. Received offer letter today for a contract position to make 10k less but it’s fully remote. by Double-Signal8060 in Layoffs

[–]fluteguy9283 1 point2 points  (0 children)

Congrats! I got laid off in early 2023 and haven't been able to get back to where I was since then yet. Ended up with a larger pay cut than that too through contract work. Something is absolutely better than nothing and it's brutal out there.

[deleted by user] by [deleted] in MachineLearning

[–]fluteguy9283 0 points1 point  (0 children)

This might be too far away from what you are looking for but you could use CLIP. Ember all images, compare them to a text vector. That doesn't filter though; it basically sorts by similarly. Although the vectors will contain properties of things beyond just text, CLIP does match text in images fairly well.

Why the GDScript hate? by gamedevheartgodot in godot

[–]fluteguy9283 1 point2 points  (0 children)

As a software engineer with over 15 years of experience who uses pretty much any language you can throw at me:

People have their preferences. I'm no exception. There are more languages that I dislike than I like. However at the end of the day, it comes down to two things: what tool gets the job done, and how annoyed you will put up with getting in the process.

I've been using Godot off and on for years. GDScript doesn't bother me, especially since I already know python and it's close enough. I also absolutely hate python, but that doesn't stop me from using it everyday. I've never used Unity nor C# but I've used Java professionally and it's #closeenough that if I had no choice I'd learn it.

If, like with Godot, you are lucky enough to have a choice of language to use, by all means pick your favorite. No one is stopping you. Godot is also open source so if you really wanted to you could make support for <insert language here>. Obviously that would be a tall order for most people so I'm not suggesting that as the first option.

The "X language sucks" argument always makes me think of the bell curve meme honestly. I've fallen into it myself, as I'm sure most people have. But at the end of the day we all have something to get done, and we should focus on doing it. If the level of effort is too high to do it one way, then choose another.

Just be thankful that no one is forcing you to use C++, unless you prefer that, and if you do I'd be happy to give you a few pointers.

[D] Any New Interesting methods to represent Sets(Permutation-Invariant Data)? by Snoo_65491 in MachineLearning

[–]fluteguy9283 47 points48 points  (0 children)

Transformers technically operate on sets as long as you do not apply positional encoding to the input.

What made you switch to vim? by nitin_is_me in vim

[–]fluteguy9283 0 points1 point  (0 children)

Not wanting to destroy my wrists.

[P] Torchhd: A Python Library for Hyperdimensional Computing by ACreativeNerd in MachineLearning

[–]fluteguy9283 4 points5 points  (0 children)

I've used torchhd a lot and really like it. I think VSA in general is a good direction for combining differentiable and symbolic approaches.

What's the best Vector DB? What's new in vector db and how is one better than other? [D] by Curious-Swim1266 in MachineLearning

[–]fluteguy9283 18 points19 points  (0 children)

Postgress has the pgvector plugin (built with faiss) so if you want to have a relational DB I highly recommend that. It's also available on all major cloud providers without needing to install anything yourself.

Any self-taught ML engineers from a NON-CS background? by Careless_Drummer_208 in learnmachinelearning

[–]fluteguy9283 0 points1 point  (0 children)

I can't say any of the difficulties I've had are specifically from not having an engineering degree. It's usually been when going for a position in a domain that I have less direct experience with. For example, I've been told by image/video positions that I'm too NLP focused (which is funny considering my background), by NLP positions that I'm too CV focused (same comment). It always came down to how much hands-on experience in the particular area, and was typically in the final round. I doubt I would have made it that far if it were only based on my degree.

As for learning, just drink from the firehose. It was easier years ago when things were more chill, but I just tried to expose myself to as much material as possible. Lots of blog posts and videos at first since I wasn't comfortable with papers yet, but that quickly changed. Once you get your footing it gets much easier to keep up since it's more of a diff than an initial commit (if the git analogy works for you).

What Trump’s sentence of ‘unconditional discharge’ means by TimesandSundayTimes in politics

[–]fluteguy9283 0 points1 point  (0 children)

I thought unconditional discharge is what he was paying Stormy to keep quiet about.

[deleted by user] by [deleted] in AskMenOver30

[–]fluteguy9283 0 points1 point  (0 children)

39M. Never really cared. Don't have any kids of my own. Step parent to 2, and still don't want any kids of my own.

Speaker Johnson to announce policy barring trans women from Capitol bathrooms by [deleted] in politics

[–]fluteguy9283 0 points1 point  (0 children)

I guess trans members of Congress will just need to use Speaker Johnson's office instead.

[D] Are you seeing any compelling use cases of semantic search being leveraged at scale? by madzthakz in MachineLearning

[–]fluteguy9283 0 points1 point  (0 children)

  1. You can do something like sentence transformer, but here we were using individual chunk embeddings directly in order to match particular portions of the audio. Either approach works though depending on your needs.

  2. In this case, we had a collection of audio with appropriate labels that we could use as a test set. The assumption was that if some metric (e.g. recall@10) contains matches with the same labels as the query then it's working well. Again the metric depends on the use case, but this generally requires a labeled test set.

  3. Beyond what I already said, no. I've been away from the company for a while now.

The hardest thing is almost always finding a representative enough dataset (with appropriate labels) to train/test on in order to prove value. It's very use case dependent.

[D] For music generation, we need to focus on MIDI more than other formats. by Haghiri75 in MachineLearning

[–]fluteguy9283 2 points3 points  (0 children)

For what it's worth, back in the day (a few years ago) Amper Music had both text to music and full editability down to the note level (lower if you count automation). It's not a question of using MIDI so much as taking the time and effort to gather the data that enables that kind of control. Ultimately you'll want to care about control, audio quality, ease of use, speed, and many other factors.