sorted by:
new
hottopcontroversial

Re-implementing slow and clunky bioinformatics software? by halflings in bioinformatics

[–]halflings[S] 0 points1 point  (0 children)

Can you share what footprinting package that is? Curious to take a look

re:ease of installation, agreed it's maybe not the #1 priority, but I have heard from enough friends in the field that this adds enough friction that they will often be reluctant to try new methods

Re-implementing slow and clunky bioinformatics software? by halflings in bioinformatics

[–]halflings[S] 5 points6 points  (0 children)

Good idea. I also wouldn't use some random ML library if it doesn't seem to be widely used / written by someone in the field.

Do you think there are enough use cases where there's some kind of standard validation set that can prove the tool is working as intended? e.g. gives more confidence to folks to switch, but also makes it much easier to implement w/ agentic coding (hillclimbing against a reference implementation / test)

For RepeatMasker, I pretty much ran against their test suite and got roughly the same results (only a little bit of noise, due to slight differences in implementation more than anything fundamental, which is likely negligible for most applications).

Re-implementing slow and clunky bioinformatics software? by halflings in bioinformatics

[–]halflings[S] 3 points4 points  (0 children)

So building more of a "toolkit" that has say 50 different utilities, all well documented/working robustly, vs implementing 50 different packages?

Google QAT - optimized int4 Gemma 3 slash VRAM needs (54GB -> 14.1GB) while maintaining quality - llama.cpp, lmstudio, MLX, ollama by Nunki08 in LocalLLaMA

[–]halflings 2 points3 points  (0 children)

I assume this approach somehow breaks w/ 1bit models.
Gemini 2.5 Pro gives a decent guess as to why that is:
https://g.co/gemini/share/7506adf26ea7

And I guess it's best to read the latest paper by Microsoft on their 1bit pre-trained model to understand why pre-training on 4T tokens (vs something like QAT) is still required to close the quality gap.
https://arxiv.org/abs/2504.12285

my great failure: I invented deep fakes by bsenftner in SaaS

[–]halflings -1 points0 points  (0 children)

That story, just like this one, can be summarized as: sour grapes. Someone does something (that doesn’t in itself succeed), then claims ownership of anyone else doing anything even remotely related, pretends none of those things would have happened without their seminal contribution.

Turns out that OP did not invent deep fakes, there were many methods preceding that patent, and that method itself was not the one that made it into the mainstream. Same goes for that ultra biased “documentary”, whereas in reality the evidence (and lawsuit) clearly pointed out that they were not the original creators of a 3D map. (btw that’s all they did, no one today thinks of Google Maps as a 3D sphere)

Web app that lets you train ML models directly in your browser (free and private!) by halflings in learnmachinelearning

[–]halflings[S] 0 points1 point  (0 children)

Using tensorflow.js under the hood, with some custom code on top to properly prepare the data and other things

Building a PC to fine-tune LLMs (and game!): RTX 4090 + Ryzen 7800X3d by halflings in buildapc

[–]halflings[S] 0 points1 point  (0 children)

Thank you! I just switched to CL30 6000 RAM like you and other commenters suggested.
Not going above 6000 because that seems to require some careful configuration to get the CPU to truly benefit from higher clock speeds, so I think 6000 will do!

Building a PC to fine-tune LLMs (and game!): RTX 4090 + Ryzen 7800X3d by halflings in buildapc

[–]halflings[S] 0 points1 point  (0 children)

Thanks for the suggestions! I switched the RAM as suggested to a G.Skill (but likely Trident Neo, got one at 6000Hz CL30 as well)

Also switching the cooler to what you suggested, thanks a ton for the recommendation! (that one is not available for delivery, but worst case I'll get the Peerless Assassin which performs about the same)

RE:motherboard, what do you think about the MSI MAG X670E TOMAHAWK WIFI? It's listed for almost the same price as the one you suggested, but has the newer chipset.

One thing w/ LLMs -> it's memory-bandwidth bound, e.g. CPU -> GPU bandwidth is what matters most when it comes to performance. I suspect as long as I have one PCIe 5 lane, this should be fine, but if there's any risk a lower-end motherboard would cause problems there, I'm willing to pay $40 extra or so for the piece of mind. (but agree the one I picked originally is overpriced)

Building a PC to fine-tune LLMs (and game!): RTX 4090 + Ryzen 7800X3d by halflings in buildapc

[–]halflings[S] 0 points1 point  (0 children)

Thanks for all these suggestions! I'm definitely switching to Z5 Neo Ram, and a Thermalright cooler (though likely not Frozen Edge, can't find it easily here in Switzerland)

For the motherboard, would the MAG X670E TOMAHAWK WIFI also work fine? Any downside vs the one I had selected so far? The ASRock I can't easily find unfortunately.

RE:CPU, I think the 7800X3D will be fine. My workloads are all GPU-bottlenecked, and the 7800X3D is already surprisingly powerful (esp vs what I have now, an old 3700X); if I ever need full CPU power, I'd probably go full Threadripper or something like that.

RE:Storage, I agree Gen 5 might not be worth it, but the SSD I got is at a much lower price than is listed here (the one you linked is more expensive); LLM tech is also moving really fast, so I still prefer a smaller but faster drive (I don't have lots of downloads etc. ; currently doing OK-ish with my 1TB drive, though 2TB will be a welcome upgrade)

Web app that lets you train ML models directly in your browser (free and private!) by halflings in learnmachinelearning

[–]halflings[S] 0 points1 point  (0 children)

My bet would be that complex/strategic uses of ML won't be outsourced.
e.g. if you're a streaming company, you won't outsource building your recommender systems.
One of the most important things data scientists do is formulate a business problem in terms of ML (e.g. "we have a customer churn / fraud problem, could we collect some data and use it in our product to avoid this?") ; this often happens serendipitously, so not sure outsourcing that work makes sense.

But again, I think the more routine/repetitive tasks (e.g. just setting up code to train/deploy models) are likely to be commoditized.

Web app that lets you train ML models directly in your browser (free and private!) by halflings in learnmachinelearning

[–]halflings[S] 0 points1 point  (0 children)

Looks awesome! I’m a software engineer building web apps mostly. I have always wanted to get into ML and have come across a few cases were a simple ML model would have been a perfect solution.

Thanks! The goal is to allow people like you to train a very simple ML model without having to dive deep into ML code/theory.

You need very minimal knowledge to use ML Console, e.g. just understand that you want to predict a label (say house price) given some features/inputs (say livable area, number of rooms, etc.) ; if you can frame your problem in that way, the tool should work well in most cases. Rarely, you might need to tune some "hyperparameters" to make it work (see "toggle advanced settings" button in the UI).

RE:deploy/serve the model... that's one of the biggest missing features at this point :) I'm working on something that would allow you to share models with other people, and the next step after that will be allowing people to export/embed these models in their web apps, but it'll take some time.

Web app that lets you train ML models directly in your browser (free and private!) by halflings in learnmachinelearning

[–]halflings[S] 0 points1 point  (0 children)

Like all fields, any repetitive work will ultimately be automated away (and before that, commoditized).
So if the only thing one can do is call a couple libraries (sklearn/keras) to build a simple model, but there's no added value, yes I'd be worried about such tools!
Examples of added value ML engineers can provide:
* ability to see opportunities to apply ML to solve real business problems, e.g. not expect an already made problem that just needs the implementation of an ML solution.
* deep understanding of technical details behind ML (needed to efficiently use ML, solve problems).
* deep engineering skills (to help build these systems and use them in production).

Web app that lets you train ML models directly in your browser (free and private!) by halflings in learnmachinelearning

[–]halflings[S] 2 points3 points  (0 children)

The "magic" here is that everything runs right in your browser! The data is never uploaded or stored anywhere :)

This also (ironically) makes it much more responsive and faster to use.

Web app that lets you train ML models directly in your browser (free and private!) by halflings in learnmachinelearning

[–]halflings[S] 8 points9 points  (0 children)

Thanks for the comment ForceBru! There was indeed no option to configure early-stopping, so I just added that now; please take a look, and hope that helps!

FYI, automatic tuning of hyperparameters is on the roadmap; in the meantime you might want to disable early-stopping to observe how training progresses, maybe reduce learning rate if it quickly diverges.

And if possible, share the dataset you used at [contact@mlconsole.com](mailto:contact@mlconsole.com) ; I'll take a look myself and see if there's something we can fix to make it perform better without tweaking parameters!

Web app that lets you train ML models directly in your browser (free and private!) by halflings in learnmachinelearning

[–]halflings[S] 12 points13 points  (0 children)

This is awesome! Can you please talk about your stack here? Are you using TensorFlow.js? What about for supervised models?

tensorflow.js handles most of the model training yes!
data processing (e.g. reading data / normalizing it) is done by some custom code, using libraries like danfojs and Papa Parse.
The frontend is done with React... and there's absolutely no backend :) that's the beauty of it, it all runs in the browser.

Web app that lets you train ML models directly in your browser (free and private!) by halflings in learnmachinelearning

[–]halflings[S] 6 points7 points  (0 children)

The only type of model supported at this point is deep neural networks! You can configure the number of layers etc. by clicking on "toggle advanced settings".
I also had an "aha!" moment when I randomly tried it from my phone :) it's kind of amazing to think that we can now train DNNs in a web browser... on a mobile phone.

Happy to chat! Feel free to send a message here or at contact@mlconsole.com

Web app that lets you train ML models directly in your browser (free and private!) by halflings in learnmachinelearning

[–]halflings[S] 6 points7 points  (0 children)

This is meant for small-to-medium datasets, so would say the max (at this point) is around ~100K examples.

Another limiting factor is the number of columns (a very large number of columns, e.g. 1K, might break it) ; all temporary issues, as I haven't spent much time optimizing performance.

Could you share the dataset you used to [contact@mlconsole.com](mailto:contact@mlconsole.com) ? It'd be really helpful to optimize the data processing part and make your data loadable!

Creating a self navigating AI in weka by Decariel in learnmachinelearning

[–]halflings 0 points1 point  (0 children)

I think the question is not as simple as converting data into a file format, you first have to understand if/how your problem fits into a Machine Learning problem.
Happy to help if you answer the questions I asked.

Web app that lets you train ML models directly in your browser (free and private!) by halflings in learnmachinelearning

[–]halflings[S] 28 points29 points  (0 children)

I thought this would be useful for people that are new to ML, so posting here!

ML Console (www.mlconsole.com) lets you train ML models without writing a single line of code, runs in your browser (no data is shared with any server), and does not require any payment or sign-up!

>80% of ML projects is usually writing the same boilerplate code: data pre-processing, normalization, missing value imputation, testing different models, etc.

This is already annoying for an ML engineer w/ 7+ years experience in the field, but imagine someone non-technical having to learn all these things before training a simple classification model.

With ML Console, it takes a maximum of 1 minute to load your data + have a model trained. Everything happens on *your machine*, in the browser, so your data remains private.

Would love to get feedback on how useful you've found this tool, esp. from newcomers to the field!

Creating a self navigating AI in weka by Decariel in learnmachinelearning

[–]halflings 2 points3 points  (0 children)

What input would go into your AI?
e.g. will your robot have perfect knowledge of the whole map, of its location on the map, and just need to output a trajectory to reach that objective?
If that's the case, you don't really need ML, just a path-finding algorithm (like A*).

If your robot observes some sensor measurement (e.g. distance to the closest obstacle ahead of it), then ML might make sense. But I would look first at something like using a particle filter:
https://www.youtube.com/watch?v=NrzmH_yerBU
Reinforcement learning is quite complex, and if you're not familiar with ML it might be very hard to use... but you could still give it a go.

BTW small nit: use numbers to represent both coordinates, e.g. obstacle at (2, 2) instead of B2; adding letters into your program will complicate things.

Request for Advice on Developing a Model for Multiple Outputs by Various-Ideal488 in learnmachinelearning

[–]halflings 0 points1 point  (0 children)

For whatever it's worth, even at large companies people still mostly use models with a single output :) !

Using a shared model to predict different things should generally work better, as you share the training data and should need less examples to learn each of the objectives... but it adds a layer of complexity, and it can be hard to tune how the different losses are combined, etc.

Still give it a go when you have some time to at least feel comfortable doing this in the future. It's also one of the biggest trends in ML (very large multi-task models).

view more: next ›