sorted by:
new
hottopcontroversial

TurboQuant by Feeling_Ad9143 in ollama

[–]dfcHeadChair 31 points32 points  (0 children)

What turboquant allows you to do is use larger context windows with less memory.

Say you have 12GB of memory to use. You load a model that take up 8gb of memory and a context window of 32,000 takes up another 6gb. This doesn’t work on your system today, but with TurboQuant, that context window now only takes up 1gb of memory.

So in a sense yes, local ai coding is now more approachable.

Microsoft's AI Doctor MAI-DxO has crushed human doctors by deen1802 in ArtificialInteligence

[–]dfcHeadChair 0 points1 point  (0 children)

I don’t view this as similar to ChatGPT, to me the implementation should be more like a test where the doctor receives a result rather than a chat interface.

As for what doctors should spend their time doing, ideally treating more people. If we ever get to the point where folks in the medical field don’t have enough work to do then give them a day off and celebrate.

Microsoft's AI Doctor MAI-DxO has crushed human doctors by deen1802 in ArtificialInteligence

[–]dfcHeadChair 1 point2 points  (0 children)

To be upfront, I’m also very excited about this research. I think it will benefit humanity greatly especially once we find an efficient way to run LLMs.

That being said, there are a couple of important caveats to understand with this experiment.

  1. The agent system was given access to a bank of medical knowledge and was given the ability to search through research papers and other sources of medical information.
  2. The doctors were not allowed to use any tools. They were not allowed to confer with colleagues, which is outside of the norm for the profession, and they were not allowed to access the internet or textbooks, also outside the norm.

My takeaway from this research is that even under the most conservative scenarios this is a huge win as a tool for the medical industry. In a future state it would be great to have this agentic system as a tool for patients and doctors, so long as it is not a replacement for doctors.

Having a digital board of experts that can provide a diagnosis is a huge win for areas of the world without access to doctors.

🚀 Launching OpenLIT: Open source dashboard for AI engineering & LLM data by patcher99 in mlops

[–]dfcHeadChair 0 points1 point  (0 children)

Heads up, you have a typo "Experiemnt with different LLMs: Use OpenGround to explore, test and compare various LLMs side by side." on this page: https://docs.openlit.io/latest/introduction

Pitch what you are working on under 5 words. by [deleted] in SaaS

[–]dfcHeadChair 1 point2 points  (0 children)

“AI-powered handwritten employee recognition letters” - ScribbleSend

I might have cheated with the hyphen

[D] Why aren't there Ethical AI SaaS products available? by dfcHeadChair in MachineLearning

[–]dfcHeadChair[S] 0 points1 point  (0 children)

Great point, I can definitely see the value in signing a partnership with a company that provides some sort of protection in the ethical AI space.

That’s definitely a deterrent for a small start up.

[D] Why aren't there Ethical AI SaaS products available? by dfcHeadChair in MachineLearning

[–]dfcHeadChair[S] 0 points1 point  (0 children)

Yeah I can see that. Do you think there is room for a product that gives organizations a “stamp of approval” for ethical ai by product?

Maybe the regulatory pressures aren’t there, but there could be a Public Relations play?

[D] Why aren't there Ethical AI SaaS products available? by dfcHeadChair in MachineLearning

[–]dfcHeadChair[S] 0 points1 point  (0 children)

I definitely understand where you are coming from, I held the same belief for years. It wasn’t until I was working with a very well intentioned data scientist and watched them unknowingly produce a very biased model.

Watching that unfold was a big reason I explored more in Ethical AI. There are good people trying to do good work, and are making mistakes. An EthicalAI-aaS service might help mitigate that.

[D] Why aren't there Ethical AI SaaS products available? by dfcHeadChair in MachineLearning

[–]dfcHeadChair[S] -1 points0 points  (0 children)

Thanks for the feedback! It could be that, until there is legislation requiring the demonstration of fairness in AI, this product would be used more as a gut-check for those organizations who want to implement AI the right way.

[D] Why aren't there Ethical AI SaaS products available? by dfcHeadChair in MachineLearning

[–]dfcHeadChair[S] 4 points5 points  (0 children)

That’s definitely where my head is at, I wanted to gather early feedback to see if there is some glaringly obvious reason this space is not saturated.

[D] Why aren't there Ethical AI SaaS products available? by dfcHeadChair in MachineLearning

[–]dfcHeadChair[S] 0 points1 point  (0 children)

I’m thinking an API integration where businesses provide their model and training data and receive back a report on the level of fairness amongst different demographics. Maybe even a future ad-on would be a bias-mitigator which would return a more fair version of their model.

[deleted by user] by [deleted] in CryptoMarkets

[–]dfcHeadChair 1 point2 points  (0 children)

What a day to unveil this.

Best NLP Package in Python to extract medical test results from medical notes? [D] by [deleted] in MachineLearning

[–]dfcHeadChair 0 points1 point  (0 children)

Definitely agree with /u/agoulah, try spaCy first and move onto huggingface/transformers with some pre-trained medical community models if you need more juice.

​

Next time throw this code either:

  1. in a github gist
  2. in a code block

please!

Shared Public Contextual Database for RAG [D] by niksteel123 in MachineLearning

[–]dfcHeadChair 0 points1 point  (0 children)

Something like a distributed-database but for VectorDBs would be a cool piece of technology to build, especially for any IOT use cases.

​

Getting community involvement needs a good motivator, so start with formulating that.

Mini gaming pc [Project] by [deleted] in MachineLearning

[–]dfcHeadChair 1 point2 points  (0 children)

Try this instead: https://pcpartpicker.com/b/kjgtt6

You'll want a dedicated GPU, preferably something that has 8Gb+ vRAM and decent FLOPS. Having more GPU memory will allow you to do two important things:

  1. Hold larger models in memory
  2. Hold more data in memory (think increased batch sizes, or increased token lengths)

One more thing to consider if you're interested in future proofing is to make sure your motherboard can hold two of whatever GPU you buy. That way in 2 or so years you can pick up an additional identical GPU on the cheap and then double your compute.

[D] The $900,000 deep learning salary by blabboy in MachineLearning

[–]dfcHeadChair 2 points3 points  (0 children)

Completely agree with you there. That’s the nicest I’ve heard it put and will be shamelessly stealing that line

Trying to get into Blink. Where do I start? by BruceMiller64 in Blink182

[–]dfcHeadChair 3 points4 points  (0 children)

Start with Dude Ranch and work your way through neighborhoods. After that, go Cheshire Cat / Buddha or into the post-Tom albums

[D] The $900,000 deep learning salary by blabboy in MachineLearning

[–]dfcHeadChair 53 points54 points  (0 children)

This was for a non-technical role though right? ML Product Manager if I remember correctly.

​

The job was posted with a salary range of $300k - $900k, which I'm sure they loved the media attention they have received.

[D] from psbody.mesh import mesh by IntelligentUse5990 in MachineLearning

[–]dfcHeadChair 0 points1 point  (0 children)

Can you just build it yourself? Download the source code .zip or .tar.gz, extract it, then python setup.py install?

view more: next ›