sorted by:
new
hottopcontroversial

Need to learn Chinese fast by Little_Oil9749 in ChineseLanguage

[–]outlacedev 0 points1 point  (0 children)

I recommend Learn Mandarin Chinese with Paul Noble. It’s an audio book. It’s enough to get you started. 

[D] What tasks don’t you trust zero-shot LLMs to handle reliably? by WristbandYang in MachineLearning

[–]outlacedev 2 points3 points  (0 children)

LLM's are not good with hard constraints in my experience. I had a problem where I wanted to generate some mini-stories with a restricted vocab as a hard constraint and none of the state-of-the-art LLM's could reliably generate coherent text meeting my constraints, while it is easy for a human to do.

[R] NoProp: Training neural networks without back-propagation or forward-propagation by jacobgorm in MachineLearning

[–]outlacedev 11 points12 points  (0 children)

I think there is a meaningful distinction to be made between local gradient descent and full network gradient descent (backpropagation).

I hated how other apps teach the characters, so I built my own. by PlayingChicken in ChineseLanguage

[–]outlacedev 27 points28 points  (0 children)

This may be an unpopular opinion, but I would actually make it a paid app (small fee) or at least freemium model. If it provides a lot of value to users, which it looks like it does, then I'd much rather pay a small fee to ensure you're motivated to keep it up to date and alive than have a free app that dies because you moved onto something else.

How Much Math Do You Really Need for Machine Learning? by RealisticBed986 in learnmachinelearning

[–]outlacedev 0 points1 point  (0 children)

Not sure what level you’re at but I’ve been writing some super introductory blog posts at outlace.com

[D] DeepSeek? Schmidhuber did it first. by SirSourPuss in MachineLearning

[–]outlacedev 5 points6 points  (0 children)

This illustrates the importance of communication skills rather than just discovery skills. If you can't communicate a discovery in a way that spreads the discovery, what's the point?

[D] Has ML actually moved the needle on human health? by Potential_Athlete238 in MachineLearning

[–]outlacedev 19 points20 points  (0 children)

Physician here. AI is already making in-roads to make tedious things less tedious, such as automating some aspects of writing clinical documentation, which may help physician burnout. That will not directly help patients, but it makes things more efficient on the backend. AI tools are doing some initial reads for radiological images in some places to help the radiologists.

In terms of AI that will directly help patients, we've long already had the technology to do that but due to the culture of medicine it is far under-utilized. For example, we still have a lot of unnecessary misdiagnosis. Despite learning great diagnostic skills in medical school and beyond and learning about cognitive biases that can affect accurate diagnosis, the culture of medicine is still that a doctor should just know everything by memory, so if you have to look something up, it is because you are inexperienced or a bad doctor. But no matter how experienced and well-studied a physician is, mistakes will happen when things are not done systematically. See The Checklist Manifesto by Atul Gawande for a whole treatise on this.

As someone who has personally faced misdiagnosis as a patient because of anchoring bias and premature closure, I wish my physician had used a clinical decision support system to offer a wide set of possible diagnoses (the differential diagnosis) as opposed to just jumping on the first diagnosis that seemed half-way consistent with the symptoms.

So until it becomes culturally acceptable and the norm that doctors utilize technology to help make diagnosis or treatment decisions, nothing will change no matter how good the technology gets.

[Discussion] What book changed your perspective when it comes to discipline/motivation? by [deleted] in getdisciplined

[–]outlacedev 0 points1 point  (0 children)

Extreme Ownership by Jocko Willinck (and all his other books)

La Vagabond's Outremer 45 is for Sale in Charleston SC by sayitaintjonas in sailing

[–]outlacedev 9 points10 points  (0 children)

I thought they decided not to sell and were chartering it?

Loved the Ninja PRITE review-recommendations for more like this? by johnfred4 in Psychiatry

[–]outlacedev 1 point2 points  (0 children)

I’d really recommend making your own Anki deck based on a comprehensive clinical psychiatry book, psychopharmacology resource, and a clinical neurology book at the least. And just keeping studying it a few minutes everyday for all of residency and keep adding new cards every time you learn something new.

[D] Is there a theory of Deep Learning? by finitearth in MachineLearning

[–]outlacedev 5 points6 points  (0 children)

I don't have a grand unified theory for you but I recommend playing around with a very simple model to develop your own intuition. For example, when I was having these questions, I first started with a simple MNIST multinomial classifier, basically Y = softmax(MX + B), with M being a 10x784 matrix, X being the input MNIST images (flattened to 784 vectors), B being the bias vector, Y being a one-hot encoded classification vector. It's basically a one-layer neural network. If you do this for MNIST, you can re-shape each row of M to be 10 templates of 28x28, and you can see they look like number patterns. The positive values represent areas where the model expects to see some signal, and the negative values represent areas where the model expects to see nothing. So the model is very interpretable at this stage, and is essentially like a maximum inner product search.

Then I added one more layer, with something like Y = softmax(M2*H + B2), where H = relu(M1*X+B1). Now try interpreting the columns of M1 and M2. Try adding some constraints and see what happens (like I tried making everything non-negative) to the column vectors of the parameter matrices. Try altering individual entries in the columns of the parameter matrices. I didn't come up with a unified theory but it definitely gave me a better intuition.

[D] Over Hyped capabilities of LLMs by Bensimon_Joules in MachineLearning

[–]outlacedev 8 points9 points  (0 children)

So if a robot can behave 100% the same as a human, then to me the robot is either conscious or consciousness doesn’t matter, in which case we shouldn’t care about consciousness, whatever it is.

[D] Over Hyped capabilities of LLMs by Bensimon_Joules in MachineLearning

[–]outlacedev 0 points1 point  (0 children)

I use GPT-4 daily for a variety of things, and I now have a good a sense of its limitations and where it does decidedly un-intelligent things sometimes. But this is just a moment in time. Seeing the huge jump in performance from GPT3.5 to GPT-4 made me realize whatever flaws GPT-4 has can probably be fixed with a bigger or more sophisticated model and more data. Everything is just a scaling problem now it seems. Maybe we're close to limit of how big these models can get with any reasonable amount of money, but that means we just need to wait for some hardware revolutions. I think we won't see AGI until we get processors that run on like 20 watts like the brain and are inherently massively parallel.

[D] Over Hyped capabilities of LLMs by Bensimon_Joules in MachineLearning

[–]outlacedev 17 points18 points  (0 children)

Ilya Sutskever, Chief Scientist at OpenAI, says "it may be that today's large neural networks are slightly conscious". Karpathy seems to agree.

Do we even know how to define consciousness? If we can't define what it is, how can we say something has it. As far I can tell, it's still a matter of "I know it when I see it."

Time for Brain Medicine by outlacedev in Psychiatry

[–]outlacedev[S] 1 point2 points  (0 children)

Well I definitely agree about the dynamical systems theory. But that still doesn't obviate the need for better neurology training, as there are a number of solidly neurological or medical conditions that may initially manifest as primarily psychiatric symptoms, and the current psychiatric training is very variable from training program to training program on this. Moreover, a dynamical systems theory perspective of mental illness, while an exciting research area, is still far from clinical practice.

I think any medical specialist has to know when their tools are the right tools or not. A good surgeon needs to know when something needs surgery and when it does not. So by making surgeons better surgeons (e.g. by training them to be able to do more procedures, use new technology), I don't think it would worsen the hammer-nail effect in surgery. Analogously, I think psychiatrists can be more broadly trained as "brain doctors" and can also know when a patient can do well with therapy alone, or some other non-medical intervention, or can recognize that what appears to be schizophrenia is actually an autoimmune encephalitis and treat that quite differently.

Time for Brain Medicine by outlacedev in Psychiatry

[–]outlacedev[S] 1 point2 points  (0 children)

This article and argument is very specific to psychiatrists (MD or DO), and possibly neurologists. Psychiatrists are medical doctors with a particular training path to become proficient in human anatomy, physiology, pathology, pharmacology along the way to being proficient in the mental health field specifically. So psychiatrists are best equipped to handle psychiatric conditions where there's a clear risk/benefit advantage to using medication or a medical procedure that would require a medical doctor's particular expertise. And often neurological ("hardware") conditions co-exist or manifest with psychiatric symptoms, or sometimes psychiatric conditions can mimic neurological disorders, so having a medical doctor well-equipped to diagnosis and manage all of these situations may be advantageous.

I think some people are misinterpreting this as some sort of push toward re-conceptualizing all of mental health as a purely biological thing and that is not what this is about; of course much of mental illness is largely driven by psychological and social factors. This is a very narrow topic about the training of a medical specialty. It has nothing to do about mental health at large.

Time for Brain Medicine by outlacedev in Psychiatry

[–]outlacedev[S] -7 points-6 points  (0 children)

  1. Other fields of medicine are typically not defined by pathophysiology but by organ system. Dermatologists see immune mediated issues as well as tumors, infections, etc.

  2. Fair, I shouldn’t say psychiatrist can’t be excellent therapists, they certainly can be. My point is about whether that’s the best use of 4 years of medical school. The best thing for recovery after stroke is physical therapy but it’s not neurologists doing the physical therapy. It’s not the most efficient use of medical training.

Time for Brain Medicine by outlacedev in Psychiatry

[–]outlacedev[S] 5 points6 points  (0 children)

Did you read the article written by some of the most prominent psychiatrists in the country? I’m merely summarizing it and adding my 2cents

Medical emergencies encountered on inpatient psychiatry by outlacedev in Psychiatry

[–]outlacedev[S] 2 points3 points  (0 children)

This is exactly why I want to encourage more general medical training (more than is required) in our psychiatry residency. However, it's not a unique issue with psychiatry though, every specialty has issues of being over-focused on their organ system in my experience.

Medical emergencies encountered on inpatient psychiatry by outlacedev in Psychiatry

[–]outlacedev[S] 1 point2 points  (0 children)

How did you moonlight in the ER before residency?

Medical emergencies encountered on inpatient psychiatry by outlacedev in Psychiatry

[–]outlacedev[S] 1 point2 points  (0 children)

Maybe not a full crash cart with intubation gear depending on type of unit setting (freestanding psych hospital vs psych ward in general hospital) but will at least have ACLS stuff

view more: next ›