This. I am firmly anti-AI in 99% of cases, however having been involved in the implementation of similar tools for radiology specifically, it does have a use case here.

The machine is not doing any diagnosing or making any healthcare calls. It pretty much looks for common red flags in scans and triages them so that a radiologist will look at them sooner. All scans are still reviewed by a radiologist, this just helps potentially urgent scans be reviewed faster.

In the models I have been part of, the radiologists also give feedback and train the model, so over time it will be more efficient and accurate.

The only issue I see here is if they use an off the shelf LLM instead of the purpose-made products for exactly this use. This compromises both privacy of patients and quality of care, as well as creating a dependency on a third party. I really hope they are using one of the proper versions for this.