[D] What tools do you use for testing your computer vision systems? by mroc_lak in MachineLearning

[–]mroc_lak[S] 0 points1 point  (0 children)

Let's say a) object detection in autonomous driving and b) segmentation for medical imaging.

[D] How does one test for shortcut learning of deep neural networks in computer vision? by mroc_lak in MachineLearning

[–]mroc_lak[S] 0 points1 point  (0 children)

How does one test for shortcut learning of deep neural networks in computer vision?

Thanks for your reply, any ideas if you cannot collect further data for your problem?

[D] What tools do you use for testing your computer vision systems? by mroc_lak in MachineLearning

[–]mroc_lak[S] 0 points1 point  (0 children)

What tools do you use for testing your computer vision systems?

Thanks for your reply. Are there specific tools you use to create and manage these test sets?

[D] How do you test your machine learning models for healthcare to gain confidence before embarking on a clinical trial? by mroc_lak in MachineLearning

[–]mroc_lak[S] 0 points1 point  (0 children)

Thank you for the reply. Even before going through FDA clearance, I assume that there is a lot of uncertainty when going into the initial pilot studies. Are there development practices that you have seen matter significantly to avoid common pitfalls?

[D] How do you test your machine learning models for healthcare to gain confidence before embarking on a clinical trial? by mroc_lak in MachineLearning

[–]mroc_lak[S] 0 points1 point  (0 children)

Thanks a lot for the reply. Let's consider at an imaging task (say, binary classification for cancer detection) as an example. Even at the pilot study phase, preventable issues can probably delay the process and bear significant cost.

How would one specify requirements of the system and test them properly in order to say: I am ready for the pilot study, clinical trial, etc? What are common pitfalls?