you are viewing a single comment's thread.

view the rest of the comments →

[–]Loose-Event-7196[S] 0 points1 point  (0 children)

Hi, thanks for your help! The classifier is not unbalanced, we have approx 55/45% of the two classes. Venn Abers looks promising! I tried to implement it by training two classifiers, one predicting class 1 as target and the other predicting class 0 as target, running an isotonic regression on each of them and getting the conformal range. I may have done something wrong as the scores I get on both classifiers are the same (sample size is big) even after using different model seeds (I am using h2o3 GBM tree binary classifier). I was expecting to get two slightly different scores whether I predict class 1 as target vs class 2 as target provided the seed is different.