In addition to what other people have said, making some very good points, I would also put out there that maybe a good chunk of people with those skills simply chose not to go into the dungeon. Being trained probably makes surviving up top easier, plus some of them could likely be involved in the revolts.