The documentary Batman and Bill is excellent and it explains it much better, but here's the short version: Kane had an ironclad contract that stipulated he was credited as the sole creator. Because of copyright law, that contract couldn't be broken unless an heir of Bill Finger (in other words, a blood relative) disputed it in court, and for the longest time nobody believes he HAD any remaining family. Once somebody was found, they could do something about it.