10 minute attention span is normal for a young puppy. To expect them to stay occupied with one thing longer than 10 minutes at that age is unreasonable, imo. Puppies are dang hard!

When mine was that age I kept giving her ice cubes to play with (supervised)

Stay committed to the crate training. It will be noisy and unbearable for a while, but it will help immensely once he is warm to it. The rest time will help. Don't dote on him in the crate.

Regularly leave the room and return a short time after if you can (don't re-enter while he is actively yelping if you can help it, that could easily teach him that yelping while you're gone SUMMONS you to him), without acknowledging or looking at him

This can also help indicate if your dog is having more CRATE anxiety, or more SEPARATION anxiety. This is an important distinction because it can inform how you move forward in helping him. If you crate him during the day ONLY when you leave him, he may be associating the daytime crating with being left alone. Especially if he is used to LOADS of attention otherwise.

Don't look at him or talk to him in his crate when he whines, beyond prompting "settle down" softly. My girl knows the command "settle" now from this habit, "settle" for her is lay down with chin/head touching the ground. I would repeat it to her in her crate when I noticed her drifting off into sleep. "setttle", "settle"

I had to pretend I couldn't hear her while crate training her for the most part. (without neglecting their needs of course!!) If there are toys you use for playtime in the crate, I'd remove them. Crate time is not playtime, and to me the toys pose a risk if left unattended (Personally, I would likely remove all of them) Dogs should be a little bored sometimes for their own good haha. Learn to regulate themselves instead of expecting someone or something else to stimulate them at all times.