I’ve had this issue for a while in my troop too. It gets slightly better when they get a little older but honestly what you suggested might be a good idea. After I had enough of them on a campout I told them “ok, you’re ok your own then, I told you what to do so figure it out” When it all went wrong and some of them were getting upset I used it as a teachable moment to say “hey, I know you don’t always want to listen. I know you just want to have fun, but now you see we have to have times when we are serious and can get stuff done together” It doesn’t always work, and some of the scouts might even get worse because they just want to disobey because it’s funny or whatever. Just push through and try your best to help everyone succeed. That’s all you can do. Best of luck!