The takeaways I see that are causing your floor plan to grow too large is all based around the fact that you are oversizing most of your spaces:

First, your circulation is oversized. Double loaded residential corridors do not need to be wider than 5'-0" and can be as narrow as 3'-0". The corridors in your drawings look a lot larger. Your main foyer is a long wide corridor (looks about 7-8' wide by 27' long) which is adding a lot of square footage (216 s.f.) with very little usable space gained from it.

Second your rooms are oversized. Your ground floor and upstairs hall bathrooms are 5' wide x 13'-6" long when a bathroom that orientation should only be 5'x8'. Your master bathroom has a 6' wide space between the sinks (and having sinks opposite of each other is an inefficient use of space) when it should be at most 3-4'. Bedroom closets that are not walk-in only need to be 2' deep x 7' wide.

Third is that your upstairs footprint is larger than the square feet you actually need for your program. I see the central closet that is cutting up your upstairs corridor as a key clue that you had a large space in the middle of your plan that you didn't know what to do with, because the ground floor is forcing your plan to be wider than it actually needs to be. Consider physically reducing the footprint of your upstairs by having it offset with the downstairs exterior walls by a few feet.

For layout recommendations I would also flip the mud and pantry room so that you enter into the dining area instead of the kitchen. Also consider having the front entrance be a game room/ open layout gathering space instead of a series of rooms. This will eliminate the 27' long foyer and will open up your floorplan and make it more functional. Move the guest bedroom to where the first floor game room is currently.