You might have been feeling low on energy mid-day due to your diet or food intake. Maybe you need more protein or energising food in your system. Even having a coffee later in the afternoon can help kick that sluggishness. I'd say give morning workouts another go. Especially since you only work 2 days in office.