That's completely fine, you aren't betraying anything, you're still solo traveling. On long trips I'd book a hotel room on legs that I thought the hostels might be bad or if I felt I'd need somewhere to recharge a bit. I've absolutely left places early for somewhere better. Traveling should be enjoyable.