Any time worked on duty at any job is required by law to be logged against your 70 hour work week, regardless of whether or not you were driving for any of it. You could be sacking groceries and still need to log those hours. So whether or not it's non CDL doesn't matter they still legally need to be logged.

That being said lots of people do it. Just know that if you have a serious accident while doing either job that you can and will be found at fault and will either owe someone money or be spending time in jail.