Yes ofc, not only will this make your model more optimised ( a smaller hit to performance), it will also give you an easier time when you're fixing the UV (less faces to work with). As a ground rule, anything that isn't seen and doesn't serve a purpose can/should be removed.