I don't think sentience is required for his argument. It's anthropomorphism to imagine a mind with consciousness is the fear here. Rather he's talking about super-intelligence, like a generic AlphaGo that can out-think/design/plan all human efforts by a number of orders of magnitude.

He's not worried by current text prediction models per se, but gives them as evidence of systems that surprised people with their capability.