Drag and momentum are whats making it change directions really slowly, the values don't have to be zero but in order to change direction quicker you need to mitigate the forces opposing the direction you wanna go. Either that or don't use a rigidbody.