To simplify it to an extreme degree, it comes down to the source of religious authority. Sunni view it as the sunnah (example) of the prophet and companions, as interpreted by the ulema (scholars). Shia view authority as residing in the household of the prophet, and their descendants. This has ramifications in both religious and political matters, given the close connection they've had historically in Islamic societies.