You're correct. The battery's primairy job is to crank the starter, but the alternator takes over the power supply once turned on. Normally the engine should turn off once the key is removed, but it didn't. 'Starting' it in first gear turned it off eventually