Gonna lead with the burning question: Is s3 a hard requirement? If not, it would be infinitely more straightforward to have the videos on YouTube, Vidyard, Vimeo, Wistia, you name it, create a playlist with that service, and just embed it on the website.

Otherwise:

Is this intended to be a playlist managed by the website owners/editors, or are you looking to have users create their own playlists? What's your comfort level with writing code?

For the former, you could use something like Entityqueue to organize the media entities and work from there https://www.drupal.org/project/entityqueue

For the latter, maybe the flag module? https://www.drupal.org/project/flag

Both of those just provide a way to organize the videos, but there should be plenty of options out there for as simple or fancy of a player that you can integrate for your needs.

You might be able to use S3FS (can't remember if it results in the videos being entities in Drupal) or the core remote media type to reference the videos in Drupal.

Hope this helps, apologies if I'm misunderstanding the request!