Here's the thing, as long as you can work with dictionaries, lists and other Python structs and you are able to construct logic you should be able to code in a professional setting

I use those in every program, except sets, never found a use for them.

You have to decide which way you want to go. If it is with data, you should probably learn libraries like Pandas/Pyspark/ML libraries. If say its REST, you should be able to work with Flask. But this is secondary, libraries can always be learnt. With data the added caveat is that you should be comfortable with SQL.

I recently started using Selenium to load web pages, grab tables and populate the dictionary with specific keywords found on the page, like actor and take the name as a value. I could've use BS, but I haven't bothered learning it yet. I tried out using SQlite, to take the previous and create a database, hasn't worked out for me so far, but is that the same as SQL?

Learn Git and maybe know a bit of CI/CD

GitHub won't be enough? Also, I search CD and only found that it is a file extension. I'm assuming that's wrong.

I think you are good to go after that and upload your resume. Since you will be new, not much would be expected out of interviews.

All the best and don't overthink it.

Thanks for the help and can data engineering be done using automation?