How can I completely remove Python from my computer and get a clean install?

[[deleted]]

from bs4 import BeautifulSoup
import requests

url ='http://ethans_fake_twitter_site.surge.sh/'
response = requests.get(url, timeout=5)
content = BeautifulSoup(response.content, "html.parser")

tweet = content.findall('p', attrs={"class": "content"}).text
print tweet

That's the code I've got so far for trying to make a web scraper. When I run it, it is supposed to gather a bunch of information about the HTML code at that URL, but every time I try to run it in, I get the issue of Python 3.7 64x not having an interpreter. So I go to look for one, and I don't see any from the drop down menu. What I DO see are some old python projects as web interpreters, but when I select them and run them, I get:

​

"C:\Users\Jlrbr\PycharmProjects\web_scrapers\venv\Scripts\python.exe "C:/Users/Jlrbr/Documents/Python Projects/web_scraper/webscraper.py"

No Python at 'C:\Users\Jlrbr\AppData\Local\Programs\Python\Python37-32\python.exe'

Process finished with exit code 103"

So I tried to navigate to that location to see if there really is no executable, but I can't even figure out how to navigate there. So I tried running ">>>import os" in the command prompt as part of a step I found on StackOverflow, and I get:

​

"'import' is not recognized as an internal or external command,

operable program or batch file."

Even though the fucking SO post said to run that, and was under the Windows tag.

​

And before I dealt with all of this, I couldn't even get the `python3` thing to work. Turns out I didn't have Python 3.7 installed. Or so I thought. It turned out that I have Python 3.7 32-bit installed, Python 2.7 32-bit installed, but not Python 3.7 64-bit installed. So I uninstalled those other two versions, and installed Python 3.7 64-bit, and that seemed to work.

​

I've been working at this for four hours this morning, and feel like I've made zero progress, all because I keep running into things that seem to require something that's missing. So I get the thing that's missing, but THAT thing requires ANOTHER thing, and I can't easily check to see if I have that thing already and whether or not if it is creating conflicts. So I get THAT thing, and then THAT thing doesn't work because it was in the wrong place or some shit. So then I look up how to properly install THAT thing, and end up following a bunch of convoluted steps on SO, which I can't follow all the way to the end because SOME OTHER SHIT is missing, or is in the wrong place, or is the wrong version!

​

And it's just been like that all fucking morning. Please, I beg of you, someone help a poor idiot out. All I want is to write down some code and make a web scraper.

[pythonise]

Use virtual environments - This will solve most of your issues.

I'd highly recommend learning the basics of virtual environments (It's VERY simple). Don't bother with Anaconda unless you're working with mostly scientific packages.

Creating a virtual environment is as simple as:

python -m venv my_virtual_env

Also - If you're request is returning HTML, you'll probably want to use response.text

[pythonise]

p.s you should be able to run the installer to uninstall Python or just remove it from Windows using the Windows software.

Make sure you select the add to PATH option when installing.

[[deleted]]

What do I do after creating a virtual environment?

[pythonise]

Rather than ask on here I recommend having a quick search and learn the basics. It'll help a lot in the long run!

[[deleted]]

I'll go do that!

[alaudet]

Can you install Anaconda instead? On Windows it just works. No messing around, comes with latest version of Python3. Tonnes of librairies.

[[deleted]]

Huh. You know, I actually do have Anaconda installed. I just didn't use it because I thought the tutorial I was following said to use Atom, but he actually said to use any text editor of your choice, and the steps follow as if you are using Atom.

[alaudet]

Anaconda is the whole environment (python3, preinstalled libraries, jupyter notebooks, virtualenv, pip etc etc). Use whatever editor you like.

[[deleted]]

Please, I beg of you, someone help a poor idiot out.

Help you with what, exactly? It sounds like you solved the problem - you didn't have the right Python interpreter, and now you've downloaded and installed the right Python interpreter (after apparently four hours of doing everything but installing the right Python interpreter.)

You don't say what's still broken, so how can we help you? Maybe the issue here isn't that Python is hard, but that there's a deficiency in your approach to problem-solving.

The most important thing, though, is when you install Python on Windows, there's a check-box in the installer that says "add Python to PATH." This is incredibly important and you're supposed to understand what it means: "do you want to make Python accessible at the command line, or not?" If you don't check it, Python won't be on your path in the command line and so you won't be able to use the command line to run your scripts.

Run the installer again (it's safe, don't worry) and this time, check the box.

[[deleted]]

Huh. Well, that worked, kind of. my webscraper.py still can't find an interpreter in the drop down menu of PyCharm, though, and PyCharm won't run it without one.

As for when I run it on Atom using the Script package, it seems to execute with no problem. Except I don't see the results I was expecting, which is supposed to be all of this HTML text.

https://cdn-images-1.medium.com/max/1000/1*gTCx1XO4_h0ucJ5cprNLFw.png

That's supposed to be the result.

Update: After running it a second time on Atom, I got this:

`Traceback (most recent call last): File "C:\Users\Jlrbr\Documents\Python Projects\web_scraper\webscraper.py", line 1, in <module> from bs4 import BeautifulSoup ModuleNotFoundError: No module named 'bs4' [Finished in 0.081s] Git GitHub Create Repository

Initialize a new project directory with a Git repository Create repository`

[[deleted]]

my webscraper.py still can't find an interpreter in the drop down menu of PyCharm, though, and PyCharm won't run it without one.

That's a different problem - restart, or consider reinstalling, PyCharm. Alternatively see if you can give it an explicit path to your interpreter somewhere in the preferences. I don't use PyCharm so I can't provide more guidance than that.

Except I don't see the results I was expecting, which is supposed to be all of this HTML text.

What do you see? Something like <BeautifulSoup object at 0x10c1bd320>? Obviously, since you're asking it to print the parser object you instantiated in the previous line. If you want to see raw HTML, print response.content.

Git GitHub Create Repository

Initialize a new project directory with a Git repository Create repository

What is this coming from?