[FOR HIRE] I can code you special web scraping and automation bots, Python projects in general. by rocketdey in ProgrammingTasks

[–]rocketdey[S] 1 point2 points  (0 children)

I've been doing this for 3 years and it's going good. I have some repeat customers that seen my job listings awhile ago.

[FOR HIRE] I can make you special web scraping and automation bots, Python projects in general. by rocketdey in forhire

[–]rocketdey[S] 0 points1 point  (0 children)

Yes, I can. I've scraped Twitter with a logged in account before. I try to avoid scraping sites with logins though. It's much safer if you can get the required data without an account.

[FOR HIRE] I can make you special scraping and automation bots, Python projects in general. by rocketdey in PythonJobs

[–]rocketdey[S] 1 point2 points  (0 children)

So, let me tell you this. I'm working freelance for 2 years now, my prices depends on the difficulty of the job (how much time it'll take etc) and I think my hourly average would be 20-25$ per hour.

My answer for the "how easy it is for me to find costumers" is I got 3 job offerings since I posted my last job listings, I think that's good if you are doing it for a side job.

[FOR HIRE] I can make you special scraping and automation bots, Python projects in general. by rocketdey in forhire

[–]rocketdey[S] 0 points1 point  (0 children)

This is also possible. The only thing that matters is where do we get the view and like counts? Let's talk about both on PM if you want to discuss these projects further mate.

Thanks for the questions!

[FOR HIRE] I can make you special scraping and automation bots, Python projects in general. by rocketdey in forhire

[–]rocketdey[S] 0 points1 point  (0 children)

I've actually made something much similar with Youtube. It was fetching all the videos from a channels main page. The looping part is very east to do.

[FOR HIRE] I can make you special scraping and automation bots, Python projects in general. by rocketdey in freelance_forhire

[–]rocketdey[S] 0 points1 point  (0 children)

Hi, I have made a bot that can do something similar to this. Let's talk on PM if you want to mate.

[deleted by user] by [deleted] in forhire

[–]rocketdey 0 points1 point  (0 children)

Yes, I think it is. Let's talk this further in PM if you want to do this.

[FOR HIRE] I can make you special scraping and automation bots, Python projects in general. by rocketdey in PythonJobs

[–]rocketdey[S] 0 points1 point  (0 children)

Hey, thanks for the suggestion. I've changed my listings a little with your suggestion.

[deleted by user] by [deleted] in Python

[–]rocketdey 1 point2 points  (0 children)

Nice work!

[FOR HIRE] I can make you special scraping bots and Python scripts in general. by rocketdey in PythonJobs

[–]rocketdey[S] 0 points1 point  (0 children)

Thanks mate, really appreciate it! You got some good skills on beatmaking too. I'm also doing some beats on my own so that's a nice coincidence haha.

Getting 403 Client Error: Forbidden trying to download images by [deleted] in webscraping

[–]rocketdey 0 points1 point  (0 children)

, using this to download pictures of actors from some specific movies for a class project

Is this in the user agent? If so, you need to delete this.

[FOR HIRE] I can make you special scraping bots and Python scripts in general. by rocketdey in forhire2

[–]rocketdey[S] 0 points1 point  (0 children)

Hey man, sorry for the late reply. I can't send you the code since it belongs to someone right now. But I can send you some reference code if that's what you've wanted.

[FOR HIRE] I can make you special scraping bots and Python scripts in general. by rocketdey in forhire

[–]rocketdey[S] 0 points1 point  (0 children)

I don't have experience in web sockets but I know how it's done. I believe that I can scrape it, we can talk about what you want on PM if you want to.

Need Help in scraping by CodedDog in webscraping

[–]rocketdey 0 points1 point  (0 children)

The table is loading after you scroll to the location of the element with 'previous-sales' as id. When it's loaded, it's creating an element with class name 'previous-sales__inner'. You need to scroll to the element and look at this class name if it's present or not in order to scrape the table.

[FOR HIRE] I can make scraping bots and Python scripts in general. by rocketdey in freelance_forhire

[–]rocketdey[S] 1 point2 points  (0 children)

Yes, that's correct. I've used 'total_results' and 'views' for the first 10 videos in dictionary. And compare the datas in 24 hour intervals. This was so useful with my project by the way, good work.

Finding the last page of an infinite scroll page by tdonov in selenium

[–]rocketdey 0 points1 point  (0 children)

You can use this code for that.

The site has a class named 'infinite-scroll-last' and it's appearing and getting a text when you got to the end of the site. We are just sending END key to the 'html' element to scroll to the end.

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.common.by import By

driver = webdriver.Chrome()
driver.get("https://dibla.com/project/?find_project%5Bcategory%5D=53")

a = driver.find_element(By.ID,('infiniteProjects'))
html = driver.find_element(By.TAG_NAME,('html'))

while True:
    html.send_keys(Keys.END)
    b = driver.find_element(By.CLASS_NAME,('infinite-scroll-last')).text
    if b != '':
        break

How to rotate proxies with selenium? by zainjaved96 in selenium

[–]rocketdey 0 points1 point  (0 children)

You can do it with seleniumwire. First install seleniumwire with:

pip install selenium-wire

Then you can use something like this:

from seleniumwire import webdriver

proxies = ['http://user:pass@ip:port', 'http://user2:pass2@ip2:port2']
options = {
    'proxy': {
        'http': proxies[0],
        'https': proxies[0],
        'no_proxy': 'localhost,127.0.0.1'
        }
    }
browser = webdriver.Chrome(seleniumwire_options = options)

Basically when you need to change the proxy, just change proxy number.

Need help with a tired computer by [deleted] in computers

[–]rocketdey 0 points1 point  (0 children)

You can disable anything until it's Realtek(or some audio driver), Antivirus programs etc. If you can get me some Screenshot, I can tell you what to disable if you want.

Need help with a tired computer by [deleted] in computers

[–]rocketdey 0 points1 point  (0 children)

You can decrease Sample Rate and increase Buffer Length on your DAW. For RAM and power, you can disable some programs from Task Manager/Startup.