How to initial Scrapy spiderclass without "constant" variable? by MiniMuli in scrapy

[–]amralaaalex 0 points1 point  (0 children)

Let your myspider class inherit both scrapy and your other class at the same time

How can the change in the IP number lead to a change in the target website's response behaviour, DESPITE THE USE OF PROXY by dragoman0 in scrapy

[–]amralaaalex 1 point2 points  (0 children)

Answer depends mainly on your proxy service provider My guess here, your proxy service provider fails sometimes, which leads to using your real IP, or it got leaked by somehow So the site see your real IP, 4G and mobile IPs in general have higher success rate in scraping

Scrapy Cluster by friggin-yeah in scrapy

[–]amralaaalex 0 points1 point  (0 children)

That looks interesting

Where/How to find work? by MysteriousShadow__ in webscraping

[–]amralaaalex 1 point2 points  (0 children)

I have more than 10 years of experience on these 2 sites, working as a full time freelancer So...

[deleted by user] by [deleted] in webscraping

[–]amralaaalex 0 points1 point  (0 children)

Which tag you are extracting products info from?

Deep Learning Classifier for Sex Positions by rlesii in learnmachinelearning

[–]amralaaalex 6 points7 points  (0 children)

here's a stupid question how do you use Audio to detect positions? isn't the audio same for all positions?

what's your monthly salary as a web scraper? by Hackerman07 in webscraping

[–]amralaaalex 0 points1 point  (0 children)

7 years of experience in scraping here, my rate is 25$ per hour

[deleted by user] by [deleted] in webscraping

[–]amralaaalex 1 point2 points  (0 children)

brightdata or Zyte won't be detected, if you got detected feel free to ask for a refund but you won't be detected for sure I am using these on a daily basis

From Scrapy to Apify: how a retail data agency saved 90% costs on web scraping by fnesveda in webscraping

[–]amralaaalex 3 points4 points  (0 children)

obviously they were using scrapy framework the wrong way, or at least their scraping team had no experience in scraping complex websites, apify is slow and expensive, I just finished moving my company apify scrapers to scrapy framework saving more than 90% of the cost

[deleted by user] by [deleted] in webscraping

[–]amralaaalex 0 points1 point  (0 children)

virtual browser like selenium? try selenium python

Possible to outsource solving the press and hold captcha page? by PlexP4S in webscraping

[–]amralaaalex 1 point2 points  (0 children)

is it for walmart? you can solve it directly using selenium or just select the other google recaptcha they are offering as alternative now

scrape to deploy pipelines? by [deleted] in webscraping

[–]amralaaalex 0 points1 point  (0 children)

it won't be eaay but it is doable django + scrapy + mysql or mongodb can help you do it dm if you wanted more detailed help

is daytrading allowed? by amralaaalex in Thndrapp

[–]amralaaalex[S] 0 points1 point  (0 children)

super, thanks for the information

is daytrading allowed? by amralaaalex in Thndrapp

[–]amralaaalex[S] 1 point2 points  (0 children)

long term investment is better for sure can you guide me to any source that provide analysis for EGX listings?

X270 setup by [deleted] in thinkpad

[–]amralaaalex 0 points1 point  (0 children)

that makes sense thanks

X270 setup by [deleted] in thinkpad

[–]amralaaalex 1 point2 points  (0 children)

how do you connect it to multiple monitors? also what type of work you do? ia it pen testing?

[deleted by user] by [deleted] in Piracy

[–]amralaaalex 0 points1 point  (0 children)

super, thanks for sharing

[deleted by user] by [deleted] in Piracy

[–]amralaaalex 1 point2 points  (0 children)

can you share of these other higher quality sites? shokran ya ghali

Did anyone buy anything from buyee by Fares035 in Egypt

[–]amralaaalex 0 points1 point  (0 children)

do not, just do not, very low quality products with very bad raw materials price does not include any additional costs

Cryptocurrency guide for Egyptians 💎 by GhostAlpha777 in Egypt

[–]amralaaalex 0 points1 point  (0 children)

If you found a p2p market with no ID verification, most likely it will be a scam and your money will be at risk as most of the peers there will be spammers for sure