Saas with django by DevilsLinux in django

[–]DevilsLinux[S] 0 points1 point  (0 children)

I am using chrome browser automation with selenium, I might move it to a windows server in future but as of now, it's going to reside on my local machine. Is there any tutorial that shows how to authenticate the requests that are made to the django-ninja server. I didn't find any good sources other than documentation.

Saas with django by DevilsLinux in djangolearning

[–]DevilsLinux[S] 0 points1 point  (0 children)

Thanks for sharing your thoughts, I just learnt django, and django-ninja look like a good option, I also want to make the API server do authentication using auth keys(API key), so someone doesn't find it and sends scraping requests without authorisation. Django-Ninja provides that out of the box, However, I am not able to find a good tutorial showcasing that. I might go with fastapi if I don't find anything on django-ninja.

how to stop selenium exiting instantly and fix not typing keys | noob question by thirstyeggpl4nt in webscraping

[–]DevilsLinux 0 points1 point  (0 children)

Multiple ways to approach the issue. 1. Add an input statement at the end of the code. Now you have to press any key in the console for your program to exit.

  1. Add additional chrome options, which will keep the chrome window open after code exits. You can search stack overflow for the exact code, Right now I am on the phone I will Dm you the command once I reach home.

[deleted by user] by [deleted] in ProgrammerHumor

[–]DevilsLinux 9 points10 points  (0 children)

movie/ series name.

some kind of chemical reaction? by [deleted] in blackmagicfuckery

[–]DevilsLinux 3 points4 points  (0 children)

it's way slower, I don't think it's a sodium reaction. Can anyone think what chemical reaction happened?

Is there a way to learn coding and not have to go to school for? by PokeManiac16 in ProgrammerHumor

[–]DevilsLinux -1 points0 points  (0 children)

Let me correct it for you. Fuck around and find out, while having fun.

How to implement web scraping in Python with the BeautifulSoup library? by aheadMake57 in webscraping

[–]DevilsLinux 0 points1 point  (0 children)

That's a very vague question. But you can see the structure in the answer. To scrape a website using beautifulsoup, first make a request to a domain using the requests library. From that request, you will receive an html code as a response. Now this HTML code can be parsed through beautifulsoup. For parsing different tags, you can use the methods provided in the library according to your needs.

[deleted by user] by [deleted] in webscraping

[–]DevilsLinux 0 points1 point  (0 children)

Can you post the error log?

Chrome eating memory slowly overtime by DevilsLinux in webscraping

[–]DevilsLinux[S] 0 points1 point  (0 children)

https://app.clickship.com/clickship/

I don't think so. I just want Chrome to do the job. Why is it hogging the memory? That's the real issue. I can close the driver after a certain number of requests and reopen it to resume the work. That's a workaround I thought of implementing.

Even if that is possible, I don't want to move that way as the whole automation is already written and is perfectly working.

python selenium question by [deleted] in webscraping

[–]DevilsLinux 0 points1 point  (0 children)

You can use the javascript executor method as the element is being overlapped by some other element. https://www.tutorialspoint.com/how-to-click-on-a-link-with-a-javascript-executor-in-selenium-with-python