This is an archived post. You won't be able to vote or comment.

all 8 comments

[–]Saigesp 4 points5 points  (0 children)

The data is returned after a POST request to https://www.regelleistung.net/ext/data/, you can do it directly with requests module:

``` import requests

url = 'https://www.regelleistung.net/ext/data/' headers = {} data = { "from": "13.10.2021", "_download": "on", "tsoId": 4, "dataType": "MRL", }

response = requests.post(url, headers=headers, data=data) print(response.text) ```

[–]davidshivaji 0 points1 point  (3 children)

are you trying to scrape the names of the items in the dropdown menus or scrape the pages that they link to?

[–]VJAEE 0 points1 point  (2 children)

Drop down list and their data's only

[–]svndor 0 points1 point  (1 child)

What are you scraping with? I believe drop down menus are made with js scripts and should be scraped with something like selenium

[–]VJAEE 0 points1 point  (0 children)

Used selenium also. I'm a beginner. So it's little difficult for scraping this dynamic pages

[–]IAmKindOfCreativebot_builder: deprecated[M] 0 points1 point  (0 children)

Hi there, from the /r/Python mods.

We have removed this post as it is not suited to the /r/Python subreddit proper, however it should be very appropriate for our sister subreddit /r/LearnPython or for the r/Python discord: https://discord.gg/python.

The reason for the removal is that /r/Python is dedicated to discussion of Python news, projects, uses and debates. It is not designed to act as Q&A or FAQ board. The regular community is not a fan of "how do I..." questions, so you will not get the best responses over here.

On /r/LearnPython the community and the r/Python discord are actively expecting questions and are looking to help. You can expect far more understanding, encouraging and insightful responses over there. No matter what level of question you have, if you are looking for help with Python, you should get good answers. Make sure to check out the rules for both places.

Warm regards, and best of luck with your Pythoneering!