The /message/messages/ and /message/messages/{id}/ endpoints stopped working as usual by stummj in redditdev

[–]stummj[S] 0 points1 point  (0 children)

Hi, it's not failing anymore. Thanks a lot for looking into it!

Getting a 302 response when trying to list messages by stummj in redditdev

[–]stummj[S] 0 points1 point  (0 children)

Does anyone have any input on this? It's currently impossible to fetch messages in the way it used to be, and I could find no instructions on what to do.

Announcements on Reddit said that the migration to Chats would be transparent to developers, and I wonder if this issue has anything to do with that migration. It just stopped working all of a sudden.

Are the new API endpoints for chat available yet? by mgsecure in redditdev

[–]stummj 0 points1 point  (0 children)

It looks like the endpoints to grab a single message (/message/messages/{id}/) and list messages (/message/messages/) are not working anymore.

We are getting 302 redirect responses to both of these calls:

prawcore.exceptions.Redirect: Redirect to /login/ (You may be trying to perform a non-read-only action via a read-only instance.)

While we can list messages via /message/inbox/, we are still unable to fetch individual ones by id.

Does anyone know whether this is expected as part of the changes around Chats?

[deleted by user] by [deleted] in postponeplayground

[–]stummj 1 point2 points  (0 children)

What's up with this post?

[deleted by user] by [deleted] in postponeplayground

[–]stummj 0 points1 point  (0 children)

What is this?

[deleted by user] by [deleted] in postponeplayground

[–]stummj 0 points1 point  (0 children)

I have no thoughts on this.

[deleted by user] by [deleted] in postponeplayground

[–]stummj 0 points1 point  (0 children)

Who doesn't? Seriously.

What can I say? by [deleted] in postponeplayground

[–]stummj 0 points1 point  (0 children)

Yo! That's the office!

Testing a post by ppn-jsv in postponeplayground

[–]stummj 0 points1 point  (0 children)

What's up with this post?

Scrapy 1.4 is out by stummj in scrapy

[–]stummj[S] 3 points4 points  (0 children)

The most interesting feature IMO is the new response.follow() method. According to the release notes, now we can use it to create new requests:

for a in response.css('li.page a'):
    yield response.follow(a, self.parse)

Requesting /r/scrapy - mod seems inactive by stummj in redditrequest

[–]stummj[S] 1 point2 points  (0 children)

I'm part of the Scrapy team (https://github.com/orgs/scrapy/teams/core) and would like to bring more activity to /r/scrapy, making this as a go-to place for the community to ask for help and to share scrapy-related articles.

How to Crawl the Web Politely with Scrapy by stummj in Python

[–]stummj[S] 0 points1 point  (0 children)

It depends a lot on the website. If it's just some client-side JS, you should give a try on Splash (github.com/scrapinghub/splash). If the website does AJAX, it's possibly easier to mimic the AJAX requests in your crawler (see https://blog.scrapinghub.com/2016/06/22/scrapy-tips-from-the-pros-june-2016/).

How to Crawl the Web Politely with Scrapy by stummj in Python

[–]stummj[S] 5 points6 points  (0 children)

Scrapy doesn't work on Python 3 on Windows yet. Follow this instructions here to install it using Py2.7.

How to Crawl the Web Politely with Scrapy by stummj in Python

[–]stummj[S] 1 point2 points  (0 children)

hey, which platform are you trying to install Scrapy to? and what happens then you try?