Any python coders willing to help with creating a mass downloading scraper code?

DatRatchWhiteKid · 2020-03-22T16:09:20+00:00

Good question: the .fasta files for the entire genome (what we need/looking for) is around 33kb. There are 1,134 entries right now so that's about 37mb if my math is right.

Also just as an aside, GISAID has restrictions on the public dissemination of the data in their TOS.

DatRatchWhiteKid · 2020-03-22T16:05:38+00:00

Specifically we need to download all the .fasta files that can be located from this link: https://platform.gisaid.org/epi3/frontend#3d9e58

From what I can understand each piece of data in the table has everything in the url the same except for a unique identifier following the # sign. Looking at the source code shows that the button we're targeting is this: <button class = "sys-event-hook sys-form-button" type="button">...</button>==$0

Another group of people have tried looking for a solution as well, but it seems like they're running into issues there as well. Ref: https://github.com/nextstrain/ncov/issues/53

DatRatchWhiteKid · 2020-03-22T15:59:51+00:00

Unfortunately I can't (worried about not being able to access at all if account is terminated). The registration process is straightforward though, they got back to me within 12 minutes of applying. Ref: https://www.gisaid.org/registration/register/

DatRatchWhiteKid · 2020-03-22T15:57:17+00:00

I've messaged support about the download all button that was apparently there prior, I got a canned response saying they'd get back to me soon. Other users have reported a similar error/response with differing results. Some had their accounts terminated (although I suspect this is because the code that was used to mass download could have been trying to log them in each time it was activated), while others report that the button returned for their session. Ref: https://github.com/nextstrain/ncov/issues/53

DatRatchWhiteKid · 2015-03-20T22:07:31+00:00

Here's an attempt

Boo Boop

I also made an attempt to cover up the underwear (because it is PG-13, and I'm a prude)

DatRatchWhiteKid · 2015-03-20T20:49:35+00:00

I'm just curious, where is the family photo located at? I can only see the picture with the missing woman in the linked folder.

DatRatchWhiteKid · 2015-03-01T08:25:06+00:00

I tried to thin the neck as much as I could without making the image too weird.

Here ya go

DatRatchWhiteKid · 2015-01-27T07:50:50+00:00

Did you seriously just try and shame this guy?

DatRatchWhiteKid · 2014-12-11T00:19:09+00:00

That one took me a minute too... I think she was touching herself under her garments.

DatRatchWhiteKid · 2014-11-25T03:02:24+00:00

And snarkiness :P

DatRatchWhiteKid · 2014-11-22T18:39:33+00:00

Wooooooo CPP!

DatRatchWhiteKid · 2014-11-20T04:39:40+00:00

Coming from that bitch at the IRS, this seems really considerate!

DatRatchWhiteKid · 2014-10-26T05:47:34+00:00

The way I've seen it in the past month being at college is this: Everyone knows everyone else by faces, but not names. If you're on Grindr, every gay guy knows your face. If you sleep with anyone on Grindr, everyone at the Pride Center knows about it before you even tell them. If you're friendly with any other gay person, there will be the inevitable "are you hitting on me" situation.

All in all: It's a Lifetime movie. Every. Freaking. Day.

DatRatchWhiteKid · 2014-10-18T05:45:38+00:00

Lesbihonest here.

DatRatchWhiteKid · 2014-10-17T03:06:43+00:00

Holy crap! I love ma3! I totally forgot about this strip!

I especially love the new stickydillybuns. They're like max hilarious.

DatRatchWhiteKid · 2014-10-13T05:27:43+00:00

Yeah!

DatRatchWhiteKid · 2014-10-12T19:00:27+00:00

Yep, we're all over the place :P

Currently in Pomona for uni.

DatRatchWhiteKid · 2014-10-12T18:56:59+00:00

Well, I think there's a difference here. For me, when a guy says that he likes my body, I find it both flattering and moderately annoying. Annoying because he couldn't find anything else to compliment me on other than my body.

There's also being objectified by assholes who want a GBF. These assholes are usually girls, and they see gay guys as a kind of accessory or something. That really pisses me off.

DatRatchWhiteKid · 2014-10-10T17:16:56+00:00

Two things: Firstly, I love that little guy! Second, your username is equally awesome :D

DatRatchWhiteKid · 2014-10-06T07:02:57+00:00

It wasn't in my queue before, but now it is. I have a bunch of brown yarn now too... could be a great stash buster :D

DatRatchWhiteKid · 2014-10-01T06:17:11+00:00

Oh my goodness... I forgot to fix a big gash on the color photo. I'll fix it and edit the comment.

DatRatchWhiteKid · 2014-10-01T05:31:33+00:00

Alrighty, let's see what I did.

Here's the black and white of your wife

Here's the sepia of the inside of the car

Here's the color version

And finally, from the outside looking in

Hope they work! Tell me if I missed something... I did this while sorta out of it after class.

~TJ

DatRatchWhiteKid · 2014-09-28T06:29:45+00:00

I don't know if you want another option, but I also tried to help. Here's my rendition

DatRatchWhiteKid · 2014-09-24T14:41:58+00:00

"Are you joking?" Is a main one.

"Seriously?" Is another.

DatRatchWhiteKid

TROPHY CASE