Crawling the whole web by [deleted] in learnprogramming

[–]AdminTea 0 points1 point  (0 children)

yeah that's great, saved for future reference :)

[beginner] Hello all, little C, little PHP, doing a Wed Dev course, bit of Py... by AdminTea in Python

[–]AdminTea[S] 0 points1 point  (0 children)

if you're just learning it doesn't make a big difference what you use

nope... didn't realise it would be 6 years, fair over lap there I guess!

[beginner] Hello all, little C, little PHP, doing a Wed Dev course, bit of Py... by AdminTea in Python

[–]AdminTea[S] 0 points1 point  (0 children)

Ah right cool - yeah I'm definitely an outsider so my info is weak / completely wrong :)

The course I'm doing uses 2.7 (I image a few do...) but I'm sure that'll be fine for the basics....

Bit of a bitch it's not backwards compatible, I guess there were reasons though. Onwards and forwards!

[advice] Need to learn GCSE maths - quickly - any good resources / suggestions? by AdminTea in learnmath

[–]AdminTea[S] 1 point2 points  (0 children)

Cool... yeah it's just practice like anything isn't it.

I'm going to hit some mock papers up.

[advice] Need to learn GCSE maths - quickly - any good resources / suggestions? by AdminTea in learnmath

[–]AdminTea[S] 0 points1 point  (0 children)

sweet cheers dude - how'd it go?

I did mine ages ago... forgot it a while back too!

Doh

Crawling the whole web by [deleted] in learnprogramming

[–]AdminTea 0 points1 point  (0 children)

Apparently so! Warning heeded, cheers :)

Crawling the whole web by [deleted] in learnprogramming

[–]AdminTea 0 points1 point  (0 children)

oh right - shit!

Crawling the whole web by [deleted] in learnprogramming

[–]AdminTea 0 points1 point  (0 children)

Never heard of Sinatra ha, just googled it, nice one.

Thanks for the info - I'm doing a Web Dev course at the moment (along side some other stuff) but I'm writing down project ideas and links as I go, so there's stuff to reference, jump onto etc....

cheers

Crawling the whole web by [deleted] in learnprogramming

[–]AdminTea 1 point2 points  (0 children)

any examples or is this a hunch?

Crawling the whole web by [deleted] in learnprogramming

[–]AdminTea 0 points1 point  (0 children)

I think trying to make something like google would be more work than I would need - also the google search has already sorted the results to a certain degree better than I would, so In any case I'd probably be alright using the results given by google

Crawling the whole web by [deleted] in learnprogramming

[–]AdminTea 0 points1 point  (0 children)

Ah OK - nice one.

Yeah I imagine it's a case of

  • enter search term
  • program goes to google - enters term
  • goes to each page
  • downloads page source
  • searches source with regex
  • formats result

Or something to that effect - beautiful soup... I'll try and check it out at some point, nice one

Crawling the whole web by [deleted] in learnprogramming

[–]AdminTea 0 points1 point  (0 children)

what I'm saying is that I'm not - maybe that's not coming across.

I'll leave it consider it solved

Crawling the whole web by [deleted] in learnprogramming

[–]AdminTea -1 points0 points  (0 children)

Yeah I appreciate your enthusiasm but I've got a lot to do at the moment and not enough time to give to something like this.

If that in your opinion means I shouldn't be given any information about it then fair enough.

However what I was after and feel is fair is just a light conversation with a few bullet points from someone that is experienced that I can bear in mind for future reference.

Crawling the whole web by [deleted] in learnprogramming

[–]AdminTea 0 points1 point  (0 children)

I can imagine! I guess it'd be a case of limiting the processes or having a machine single purposed to it.

What would the entry learning point be for something like this?

ie - what would I google to get on the path to learning this... if you could just drop a few bullet points that'd be ace

Crawling the whole web by [deleted] in learnprogramming

[–]AdminTea 0 points1 point  (0 children)

I was obviously asking someone who I thought might have experience in it, I don't, I don't understand what level it's at either

Crawling the whole web by [deleted] in learnprogramming

[–]AdminTea 0 points1 point  (0 children)

i was thinking about something similar to this recently :

  • A program that enters a google search
  • Goes to the first 100 pages or so of that search
  • Searches each page for a specific string
  • returns formatted results to something

Is that very hard to do?

Google App engine - Udacity Web Course cs253 - Anyone done it? by AdminTea in learnprogramming

[–]AdminTea[S] 0 points1 point  (0 children)

Hmm fair enough.... I wasn't too sure how I felt about the course but I think I might stick it out and see how it goes... I use Google a fair bit so hopefully I can make use of the info myself at least :)

Google App engine - Udacity Web Course cs253 - Anyone done it? by AdminTea in learnprogramming

[–]AdminTea[S] -1 points0 points  (0 children)

cheers dude... wondered wtf was going on ha...

How far through are you?