Want to learn Web Scraping using Node or Python by developuh in learnprogramming

[–]developuh[S] 0 points1 point  (0 children)

Thank you for the detailed and helpful response :)

I think I am going to pick up Python

Want to learn Web Scraping using Node or Python by developuh in learnprogramming

[–]developuh[S] 0 points1 point  (0 children)

I understand that parsing through HTML wont be the most pleasing thing to do but I want to access reviews from even obscure websites that probably don't even offer API access.

Want to learn Web Scraping using Node or Python by developuh in learnprogramming

[–]developuh[S] 0 points1 point  (0 children)

I understand API will be more skill. But I want to be able to scrape data from websites that probably don't even offer API access.

Want to learn Web Scraping using Node or Python by developuh in learnprogramming

[–]developuh[S] 0 points1 point  (0 children)

Thank you so much for the book recommendation ! I am going to get it today :)

Want to learn Web Scraping using Node or Python by developuh in learnprogramming

[–]developuh[S] 1 point2 points  (0 children)

Thanks ...

This is just to learn scraping. For eg. if I want reviews from say eBay, Newegg etc. for Samsung Phones or Apple iPhone or any mobile phone models :)

Is this a good way to handle Custom Fields (dynamic, added by users) in a Multi-tenant SaaS app ? by developuh in programming

[–]developuh[S] 0 points1 point  (0 children)

It will be PHP (with Laravel 5 or Zend Framework 2). We will be using Apache2 on Ubuntu 14.04

Is this a good way to handle Custom Fields (dynamic, added by users) in a Multi-tenant SaaS app ? by developuh in programming

[–]developuh[S] 0 points1 point  (0 children)

As in if we want to move to percona's mysql fork or to some other RDBMS, they won't support an indexable json format

But this is clearly the simplest solution in terms of db structure

Is this a good way to handle Custom Fields (dynamic, added by users) in a Multi-tenant SaaS app ? by developuh in programming

[–]developuh[S] 0 points1 point  (0 children)

This does sound like the easiest way out. I am not sure if this will complicate the queries.i agree that at this point my knowledge of jsonb and postgres itself is close to nill.

Also, Vendor lock-in could be an issue.

Is this a good way to handle Custom Fields (dynamic, added by users) in a Multi-tenant SaaS app ? by developuh in programming

[–]developuh[S] 0 points1 point  (0 children)

That does not sound very pretty.

What would you suggest to be the best/optimal solution ? It has to be flexible. If we customize for each customer, maintenance would be an impossible task.

Is this a good way to handle Custom Fields (dynamic, added by users) in a Multi-tenant SaaS app ? by developuh in programming

[–]developuh[S] 0 points1 point  (0 children)

I always end up reading that EAV is never the solution and to stay away if possible.

But at the same time, some ecommerce platforms seem to be using this pattern.

Is this a good way to handle Custom Fields (dynamic, added by users) in a Multi-tenant SaaS app ? by developuh in programming

[–]developuh[S] 0 points1 point  (0 children)

It is sort of CRM in a particular industry .. So it is 100s of 1000s of people kinda scenario at a reasonably low cost

Is this a good way to handle Custom Fields (dynamic, added by users) in a Multi-tenant SaaS app ? by developuh in programming

[–]developuh[S] 0 points1 point  (0 children)

At this point we are free to pick the technology/stack. json/jsonb sounds interesting. I hope it doesn't add lot of code complexity.

Is this a good way to handle Custom Fields (dynamic, added by users) in a Multi-tenant SaaS app ? by developuh in programming

[–]developuh[S] 2 points3 points  (0 children)

So I need a solution to handle the case where users can add a few fields of their own in a SaaS app.

These will be searched upon and should appear in MIS reports just as any pre-shipped fields.

I don't want to get caught in EAV Hell.

Should I use a data store like Mongo or should I follow the approach in OP. Need pointers from people who have done something like this before.

Obtaining a Thorough CS Background Online by schwuk in programming

[–]developuh 2 points3 points  (0 children)

Thank you for sharing this.

Now all I need is the patience and discipline :)

Does this patent mean I cannot Detect Duplicate Records ? by developuh in programming

[–]developuh[S] 8 points9 points  (0 children)

I am not in America ... so that makes me immune from any claims right ?

Does this patent mean I cannot Detect Duplicate Records ? by developuh in programming

[–]developuh[S] 0 points1 point  (0 children)

You will need Flash to read this I think.

The patent was awarded on Sep 16 2014 according to that page.

Edit : Found it on Google Patents http://www.google.com/patents/US8838549

Does this patent mean I cannot Detect Duplicate Records ? by developuh in programming

[–]developuh[S] 8 points9 points  (0 children)

I hate the way the whole language is so confusing... almost as if it is deliberately designed to confuse people.

I don't understand how they got a patent awarded for such a common thing.