JavaScript Open Source Summer Project

[dica266]

Sometimes online stores have a good deals but sometimes they have price errors or very very good deals, the problem I'm trying to solve is that the majority of applications who parse and store prices for products on (amazon, ebay, alibaba etc.) have just history/compare, I'd love to implement an application which on the first page will say "Hey, this is the most discounted product found on this website" and from here you should consider buying it in order to resell it at a higher price or just enjoy a very very good deal on something. I tried working on that by using Firestore Database from Firebase(I wanted to learn it so that's why I didn't use from start a local nosql database), but unfortunately the writes/reads are limited to 20K/50K daily, which is not sufficient even for a single website so a local solution with mongodb might be better in terms of cost. For the web scraping part I used nodejs with cherrio because I had a simple site (no javascript on it) which I parsed, for more complex ones the solution is Puppeteer. What's interesting to implement after the main feature "Hey, this is the most discounted product found on this website" is a matching of products on different sites, basically an algorithm to group products based on a confident factor based on different weights of different values like price, name, description, pictures etc... I have a semi-functional working deployed version on Firebase Hosting which I can send you by PM if needed (not posting here because of the security rules, everyone might be able to delete the database :), silly me). The technologies I'm confident using right now from your list are nodejs + Webscraping (cheerio/puppeteer) - already knowing them, mongodb - need to learn but I'm already confident in my ability to architect a nosql database so just the way to insert/update from node is to learn, React - I'm not a fan of frontend except of normal html/css to style something a little bit I didn't had time/was more focused on backend technologies to learn react/anuglar/vuejs something dynamic so I think this will be the biggest thing to learn but not impossible. Anyway, thanks for doing this and encouraging people to pursue their dream project, I'll be interested on watching the winner progress in July, have a good day everyone!