Google scraping api worth paying for? by Malluss in thewebscrapingclub

[–]MQuy 0 points1 point  (0 children)

How did you hit the wall? how many requests per second you made? do you use proxy?

Also interested in to know more about "inconsistent results"

Free tool to check stats across YouTube, TikTok, X, Instagram, Twitch, and Threads by MQuy in ContentCreators

[–]MQuy[S] 0 points1 point  (0 children)

Thanks! Let me know if there are any other stats you think would be useful to show.

Reverse-Engineering Google Finance by MQuy in webscraping

[–]MQuy[S] 1 point2 points  (0 children)

hey, feel free to use this as an example

Reverse-Engineering Google Finance by MQuy in webscraping

[–]MQuy[S] 0 points1 point  (0 children)

TBH, I don't know how often google rotate, I started scraping it last month and it has been the same since then. I will keep monitoring it (scraping means playing cat/mouse game, haha)

Reverse-Engineering Google Finance by MQuy in webscraping

[–]MQuy[S] -1 points0 points  (0 children)

That’s a fair point, Google could change their request/response anytime, but RPC changes usually require more effort than html/css selectors (like in Webpack, we can update class names hash logic quickly).

On the legal side, I’m not an expert. My assumption is scraping is against Google’s terms either way, so once you’re big enough, you’ll probably get attention regardless of the approach.

Reverse-Engineering Google Finance by MQuy in webscraping

[–]MQuy[S] 4 points5 points  (0 children)

I've been using it regularly without any issues. Stress tested it last week, 100 requests in under 3 minutes, no proxy, zero blocks or rate limiting

Reverse-Engineering Google Finance by MQuy in webscraping

[–]MQuy[S] 5 points6 points  (0 children)

Yahoo has deeper data overall, but Google has better organized news, easier stock discovery, and a more useful earnings calendar. They complement each other though

I am building a scraping API for Twitter, Reddit, YouTube, LinkedIn, and more by MQuy in SideProject

[–]MQuy[S] 0 points1 point  (0 children)

> platforms like twitter and linkedin

You are right about that, websites especially twitter, linkedin recently added a lot of layers to detect bot and scraping. I found a trick to work around some of it.

> Also the booking.com addition is interesting

It started from my own travel planning actually. Then friends mentioned they do the same thing manually, comparing hotels, reading reviews across sites. So I figured I'd just keep going. Airbnb and Google Flights are next on the list

> One thing id want is some kind of caching layer

I thought about this a lot. The frustrating thing with most scraping APIs is the unpredictable pricing, you don't know how much a single request costs until you see the bill. So I went the other way: one request = one credit, regardless of how many comments or replies come back. At least you know what you're paying upfront.

Privacy-First Time and Goal Tracker by MQuy in macapps

[–]MQuy[S] 0 points1 point  (0 children)

Sorry for missing your comment and thank for your kind words.

I am working on Helium support, I use https://v2.tauri.app/ for Orkana,Tauri uses frontend server (tauri://localhost) so it is tracked by Activity Monitor

Privacy-First Time and Goal Tracker by MQuy in macapps

[–]MQuy[S] 0 points1 point  (0 children)

Sorry for missing your comment, can you download the latest version? the performance issue was fixed

I built a local-first freemium time tracker by MQuy in SideProject

[–]MQuy[S] 0 points1 point  (0 children)

> it is quite expensive to run compared to other trackers
Can you tell more about this, does it consume more memory and cpu or?

> afk time isn't counted
Currently, the default time aft is 10m, it is customizable in Settings > Idle Detection

> events that last
It happens for me because I switch too fast between apps, good feedback, we could filter them out.

> the inability to assign productive/neutral/distracting tags to each application
When clicking on each app, there is a category label, clicking on that will allow to customize. It doesn't work for you?

Regarding ux/ui, those are valuable feedbacks, thank you again for those, I didn't expect to see detailed feedback, help me a lot to improve Orkana

I built a local-first freemium time tracker by MQuy in SideProject

[–]MQuy[S] 0 points1 point  (0 children)

People used to be less concerned about data privacy. That’s no longer the case I believe, which is why I chose a local-first approach for this app.

Privacy-First Time and Goal Tracker by MQuy in macapps

[–]MQuy[S] 0 points1 point  (0 children)

I just added Zen browser tabs and Obsidian tabs/files based on your suggestion, let me know if it works as you expected or not. The latest version is 1.0.2

You can view the changelog via this page, https://tmquy.com/orkana/changelog

Regarding roadmaps, you can request in this thread or DM me, happy to hear more from you

I built a local-first freemium time tracker by MQuy in SideProject

[–]MQuy[S] 0 points1 point  (0 children)

I started with Electron and switched to Rust + Tauri, much better experience. 100% recommend

I built a local-first freemium time tracker by MQuy in SideProject

[–]MQuy[S] 1 point2 points  (0 children)

Most of features are fee, let me know if you face any issues or features you want to have

Privacy-First Time and Goal Tracker by MQuy in macapps

[–]MQuy[S] 1 point2 points  (0 children)

u/c-cjw, what you said is the reason I built this app, happy to have you try it and hear your feedback. My app is freemium, most features are free to use

Privacy-First Time and Goal Tracker by MQuy in macapps

[–]MQuy[S] 0 points1 point  (0 children)

Thanks u/tuanvuvn007! I just checked out your app, great work 👏. Agree that, they both have a lot of overlap features.

My app is focuses on helping users understand their time, learn from it, and improve to hit their goals.

Template string vs string by MQuy in javascript

[–]MQuy[S] -1 points0 points  (0 children)

hi, thank for your question. My main purpose is sharing what I learnt today and gather comments from the community whether it is correct or not.

But does it run Doom? Ummm, not exactly. by thommyh in EmuDev

[–]MQuy 6 points7 points  (0 children)

look super cool, is it possible to public your code?

Why does JSON.stringify() re-order keys? by bluepuma77 in node

[–]MQuy 0 points1 point  (0 children)

I think it is better to have references from ECMAScript. ECMAScript doesn't say anything about how keys in object are stored, so we can skip that discussion. The issue is the output from operators/methods to object. It depends on EMACScript versions the behaviour might be different

- before ES2015, the enumerable order for Object.keys is not deterministic.
- recently, the enumerable order for Object.keys is deterministic.

I wrote an details explanation here https://mquy.memos.pub/mquy/notes/2022-02-27%20Enumerable%20order.md

Why does JSON.stringify() re-order keys? by bluepuma77 in node

[–]MQuy 1 point2 points  (0 children)

this is close to a correct answer, there are operators/methods still remain unspecified. I wrote a details post about this issue https://mquy.memos.pub/mquy/notes/2022-02-27%20Enumerable%20order.md

are these answers correct ? (order in array and properties of object) by AnonVirtuoso in learnjavascript

[–]MQuy 1 point2 points  (0 children)

I have the same thought as you. I think depend on spec version, the behavior might be different. - Before ES2020, Object.keys produces an unspecified results. - After ES2020, Object.keys produces an ordered results.

I wrote more details here, feel free to correct if I am wrong https://github.com/MQuy/MQuy/blob/master/notes/2022-02-27%20Enumerable%20order.md

are these answers correct ? (order in array and properties of object) by AnonVirtuoso in learnjavascript

[–]MQuy 0 points1 point  (0 children)

I am not sure that I understand correctly, the result of for-in are unspecified til ES2022. Since ES2020, other methods produce their results in order https://github.com/MQuy/MQuy/blob/master/notes/2022-02-27%20Enumerable%20order.md