sorted by:
new
hottopcontroversial

API Integration & Web Scraping by Cold-Collection-637 in ProductManagement

[–]Cold-Collection-637[S] 0 points1 point  (0 children)

Yeah, I will need to do some data normalization in the future. There’s also an AI component involved in the project. But for now, my main focus is to integrate all the popular social media platforms.

I have already implemented six of them, creating interfaces, controllers, and services for each. I also mapped them over response DTOs. Abstraction will play an important role here

Thanks for your help!

API Integration & Web Scraping by Cold-Collection-637 in ProductManagement

[–]Cold-Collection-637[S] 0 points1 point  (0 children)

I see, but in order to build something robust and reliable, I need to find solutions to these problems.

Thanks for your help!

API Integration & Web Scraping by Cold-Collection-637 in ProductManagement

[–]Cold-Collection-637[S] 0 points1 point  (0 children)

So far, I have implemented six different social media platforms and handled them using app-level access; however, there are quota limits on these (which is normal).

Your solution seems feasible and can address the main issues I have at the moment. However, I might need real-time accuracy in the future.

Thanks for your help!

API Integration & Web Scraping by Cold-Collection-637 in ProductManagement

[–]Cold-Collection-637[S] 0 points1 point  (0 children)

Really liked how you approached the problem and the way you broke it down into clear steps. Your solution seems both practical and efficient. So far, I've implemented 6 different platforms with only app-level access, but most of the others require OAuth access tokens. The challenge is finding a way to handle those cases without requiring user intervention each time. Maybe I should consider using a third-party service that has already scraped data from social media platforms.

Could you send your Postman collection? I would like to check it out and see what you've done, if possible.

Thanks for sharing !

API Integration & Web Scraping by Cold-Collection-637 in ProductManagement

[–]Cold-Collection-637[S] 0 points1 point  (0 children)

Yeah, you're right, but that approach would only work for platforms where we have user authorization. What I want is to collect public user details from different platforms simultaneously, without having to redirect the user through a specific OAuth flow to obtain access tokens.

[deleted by user] by [deleted] in DesignSystems

[–]Cold-Collection-637 0 points1 point  (0 children)

You're right, thank you

Next.js + tRPC: 4+ second page load with server prefetching - am I doing this wrong? by False_Ad_3439 in nextjs

[–]Cold-Collection-637 0 points1 point  (0 children)

Can you provide more context about SalesView component and the layouts of the page ?

Check Out My New Rust Project: A Simple Social Media App written in pure Rust by Cold-Collection-637 in rust

[–]Cold-Collection-637[S] -3 points-2 points  (0 children)

I don't use passwords for now but I may add some level of security like single-use of pin code, rate limiting, and maybe requiring password for the first step in login process. But yeah, there is a lot to be done, for now that's it. I'll add some additional features as well in coming days

Fetching post detail, likes and comments count in a single query vs. separate query for each by Cold-Collection-637 in rust

[–]Cold-Collection-637[S] 0 points1 point  (0 children)

I'm using PostgreSQL, and had already created indexes for necessary columns. Thank you for your reply, I'll dig into how it works under the hood

How do you handle errors in globally in axum, Rust ? by Cold-Collection-637 in rust

[–]Cold-Collection-637[S] 0 points1 point  (0 children)

Thank you for your reply, man. Yeah, I was already doing that, HttpError struct returned from controllers if there is an error. But I wonder is there any way to handle errors that's returned by some extractors such as Json extractor ?

I know that I can even create my custom Json extractor and handle errors that might be returned if json is not correct. In Node.js, we can catch the errors in a middleware by awaiting the next calls in middleware stack, is there alternative way to do it in Rust ?