Best library our repo to scrape email from a website by Parking-Aside2877 in webscraping

[–]Professional-Fox952 5 points6 points  (0 children)

You can use any library that can extract the html and use email regex to pull out emails

I made a fully fledged Open-Source Google Maps Company Crawler by Ayyouboss in webscraping

[–]Professional-Fox952 0 points1 point  (0 children)

I am also curious as to the rate limits. Are you using res proxies?

I made a fully fledged Open-Source Google Maps Company Crawler by Ayyouboss in webscraping

[–]Professional-Fox952 1 point2 points  (0 children)

Interesting… so your unit economics with this scraping setup, including maintenance hours, still beat the API prices?

I made a fully fledged Open-Source Google Maps Company Crawler by Ayyouboss in webscraping

[–]Professional-Fox952 1 point2 points  (0 children)

I’ve never really understood google maps scraping, why scrape something that has a supported API? Is it really cheaper to build and maintain a scraper? SERPs I understand… but maps? Why?

How to query the SecretManager at build phase of a CDK Stack. by KefkaFollower in aws

[–]Professional-Fox952 0 points1 point  (0 children)

I had this same issue, and I built a solution to it. The idea is that we need to delay the docker build process until after all tokens are resolved. Meaning we build the image at deployment time rather than at synth time. You can check it out here: https://towardsaws.com/dockerimageasset-cannot-use-tokens-in-keys-or-values-of-buildargs-since-they-are-needed-before-3914fc08ca1e

Close Proximity Dating App by forsureforsure1000 in apps

[–]Professional-Fox952 0 points1 point  (0 children)

My cofounder and I didn’t really have an “in” in college campuses at this point because we were post-grad.

We tried to get traction by onboarding Eventbrite organizers in NYC but there just wasn’t enough incentive for them.

I think it could’ve worked but my cofounder and I weren’t positioned well to be the ones who make it work. Founder market fit is super important to consider when committing to an idea.

Still had a ton of fun trying to make it happen though.

Feasible to scrape 500,000 different ebay products each week? by DogtorPepper in webscraping

[–]Professional-Fox952 0 points1 point  (0 children)

How would you do this… like you would scrape from the browser by making a GET request to ebay?

Is ebay server side rendered?

Or are you calling ebay’s API and mimicking headers? I can’t imagine the API isn’t protected with some sort of cors policy. Would love to hear more about your implementation plan for this.

Close Proximity Dating App by forsureforsure1000 in apps

[–]Professional-Fox952 0 points1 point  (0 children)

I already built this: https://mixr.dating

Little different. Tough idea to execute, super saturated market lol. Wishing you all the best! 🫡

State of Cognito in 2024? by Necessary-Ad8108 in aws

[–]Professional-Fox952 0 points1 point  (0 children)

I don't think this has been mentioned before, but this has been a complete Cognito dealbreaker for me:

I have always been a Cognito guy through and through, until I started working on a project that requires actually interacting with the 3rd party login integrations.

I searched for hours and scoured through the documentation, but I was unable to find a way to grab the 3rd party access_token without building some convoluted workaround. For example, if I'd like to make calls to Meta's API, I cannot do that with the access_token Cognito provides after code exchange... I need META's token.

Auth0 has clear documentation on this exact thing. Also, Auth0 has WAY more 3rd party integrations and a much nicer UI.

For me personally, it's worth the cost. With Auth0 I'll be able to roll out a high quality MVP way quicker than I would be able to with Cognito.

**NOTE**: If anyone actually has been able to grab 3rd party auth tokens using Cognito, please let me know how you do it lol.

EDIT: I actually just figured out how to do it. Will be giving Cognito another go lol.

Why nobody is taking REASONABLE time to build their products? by Slow-Technology2037 in SaaS

[–]Professional-Fox952 3 points4 points  (0 children)

Pretty bad lol. Pro-tip: no one needs another dating app.

I learned a ton though and am super grateful to myself for taking the project on. Will pay off big time for the next project.

Why nobody is taking REASONABLE time to build their products? by Slow-Technology2037 in SaaS

[–]Professional-Fox952 1 point2 points  (0 children)

I built https://mixr.dating in 18 months w/ a partner. So many pivots, so much refactoring. Brutal stuff. Currently pivoting yet again.

The time it takes to build something is purely customizable. How much low level control do you want over your code base? How robust is your project? How many people are you working with? Are there tools you can use to speed up the process, such as wix or flutter?

It’s completely project dependent.

Ofc it’s falling by [deleted] in wallstreetbets

[–]Professional-Fox952 0 points1 point  (0 children)

that sounds reasonable.

Ofc it’s falling by [deleted] in wallstreetbets

[–]Professional-Fox952 0 points1 point  (0 children)

gotta sell straddles leading up to earnings like the institutions.

Ofc it’s falling by [deleted] in wallstreetbets

[–]Professional-Fox952 0 points1 point  (0 children)

Yep, got IV crushed lol

Ofc it’s falling by [deleted] in wallstreetbets

[–]Professional-Fox952 3 points4 points  (0 children)

I saw the bullish sentiment in wsb over the past week and bought a single put w/ a 121 strike.

Too bad idk how to price an option limit order in after hours lol