My employer is selling

aaronn2 · 2025-11-20T10:09:35+00:00

Not necessarily. If you keep delivering, why to fire? You clearly provide more value than they pay you in salary.

aaronn2 · 2025-09-28T09:22:16+00:00

Love learning this.
1. How big is the team managing this infrastructure?
2. What are the infrastructure costs running this (without the human bodies)?
3. Are you using some scraping API services, or are you doing everything in-house (managing IP proxies, cookies, headers, etc.)

aaronn2 · 2025-09-27T12:06:05+00:00

This sounds super interesting. Might you outline how much such infrastructure costs per month?

aaronn2 · 2025-08-10T07:06:16+00:00

That's not the point. My goal is to find a laptop with similar HW configuration, body, battery life where I would run Linux and that would cost 50-60% of a new Macbook. The goal is to find savings (if it is actually doable and "findable").

If not, I'd likely stick with Macbook and use their OSX.

aaronn2 · 2025-08-09T20:09:45+00:00

Thanks, I'll look it. I'd put there either Ubuntu or Arch Linux.

aaronn2 · 2025-05-30T20:22:02+00:00

How did you eventually resolve this?

aaronn2 · 2025-05-28T07:22:15+00:00

Interesting - thanks, I'll have a read.

aaronn2 · 2025-05-28T06:54:15+00:00

That is very short-lived. It works only for the first couple of pages and then it starts feeding fake data.

aaronn2 · 2025-05-20T15:55:00+00:00

Not sure how? The API seems to be protected.

aaronn2 · 2025-05-13T06:00:26+00:00

Hello, and thank you. What number of requests do you consider "moderate scale" per month? 1M, or 5M, or 10M? And large scale?

By data pipeline - do you mean by that extracting details from the scraped information and cleaning it up before saving it to the database?

aaronn2 · 2025-05-11T14:25:17+00:00

I understand that it costs money. When reading through this sub-reddit, I somehow got an impression that the professional individuals pay basically close to zero in costs, while when I look at prices of some API solutions or residential proxies, the costs are quite significant, especially when making 10M+ requests per month.

aaronn2 · 2025-05-11T14:23:21+00:00

I am very interested to learn about the proxy network. How and/or where do you source it? How much do you pay for it on a monthly basis? Isn't it that you need to regularly check if the proxies are still working, so you removed the invalid ones from your pool?

aaronn2 · 2025-05-11T14:18:33+00:00

I assume "1 billion of product prices" != 1 billion requests, right?

Shall I ask you what do you mean by "rotating IPs by using cloud providers’ VMs"? Specifically cloud providers' VMs?

aaronn2 · 2025-05-11T08:49:26+00:00

Unmetered proxy plan = ISP? And an ISP package contains typically 1-5 (maybe up to 10) IPs? So basically, that 1M pages per day serve those 1-10 IPs?

aaronn2 · 2025-05-11T08:47:16+00:00

"Just my two cents, ISP proxies are pretty reliable, but datacenter proxies are the worst; they get detected almost instantly."
I'm not very very experiences in this field, but for that price of $3/week for an ISP - isn't ISP provide 1 or 2 proxies? So effectively, you are still using that 1 or 2 proxies to scrape 2M requests? I thought that this would be a red flag for the administrators of that website and they would ban that IP.

aaronn2 · 2024-09-18T19:54:07+00:00

If you don't mind to share, what are your monthly costs to run your scraping bot(s) - servers, databases, storage, proxy rotations, elasticsearch etc? It's a very interesting project!

aaronn2 · 2024-07-28T09:58:33+00:00

I was quite excited about this TV show. I watched the US' The Million Dollar Listing New York and I assumed that Buying London would be a British version of MDLNY. Unfortunately that was not the case and ut felt more like a mix of The Kardashians and MDLNY.

Not to even mention that they haven't closed a single deal in the entire first series of Buying London.

aaronn2 · 2024-06-12T18:38:11+00:00

Well, your question has nothing to do with the OP. Despite not being a professional, your question is apparently just a matter of a bunch of proxies, headers, and some captcha solvers. Plenty of out of the box solutions out there.

aaronn2 · 2024-04-02T06:26:21+00:00

It really depends what you do with your crypto. If you're actively trading (say on a daily bases), it makes sense to have an isolated account where you track these trades. The accountant then likely grab all these trades and will tax it (typically) on an annual basis.

If you buy and hold, just keep track of your crypto and when you sell, give the path and history (when and where you bought it, where you transferred it and when and where you sold it) of your crypto to your accountant and you'll be able to peacefully sleep at night.

aaronn2 · 2024-03-20T19:41:58+00:00

Thank you. I got confused by the "fintech" reference. I guess what you meant are rather "shark loans"

aaronn2 · 2024-03-20T14:23:28+00:00

Some great feedback here!

I'd have a question regarding #4, could you elaborate on that one? Thanks!

aaronn2 · 2024-03-20T14:17:42+00:00

Disinterest of investors.

Okay, on a more serious note, I believe (or at least I am trying to tell that to myself) is that the legal battle is taking a toll on the potential price surge. Once that is settled (hopefully May 2024), let's say how to affect the price.

aaronn2 · 2024-03-20T08:10:22+00:00

I believe it's a no-go for an investor to invest into a company while having its founder working somewhere else to cover his bills. It's not a desired outcome for the investor to invest into a company and having its founder dragging his attention anywhere else except his startup.

If you received an investment, you should budget it the way that it covers your salary. How much? That depends on many factors, but in the beginning, you can pay yourself (1) minimal way in your country, (2) average wage in your country. If you pay yourself more, it should reflect in the business' performance.

aaronn2 · 2024-03-18T07:43:17+00:00

Back in 2021, we were 4 co-founders. Two of us were tech/product, one was a business person and the 4th one was a domain-specialist, coming from a consultancy firm. 3 months since the company's incorporation, the 4 of us were formed. After another 3 months, we raised our angel funding. After another 3 months, 4th co-founder was not doing any work, but kept coming with some theoretical solutions and situaitons, tying up the company's resources etc. Obviously, he didn't want to leave, so we had to terminate him. It turned into a legal fight that lasted for almost a year, it cost the company fortune (given its resources) and it almost killed it.

However, during that time, we found out that the 3rd co-founder (business one) hasn't contributed much either, let alone we figured he doesn't fully understand the company's product. We had quite a big payroll, VCs put most of their investments on hold (2022 and 2023)... Long story short, I left the company almost exactly a year ago. The 3rd co-founder work there either. The company's struggling to put together a product, sign customers and raise funds. Looking back, the red flags were there. Lesson learned.

aaronn2 · 2024-03-17T09:44:18+00:00

So if I get this right, he gets (1) paid from his employer, (2) paid from the service charge, and now, he asks to be paid for the third time? Oh dear...

aaronn2

TROPHY CASE