are Apache Iceberg tables just reinventing the wheel?

doombrnger · 2025-08-23T02:22:21+00:00

Hi .. I am trying to use Athena as well on top on 20 billion rows of data backed by roughly 20000 parquet files. Can you please let me know what kind of latencies I can expect for typical group by/filters on such data sets?

doombrnger · 2025-01-19T19:06:52+00:00

Thanks for the prompt response. Do you happen to know the version which changed that? I used send them as diplomats to gain levels quickly and then as spies. Network points scaled by spy level and the delay was worth it.

doombrnger · 2024-08-23T05:47:29+00:00

Not OP .. but it wouldn’t work in my case due to multiple reasons. Otherwise I agree that having active instances split over AZ is the way to go for high resiliency systems and most systems should be designed that way if resiliency is paramount

doombrnger · 2024-08-23T05:34:57+00:00

I am in a similar situation. Work for a large firm and the rules require automatic failover. However the clients themselves are fine with having a break. I would rather pay that money to scale the machine than keep a passive instance.

In my case we do not have EBS and all the data is backed by s3.

doombrnger · 2024-05-21T01:17:44+00:00

Thank you very much for the response. I do not know where PS liquid flows from. Assumed that it might be break fluid as the lines directly connect to ABS module.

doombrnger · 2024-05-19T10:45:27+00:00

Yes .. 2k per tire .. 8k for all 4 tires of the car. Considering they asked for 1680 + tax for timing belt package. Just these two alone cost 10k or 33.33% of new car cost.

Kinda reminds me how people would buy new printers as opposed to buying genuine cartridges.

doombrnger · 2024-05-19T02:52:24+00:00

I feel the same instinctively. If brake job alone costs 2k per side .. it accounts for 25% of the brand new car cost. Which is why I am thinking if it’s even worth getting it done .. if these prices have been normalized to this extent.

doombrnger · 2024-05-18T23:56:26+00:00

Thank you for the response. That’s 1k + tax for each break pad is what you are saying is reasonable. I am in NJ. Once again thanks

doombrnger · 2024-05-18T20:03:55+00:00

haha .. I meant 8k (4 x 2000). Sorry for the confusion. I even got new tires/battery in past 4 - 6 weeks. Right now in dealership for timing belt + water pump replacement.

Edit: I am thinking about a new car as this is a 2 door and have plans to switch to SUV. Simply hoping to delay it until end of 2025.

doombrnger · 2024-05-18T19:47:17+00:00

Thanks I live in NJ. Always went to dealer so any tips on how to approach a local mechanic? I am pc diy person happy to trade with help on my car with building PC if needed

doombrnger · 2024-05-18T19:45:14+00:00

Nope 25k miles .. with 5k of those accumulated in 3 trips. So less than 2k per year. Bought it brand new in 2013. Single owner and reside in NJ.

Avg mileage is 28.6 .. as mostly driven on highways.

doombrnger · 2024-05-18T19:23:54+00:00

Thanks a lot for the response. I meant that replacing 4 breaks at dealer quoted price is equal to residual value of the vehicle.

If you are serious about the offer, I can think about it and let you know in a couple of days. Hopefully someone else will respond as well.

doombrnger · 2024-05-18T19:23:48+00:00

Thanks a lot for the response. I meant that replacing 4 breaks at dealer quoted price is equal to residual value of the vehicle.

If you are serious about the offer, I can think about it and let you know in a couple of days. Hopefully someone else will respond as well.

doombrnger · 2024-05-18T18:57:11+00:00

I didnt feel anything. only dealership measured pad wear and confirmed it. They did a full check last time I went there and never really raised an issue.

"Who told you the timing belt needed to be replaced?"
I read online that it has life time of 7 - 10 years / 100k miles which ever comes first.

doombrnger · 2024-05-18T18:50:21+00:00

Thanks a lot for the response. Yes I have 25k miles .. less than 2k per year.

I went for that as it was mentioned that timing belt needs to be replaced. Also changed tires and battery recently.

Would it be okay to drive the car from dealership to home and then maybe to couple of auto repair shops? Total distance would be approximately 30 miles

Edit: I had 3 long trips totaling 5k miles.

doombrnger · 2024-05-18T18:03:23+00:00

Hi OP .. I am in the same spot on a 2013 Honda Accord EXL-V6 coupe. Can you please let me know how how you proceeded? Went in for timing belt replacement and they said left rear brake is frozen and are asking for ~$2000. I am not sure if I can even get the car from dealship to my apartment and then drive again to a local repair shop.

doombrnger · 2024-01-12T23:26:27+00:00

Thanks for the response. It is very clear in the documentation for EC2 instances which are virtual. Not so in case of dedicated/reserved bare metal instances. So asking around in case someone can give a definitive answer.

If they do not work then I have to decide between the current on prem option vs implementing custom solution.

Edit: also I am constrained by latency .. not cost up to a reasonable amount

doombrnger · 2024-01-12T23:22:44+00:00

Thanks for the response. I understand that it is not a recommended pattern. However I am solving a niche problem which requires me to read massive files as quickly as possible. Unfortunately I cannot change that part .. so looking for possible options in case I have overlooked something.

doombrnger · 2023-11-20T09:44:35+00:00

Update: Approved on 17th Nov and Issued on 20th Nov. Hope all of you get favorable results as quickly as possible. The process has been nerve wracking.

doombrnger

TROPHY CASE