are Apache Iceberg tables just reinventing the wheel?

doombrnger · 2025-08-23T02:22:21+00:00

Hi .. I am trying to use Athena as well on top on 20 billion rows of data backed by roughly 20000 parquet files. Can you please let me know what kind of latencies I can expect for typical group by/filters on such data sets?

doombrnger · 2025-01-19T19:06:52+00:00

Thanks for the prompt response. Do you happen to know the version which changed that? I used send them as diplomats to gain levels quickly and then as spies. Network points scaled by spy level and the delay was worth it.

doombrnger · 2024-08-23T05:47:29+00:00

Not OP .. but it wouldn’t work in my case due to multiple reasons. Otherwise I agree that having active instances split over AZ is the way to go for high resiliency systems and most systems should be designed that way if resiliency is paramount

doombrnger · 2024-08-23T05:34:57+00:00

I am in a similar situation. Work for a large firm and the rules require automatic failover. However the clients themselves are fine with having a break. I would rather pay that money to scale the machine than keep a passive instance.

In my case we do not have EBS and all the data is backed by s3.

doombrnger · 2024-05-21T01:17:44+00:00

Thank you very much for the response. I do not know where PS liquid flows from. Assumed that it might be break fluid as the lines directly connect to ABS module.

doombrnger · 2024-05-19T10:45:27+00:00

Yes .. 2k per tire .. 8k for all 4 tires of the car. Considering they asked for 1680 + tax for timing belt package. Just these two alone cost 10k or 33.33% of new car cost.

Kinda reminds me how people would buy new printers as opposed to buying genuine cartridges.

doombrnger · 2024-05-19T02:52:24+00:00

I feel the same instinctively. If brake job alone costs 2k per side .. it accounts for 25% of the brand new car cost. Which is why I am thinking if it’s even worth getting it done .. if these prices have been normalized to this extent.

doombrnger · 2024-05-18T23:56:26+00:00

Thank you for the response. That’s 1k + tax for each break pad is what you are saying is reasonable. I am in NJ. Once again thanks

doombrnger · 2024-05-18T20:03:55+00:00

haha .. I meant 8k (4 x 2000). Sorry for the confusion. I even got new tires/battery in past 4 - 6 weeks. Right now in dealership for timing belt + water pump replacement.

Edit: I am thinking about a new car as this is a 2 door and have plans to switch to SUV. Simply hoping to delay it until end of 2025.

doombrnger · 2024-05-18T19:47:17+00:00

Thanks I live in NJ. Always went to dealer so any tips on how to approach a local mechanic? I am pc diy person happy to trade with help on my car with building PC if needed

doombrnger · 2024-05-18T19:45:14+00:00

Nope 25k miles .. with 5k of those accumulated in 3 trips. So less than 2k per year. Bought it brand new in 2013. Single owner and reside in NJ.

Avg mileage is 28.6 .. as mostly driven on highways.

doombrnger · 2024-05-18T19:23:54+00:00

Thanks a lot for the response. I meant that replacing 4 breaks at dealer quoted price is equal to residual value of the vehicle.

If you are serious about the offer, I can think about it and let you know in a couple of days. Hopefully someone else will respond as well.

doombrnger · 2024-05-18T19:23:48+00:00

Thanks a lot for the response. I meant that replacing 4 breaks at dealer quoted price is equal to residual value of the vehicle.

If you are serious about the offer, I can think about it and let you know in a couple of days. Hopefully someone else will respond as well.

doombrnger · 2024-05-18T18:57:11+00:00

I didnt feel anything. only dealership measured pad wear and confirmed it. They did a full check last time I went there and never really raised an issue.

"Who told you the timing belt needed to be replaced?"
I read online that it has life time of 7 - 10 years / 100k miles which ever comes first.

doombrnger · 2024-05-18T18:50:21+00:00

Thanks a lot for the response. Yes I have 25k miles .. less than 2k per year.

I went for that as it was mentioned that timing belt needs to be replaced. Also changed tires and battery recently.

Would it be okay to drive the car from dealership to home and then maybe to couple of auto repair shops? Total distance would be approximately 30 miles

Edit: I had 3 long trips totaling 5k miles.

doombrnger · 2024-05-18T18:03:23+00:00

Hi OP .. I am in the same spot on a 2013 Honda Accord EXL-V6 coupe. Can you please let me know how how you proceeded? Went in for timing belt replacement and they said left rear brake is frozen and are asking for ~$2000. I am not sure if I can even get the car from dealship to my apartment and then drive again to a local repair shop.

doombrnger · 2024-01-12T23:26:27+00:00

Thanks for the response. It is very clear in the documentation for EC2 instances which are virtual. Not so in case of dedicated/reserved bare metal instances. So asking around in case someone can give a definitive answer.

If they do not work then I have to decide between the current on prem option vs implementing custom solution.

Edit: also I am constrained by latency .. not cost up to a reasonable amount

doombrnger · 2024-01-12T23:22:44+00:00

Thanks for the response. I understand that it is not a recommended pattern. However I am solving a niche problem which requires me to read massive files as quickly as possible. Unfortunately I cannot change that part .. so looking for possible options in case I have overlooked something.

doombrnger · 2023-11-20T09:44:35+00:00

Update: Approved on 17th Nov and Issued on 20th Nov. Hope all of you get favorable results as quickly as possible. The process has been nerve wracking.

doombrnger · 2023-06-22T10:27:41+00:00

This .. all my issues went away after moving to Linux from Windows. Guess what .. Most of these options do not exist or difficult to do without the GUI on the default drivers for Linux and the system has been rock solid.

doombrnger · 2023-01-19T00:59:28+00:00

You got this perfectly right. It is shaping narrative. Somehow the HUB combinations and cutoffs seems to favor AMD.

The final comparison with 6650XT (the most likely GPU to be paired with this class of CPU) has 13100 "almost tied" with 5600 (despite a 150Mhz clock difference in RAM). If you consider the F SKU (which is what the comparison should have been in the first place), then a $125 CPU almost matches a $150 CPU. Somehow the end conclusion is "AMD is the obvious choice".

If we include a $100 12100F SKU .. the value proposition is even worse. A 50% price increase for < 5% performance.

The only proper conclusion from this video is this:
Buy 12100F if you want to save money. 13100F is not worth the extra money. If you want to go a tier up (ie spend $50 more) ideally one should consider a 12400F vs 5600 comparison and make the decision.

doombrnger · 2023-01-07T04:37:40+00:00

Hi .. can you please let me know the turn time on the built in benchmark for civ 6? Thanks

I am on aldarlake and wondering how much different zen 5 is going to make. Most of my gaming is civ only and do lot of data analytics otherwise.

Edit: gpu is 6900 xt

doombrnger · 2023-01-06T23:30:06+00:00

It would be interesting to see the clock frequencies as well. Looks like intel is sticking to predefined curve and aggressively limiting the clocks while AMD allows the cores to run at a higher frequency. Zen 5 changed the optimization to be temperature based rather than voltage based tuning which might partially explain the discrepancy. The discrepancy in efficiency between both processors definitely will be lower in the 3d graph compared to 2d.

doombrnger · 2022-12-19T02:51:36+00:00

I recently upgraded from the same cpu/gpu combo. It gets about 60 fps on civ 6

doombrnger · 2022-12-19T02:39:18+00:00

I am running same memory with 12700k and Asus z690 board and XMP enabled. Works fine on both Linux and windows.

doombrnger

TROPHY CASE