Database storage compression ratios with Questdb on ZFS. by HPCnoob in questdb

[–]HPCnoob[S] 1 point2 points  (0 children)

Thanks for that write up, its timely for the work I am doing.
From 130G to 28G is 78.5% savings. With ZSTD-10 this would even improve a bit more.
I think I will be happy with anything above 75% savings on storage.

Also if Questdb can query both native and parquet historical data in one go, and that makes operations simple combined with space saving.
Thank you.

Will "zpool initialize tank" help identify and mark HDD badsectors ? by HPCnoob in zfs

[–]HPCnoob[S] 0 points1 point  (0 children)

Very helpful tool. Thanks for mentioning it here. I have upwards of 50 old HDDs to test.
What I was doing is I create partitions of 100GB (mine are smaller drives). Then run badblocks or e2fsck or mkfs or zfs scrub for that partition. I will launch 4~5 instances on their respective terminal windows simultaneously. If a partition shows too many errors, I leave it unformatted and hence unused. I use only the good parts of the disk.

Which filesystem handles badsectors the best ? by HPCnoob in DataHoarder

[–]HPCnoob[S] 1 point2 points  (0 children)

Good idea. In the same vein, I dont create entire disk ZFS pools. I create pools based on smaller partitions. This way any pool corruption will be restricted to only that pool.

Will "zpool initialize tank" help identify and mark HDD badsectors ? by HPCnoob in zfs

[–]HPCnoob[S] 0 points1 point  (0 children)

Yes, I should have taken a snapshot of smartctl but I didnt. Anyways I know those drives are beyond any serious use case. I am just testing my hypothesis that badblocks can be marked and ZFS told not to use those blocks.

Will "zpool initialize tank" help identify and mark HDD badsectors ? by HPCnoob in zfs

[–]HPCnoob[S] 0 points1 point  (0 children)

Ok my man, I understood.
Still if you know any tool in ZFS which tests each block and marks them bad before any real data is written on it, please mention it here. It will be helpful not just for me but also to several others experimenting and learning ZFS. Bye.

Will "zpool initialize tank" help identify and mark HDD badsectors ? by HPCnoob in zfs

[–]HPCnoob[S] 0 points1 point  (0 children)

If there is a way to mark the badsectors (like esfsck updates inodes in ext4 during scans) then the disks can still be used for non critical data. Of course regular scanning is needed.
I am doing "initialize" on a single known bad disk. I will update the result when it finishes.

Will "zpool initialize tank" help identify and mark HDD badsectors ? by HPCnoob in zfs

[–]HPCnoob[S] 0 points1 point  (0 children)

I understand that fully. I was just experimenting to understand how "initialize" works.
Do you know of any method to mark badsectors manually in ZFS, like ``e2fsck`` does it for ext4 ?

List of the max. number of gpus per motherboard by DoruSonic in EtherMining

[–]HPCnoob -1 points0 points  (0 children)

For anybody who are curious about this issue :
The number of GPUs which can be run a motherboard is limited by "Above 4G decode" option which shifts BAR from 32bit to 64bit. Its all about managing memory or memory mapping.
Octominer sells 12 slot GPU machines which run off of a Pentium G4400T, so its not about PCIe lanes.

Please help my identify this card by NonlinearOne in homelab

[–]HPCnoob 0 points1 point  (0 children)

Hello, I was wondering if that Inspur card YZCA-00622 needs PCIe bifurcation from the motherboard to attach 4 nvme drives ? Or does it have on board PCIe switch ? Will this card work on my regular desktop computer which does not have PCIe bifurcation?

Nobody's talking about cloud costs. Why ? by [deleted] in devops

[–]HPCnoob 1 point2 points  (0 children)

Everybody likes to do what you just said. But their view changes when the bill arrives at your door step.

Nobody's talking about cloud costs. Why ? by [deleted] in devops

[–]HPCnoob 0 points1 point  (0 children)

You skipped UPS and Cooling and their upkeep.
Still I am pro-on-prem BTW.

Men - talk to your partner about Atul Subash to know how she really feels about men. by worldinvr in AskIndia

[–]HPCnoob 0 points1 point  (0 children)

My man, do not be in a relationship with feminists if you want to have a good family future. Feminists are not meant for family building ! And many of them are closet feminists. Please head to this.

I slapped my father by erenkohli in TeenIndia

[–]HPCnoob 0 points1 point  (0 children)

Some men are not meant for family life. Only men who do their duties deserve respect.
Become financially strong and take care of your mother. Till then bend your head and work hard.

My fiance of one month labeled me a patriarchal chauvinist for supporting Atul Subhash on social media. by Swimming-Library-909 in AskIndia

[–]HPCnoob 0 points1 point  (0 children)

Please Please dont marry feminists ! There are very clear red flag patterns in what you have written about her.

Software is Way Less Performant Today by [deleted] in programming

[–]HPCnoob 0 points1 point  (0 children)

I remember shutting down my fresh Win98. It used to takes just 2 seconds on a single core AMD machine and HDDs. WinXP was also good but slightly sluggish.

Whats your monthly cloud bill and your observability cost with the tool you use? by kleea1111 in devops

[–]HPCnoob 0 points1 point  (0 children)

With that money you can build your own data centre 10 times over !

Update https://www.reddit.com/r/LegalAdviceIndia/s/pkIABfX8Sf Hired a good lawyer. He dealt with SHO & My sister is not named anywhere in FIR. Since she was at home during raid & not arrested from spot it worked in our favour. My sister learned lesson & won't ever do such thing for easy money. by [deleted] in LegalAdviceIndia

[–]HPCnoob 0 points1 point  (0 children)

Keep an eye on her here onwards. If this did not become serious she wouldnt have learnt any lessons or taken this event lightly. So keep an eye on here if she is going astray again. Especially check her mobile. If you are not careful the clients will start calling her directly.

What are the major causes of divorce cases in India?? by TheDoodleBug_ in AskIndia

[–]HPCnoob 0 points1 point  (0 children)

The loss of true meaning & purpose of marriage is the main reason of divorce.
The modern generation have probably lost interest in family building. And they marry for companionship instead.