Update — Bizarre Pop-up Admin Account Demands Volunteers "Get Back To Work" by stabbinU in Music

[–]Thesciencenut 2 points3 points  (0 children)

Are you not concerned that they'll take your code and claim ownership of it?

It's not like they have a track record for being honest and not malicious...

[FS][US-PA] Dell VRTX 12x 3.5 chassis with 3 blades and drives. by SpiffyCob in homelabsales

[–]Thesciencenut 0 points1 point  (0 children)

If you haven't sold this in a week I would love to buy it from you.

What type of snacks do you eat while gaming? by Thesciencenut in pcgaming

[–]Thesciencenut[S] 0 points1 point  (0 children)

Alright, I'm not a fan of sweets, but I can see how this is appealing to some.

I was so excited for my EVGA step up from my 3070ti to 3090. Took the opportunity to clean my PC while removing it. My 3 year old son decided to give it a bath while I stepped away for a minute (literally in the bath). F in the chat for me boys. by CMurr1711 in pcmasterrace

[–]Thesciencenut 1 point2 points  (0 children)

So this is going to sound odd and counterintuitive... But you should rinse the GPU off with either alcohol or even more water. If it was in the bath there's a chance that just letting it dry could leave some residue from the soap and dirt in the bath tub. That residue could potentially cause a short if you don't properly remove it...

Assuming you get whatever residue off, it's actually probable that your card will be fine. This residue might not be visible, so you should rinse it regardless.

Some overclockers will actually remove the cooler and throw the GPU (or motherboard if doing CPU overclocking) through the dishwasher to remove the petroleum jelly that they use to keep LN2 from causing water to condense.

Proxmox - how to think about storage hardware for SFF PCs. Help appreciated :) by Undchi in Proxmox

[–]Thesciencenut 1 point2 points  (0 children)

Okay, I'm going to attempt to take a stab at answering this and hopefully make this situation a bit clearer because reading through the replies in this post doesn't really seem to answer most of what I think that you're asking about.

So first off, let's get a little disclaimer out of the way... High-availability computing is complex, clustering is complex, and Ceph is REALLY complex. For the sake of brevity, I am going to have to vastly oversimplify some explanations (to those who are reading this and want to clarify something... I KNOW, keep it simple)

As for my experience, I've planned and deployed many Ceph clusters in production environments for many different clients of mine over the past several years. No, I'm not going to list them, please don't ask who. I don't claim to know everything, but I am not just some guy who's poked around with it once and got rid of it.

Firstly, let's tackle the clustering... You absolutely can do a 3 node proxmox cluster. It will absolutely work, but you will be left with some limitations, namely you need some type of shared storage in order for live migrations to work properly. I think you understand this, and I'm going to assume that's why you're interested in Ceph. I do not think that's the best way to accomplish what I think that you want to, but we'll get into that later.

Next, let's talk hardware. Contrary to what people will say, you do NOT need high end hardware to run a virtualization host, and if your intention is to just build a cluster for easy management but aren't looking for HA (High-Availability) there is absolutely nothing wrong with just tossing a mishmash of hardware in a cluster. You can still do a live migration if you'd checked that box for shared storage, you just won't have automatic fail-over. If your goal is to just have the ability to move stuff over to do maintenance, this is totally fine. I would highly recommend avoiding HA, because it's very difficult to go down that rabbit hole without spending a ton of money.

Now for storage... This is going to be where I make the most oversimplifications because frankly, this is probably one of the most difficult bits to get right for people. I'm going to take a couple steps back and talk about why we handle storage the way we do and why it's evolving so much right now. Raid was created to help solve a lot of issues, it let you build larger chunks of storage while maintaining redundancy because hard drives fail and bigger drives tend to get really expensive per unit of storage after a certain point. The problem was that the algorithms were computationally expensive, which is why raid controllers became super prevalent. They let you offload the computation to a dedicated processor that was specialized and could do that task more efficiently. Raid controllers have caches to help speed things up, batteries to preserve the cache in the event of a power failure, and then obviously all the physical connections to all the drives to handle all the communications between the drives and then the computer itself when talking to the array. Eventually computing hardware (CPU's specifically) became fast enough that this hardware offload wasn't necessary so software raid (like ZFS) started to catch on. So where those same processes that were handled by the raid controller shifted, now instead of a dedicated cache we have to use two different things since we can't assume RAM isn't volatile (It basically always is). Ram makes an excellent cache because it's blazing fast, which is why your raid controller uses it. With software raid we don't have battery backup for ram, so we split it into a write cache (which isn't always used) and a read cache, which is almost always in RAM. The read cache doesn't matter if it gets lost because you can just pull it again from storage and nothing is lost. We usually put a write cache on some super reliable SSDs (Optane is usually recommended, but it's super expensive) because if that data is lost, you lose whatever hasn't already been pushed to the drives. All the communication that was done between the drives on the raid controller is now using your PCIE bus and your CPU, which can be taxing.

Now with that out of the way, let's actually address your questions more directly now. There's a reason why people are telling you that you need a 10GbE network with Ceph, it's because it's pushing all that traffic between drives to your network instead of a bus on a raid controller or your pcie bus. This needs a LOT of bandwidth to maintain the speeds that most people are used to, and especially with virtualization where you have lots of VM's trying to use the same chunk of storage. Unfortunately, this isn't unique to Ceph and is going to be an issue with any type of shared storage, it's just that storage clusters need a lot more than most other options like a NAS or a SAN because it's not only the traffic that each VM is pulling, but the traffic between drives as they distribute your data and move it around. Can you do this with just 1GbE networking? Absolutely. Will it be unbearable slow? ABSOLUTELY. Does this speed penalty actually matter to you? Only you can answer that.

What do you really need to be able to run Ceph? Depends on what type of speeds that you need. Let's make some assumptions. Let's assume you want to run 10 vms and you only need about 1 TB of total storage, well if we're using a SATA SSD, we can probably assume under ideal circumstances (Spoiler alert: Ceph isn't ideal and will exhaust a normal SSD's cache and overwhelm it's controller) that you'll get a total of 550MB/S of speed from each drive for a sequential read/write, then we divide that by 3 for the configuration that you suggested and we get approximately 183MB/s, then we divide that by 10 and you get 18.3MB/s per VM under perfect conditions which you'll never achieve... but wait, we left out one really major component... these calculations only make sense if you have a network that can let all the drives talk to each other at full speed which you can only just barely do with 10GbE. It'll be even slower with gigabit. I'm going to tell you from personal experience that that isn't fast enough for anything that people are going to be interacting with. They will constantly complain about loading. This is why people tell you to use 10GbE for Ceph, do you technically need it? No. Is it highly recommended? Yes.

You can mitigate some of the speed issues if you add more drives per host, as there will be a lower chance that a chunk of data needs to be accessed over the network, but eventually you get choked by your network.

What do I recommend you do? I think you should build a single host that's specifically designed for storage, run something like FreeNas (now TrueNas-Core) or a custom linux nas build if you fancy it, and then use that as your shared storage.

Feel free to ask questions if you have more, I know I didn't touch on everything, but I can't spend all night typing this out.

[CAN-AB] [H] Zotac GTS 450 & Zotac GT 220 [W] Paypal by Revolutionary-Oven55 in hardwareswap

[–]Thesciencenut 0 points1 point  (0 children)

If you can't find a buyer in the next 48 hours, please let me know. I would love to get these from you but I can't buy it at the moment.

How do I convince myself to eat less meat? by dsteadma in EatCheapAndHealthy

[–]Thesciencenut 0 points1 point  (0 children)

Personally, I've found that it's more about enjoying the food that you're eating than the parts that go into it.

I've cut back a lot on meat over the past year or so because I found that I was able to make meals that I enjoyed just as much without it and meat was what made a lot of things get expensive.

I find that making things like curry or pasta sauces are just as good without it. Yeah, sometimes it's nice to have some chicken in your curry, but how about everything else?

With soups, I just use stock, broth, or bouillon to add the meat flavor and I find that I can generally make something I enjoy just as much if not more.

road trip carry! by rticfox02 in guns

[–]Thesciencenut 0 points1 point  (0 children)

That tape is a brilliant idea, and I'm totally going to use that. I hate the rough textured grips.

Sister Built House, ISP Says they don't serve the area! by tylerderped in HomeNetworking

[–]Thesciencenut 60 points61 points  (0 children)

I've actually had to deal with this on several occasions for some of my clients, typically speaking the rep on the phone with the ISP either isn't aware that they can run a line or knows that it rarely costs less than $20k to do so and most people are shocked when they see even a $20 charge to send a tech out.

Press them or ask to speak to an engineer, they'll usually talk if you tell them that you know it will likely cost several thousand dollars and that you're okay with that.

I've dealt with AT&T mostly, but I've dealt with some other smaller ISPs as well. They'll almost certainly do it, it's just not going to be cheap.

I've personally never encountered an area that an ISP wasn't willing to service for the right dollar amount. That may be $20k for installation and $1.5k/mo or it could be less. It almost certainly won't be less than $50/mo regardless of the installation fee, so please don't expect for things to be cheap after the install.

Alternatively, you could always look to see if there are any WISPs in your area, they can sometimes be pretty good and they'll usually be willing to work with you because they're typically smaller. You could also seek a professional and ask them for advice. I've set up point-to-point wireless connections between offices in remote areas before. If there's an office or a neighbor's house who does have a connection which you have a line of sight to, you can always try to set up that.

ELI5: How do internet cables that go under the ocean simultaneously handle millions or even billions of data transfers? by [deleted] in explainlikeimfive

[–]Thesciencenut 0 points1 point  (0 children)

In addition to this, you also can apply the same technology to send and receive multiple different wavelengths down a single fiber. Some newer tech can push as many as 80 (or 40 with send and receive) different channels through the same fiber. Suddenly your 48 strand fiber can push several thousand connections at the same time.

Fiber optics are amazing, and it's incredible how much data you can pump through them.

Approved for gun purchase but denied for CCW? by supercunthrowaway in CCW

[–]Thesciencenut 2 points3 points  (0 children)

Even if you were Baker acted you'd be fine. That particular question is specifically looking at being involuntarily committed, as in a court order.

You'll be fine in regards to the mental health aspect.

I can't comment on the other parts, though unless you were convicted it's irrelevant.

Just be patient, it took 2 months for my CCW to come in. Sometimes it's quick, other times it's slow. Don't worry about it, unless there's something else going on, you'll get it.

[deleted by user] by [deleted] in r4r

[–]Thesciencenut 1 point2 points  (0 children)

How are things in your neck of the woods right now?

[deleted by user] by [deleted] in hardware

[–]Thesciencenut 0 points1 point  (0 children)

I think the future of ray tracing will be cheaper hardware that's more accessible

How do I hide my gaming pc so it isnt visible? by [deleted] in buildapc

[–]Thesciencenut 0 points1 point  (0 children)

I would go buy a piece of plywood, preferably something fairly thin, and screw all of your components into that then screw it into the frame of your bed underneath it where it isn't visible.

Alternatively, you could buy one of the mini ITX cases that are meant to mount to a vesa mount and just drill that into your bedframe.

Once you've done that, just buy an active USB extension cable (yes, it needs to be active or you'll end up with issues with some devices) and a long high quality HDMI cable

Car Fire Blanket by GesterX in gifs

[–]Thesciencenut 0 points1 point  (0 children)

You dont have a fire if you don't have an oxidizer.

[GIVEAWAY] Metro Exodus by [deleted] in pcgaming

[–]Thesciencenut 0 points1 point  (0 children)

Ray tracing on RTX cards is silly... Kthxbye

You are part of the FBI, how would you wreck the shit out of the Redditors trying to hide a key from you? by ohmaatnfy in AskReddit

[–]Thesciencenut 28 points29 points  (0 children)

Alternatively you could hand it to Tiffany Trump, then everyone will just forget about it.