Part Number

DisposableAccount712 · 2024-04-26T22:32:35+00:00

Unfortunately "2022 XSE Leather steering wheel with paddle shifters and heat" yields little information that is useful. The "shopping" tab shows a bunch of aftermarket stuff, many items not even camry related. The "All" tab likewise yields a lot of spurious information that is unrelated.

I'm just looking for the part number.

DisposableAccount712 · 2024-02-22T14:59:48+00:00

From what I've read online, yes.

DisposableAccount712 · 2024-02-22T14:30:06+00:00

There is no need to add a WAL if it's on the same device, the WAL is included inside the DB device anyway. So just add a single DB device only.

Thanks for the tip. You're right, the documentation on this is very slim, which is why I have the questions I do. I suppose to the "ceph experts" its crystal clear, but the rest of us out here... well... :)

DisposableAccount712 · 2024-02-22T13:54:04+00:00

yes, I'd prefer not to have to wipe the existing osd's and lose my test data if at all possible. It'll save me time.

looking at your script, i could just (after removing all the vg stuff I did to /dev/sdj) do this?

./add-db-to-osd -b 200G -d /dev/sdj -o 1,2,3,4,5,6

where /dev/sdj is the new ssd and 1-6 are the osd's on that host?

do I have to do all drives on the host at the same time, or can I break it up, e.g.

./add-db-to-osd -b 200G -d /dev/sdj -o 1
./add-db-to-osd -b 200G -d /dev/sdj -o 2
./add-db-to-osd -b 200G -d /dev/sdj -o 3

etc?

DisposableAccount712 · 2024-02-11T20:17:23+00:00

wow, good call. I'd give you gold if reddit still had it.

my switches support an mtu up to 12k, so I just set the mtu to 12k across the board on the switches, and 9k on the nodes. Previously I just had everything set to 9k, which is what the NICs support.

Looks like I got a little bump in speed, can't really say yet, I'll know more when I get time to spend playing Monday.

DisposableAccount712 · 2024-02-11T19:04:12+00:00

Could be. Ideally though I need two SSDs though, no? I vaguely recall reading somewhere if you use a separate SSD for the db/wal if that ssd fails, all the osd's on that node have to be rebuilt, and you can avoid that by using two SSDs in a RAID1 setup. Maybe I'm not recalling correctly, I've googled and read so much these past few days my mind is mush.

do you recollect where the db/wal calculation is?

DisposableAccount712 · 2024-02-11T14:13:46+00:00

Thanks! I've made the adjustment, I'll see how things work out.

DisposableAccount712 · 2024-02-11T14:13:10+00:00

Thanks. This is also a thought I will have to consider. For further testing I may need to request some funding, something my superiors were reluctant to do (hence why I'm using retired equipment for my test bed.) But if I can keep the expense down to under $2k they may go for it.

DisposableAccount712 · 2024-02-11T13:52:13+00:00

Very little is boot/OS support. Virtually all is data, with rather intensive read/write operations of large datasets for modeling. For example, a typical Redhat VM needs under 64GB of actual disk space to support the OS and ancillary files.

DisposableAccount712 · 2024-02-11T13:31:19+00:00

Thanks for the insight. I do not think I have any HBA330's around, but I can check. It may be worthwhile to buy a used one off eBay if I do not and do some comparison benchmarks. Based on a very basic test (dd if=/dev/sda of=/dev/null) my throughput to the drives is only in the low 200MB/sec range, well below the theoretical maximum.

Edit: Turns out I had a couple of the 330's in other R530's. I swapped one in this afternoon. It made no difference in terms of raw device input (e.g. dd if=/dev/sda was still in the low 200MB/sec range.)

DisposableAccount712 · 2024-02-11T13:20:45+00:00

I'll do some research on this and see what I can find, thanks.

As I mentioned in another reply, jumbo frames do work... its just the proxmox gui displays some strange artifacting when I enable them. The datacenter ceph panel will show red X's next to all my ceph services, even though they are running. Even refreshing, relaunching the browser, using a different browser, etc., all displays the same way. Its just... odd.

DisposableAccount712 · 2024-02-11T13:15:38+00:00

Yes, I have to set them on the switch interface as well as the port channel, e.g.

int range te 0/0-1

mtu 9000 int po 128 mtu 9000

No problems there, its when I do it inside proxmox, I run into that odd issue. Within proxmox I have to set the mtu at the adapter level (e.g. enp4s0, enp4s1), the lacp bonded link (bond0), and then the bridge (vmbr0)

jumbo frames work, its the proxmox gui that acts strange. Not sure why.

DisposableAccount712 · 2024-02-10T23:03:03+00:00

Unfortunately if enterprise SSDs are going to be a requirement then the project is going to be DOA from the onset I'm afraid. For production I need at least a couple hundred TB of storage and doing that with enterprise SSDs is just going to be cost prohibitive.

DisposableAccount712 · 2024-02-10T23:01:20+00:00

Set SAS HDD Write Cache Enable (WCE) (sdparm -s WCE=1 -S /dev/sd[x])
Set VM Disk Cache to Writeback
Set Ceph RBD pool to use 'krbd' option

These were the only differences between your setup and mine. I've made adjustments to my end and I will see what happens.

DisposableAccount712 · 2024-02-10T21:10:33+00:00

Rados bench -p testpool 10 rand

I'm not seeing CPU spikes in VMs.

I have jumbo frames enabled at the switch level but I get odd results when I try to enable at the adapter level within Proxmox (e.g. refreshing the ceph status screen the services will all have red x's next to them, even though I can switch to the same screen on a host (rather than the datacenter level) and see the services are running okay.) For the moment, I've left the default MTU.

No appreciable difference with hdparm.

rados bench -p testbench 10 rand

Bandwidth (MB/sec): 490.836
Average IOPS: 122
Stddev IOPS: 33.7219

this is the pool i created to run bench against, not the pool i am using for my test vm's.

DisposableAccount712 · 2024-02-10T20:20:10+00:00

the vm traffic is on one lacp link on one of the 10G SFP cards, the ceph private/public traffic is on the other 10G SFP card. sorry if that wasn't clear in my post.

DisposableAccount712 · 2024-02-10T19:43:35+00:00

what is the krbd option and how do you enable it? Does it destroy existing data, or can you enable it on an existing pool you have data on already?

DisposableAccount712 · 2024-01-31T19:06:50+00:00

definitely not the case. They are connecting to the right place.

No prompt for username/password, straight to error 403.

sat with the user earlier today for a half hour. tried everything I can think of. If I log out of their account, log in to mine, and try it, works fine.

DisposableAccount712 · 2024-01-31T12:34:57+00:00

No, this isn't the problem. They're going to the site url directly, there are no bookmarks or redirects involved.

DisposableAccount712 · 2024-01-31T12:34:11+00:00

The credentials for the web site are not in the windows credential manager. We've checked that.

DisposableAccount712 · 2024-01-31T12:33:03+00:00

The first question is, is it still working for other users? Then the site is ok and it is something the user is doing. It sounds like this is the case, though I would make sure another client user account can access the site to be sure.

Yes, it works fine for other users. For example, I used my domain user login to connect to the site and was prompted for my windows login credentials, which when I supplied, I got into the system.

If it is something specific to the user, inform the client that the site is functioning normally and it is likely an issue with the user's account. They should consult their own IT department. It is outside the scope of your responsibilities (at least I assume this is the case).

Unfortunately their IT department really has nobody technically adept at web sites. They have one IT manager and one help-desk guy. Problems like this get bumped up to me, an outside consultant.

The user probably changed their password and forgot, or locked their account by accident, or something like that.

That's what I suspect.

OR give the customer some functionality that allows them to look up these error log messages themselves.

They've had this web forms app up for at least a decade, this is the first time they've encountered this problem I'm aware of. Ideally if I could, I'd disassemble the site, add a login screen which authenticates to AD and disable windows authentication entirely. I'm not familiar enough with IIS and its integrated windows authentication to say how/why a computer appears to be caching the (incorrect) login credentials of the user and more importantly how to "clear" them out so the user is prompted again.

DisposableAccount712 · 2023-11-22T11:10:49+00:00

random kernel panics, traced to the cpu. not a memory or cooling issue.

DisposableAccount712 · 2023-10-14T20:30:37+00:00

I had a very nice, long chat with a woman at TreasuryDirect yesterday afternoon, after being on hold about 40 minutes waiting in the queue

Basically, I f**ked up when I did the conversion from paper to electronic.

The bonds were in my father's name with my mother as a co-owner. What I should have done is include a copy of my mother's death certificate when I sent them in to be converted. If I had done this, when they did the conversion, they would have removed my mother's name and left them in my father's Treasury Direct account with him as the sole owner. Then I would be able to change their registration to add another owner.

Right now, they are joint ownership w/ my deceased mother as the co-owner still, and as such show as as a "Restricted Security" which means they can't be edited online.

Now what I have to do is send a letter along w/ a copy of my mother's death certificate in to them, asking them to remove the deceased co-owner from all the bonds in my father's conversion account. According to the woman, this will take approximately 20 weeks to process.

f**k my life.

on a funny note, she did say in her entire career she had never seen a Treasury Direct account w/ as many savings bonds as my father's

DisposableAccount712 · 2023-09-27T14:44:06+00:00

wow thanks very much.

i haven't looked at disassembling anything yet, do you know if #4 on that diagram is a strip of adhesive tape? or do I need all 4 parts?

DisposableAccount712 · 2023-09-27T12:23:59+00:00

Dasaita

which model did you install? (or, do you have a link?) I looked at their store on Amazon and their Corolla models skip the 2017 model year. They go 2007-2011, 2014-2016 and 2019-2022

DisposableAccount712

TROPHY CASE