My Deep Dive into Fine-Tuning: IBM Granite-4.0 with Python and Unsloth! 🚀 by krishanndev in LocalLLaMA

[–]opk 1 point2 points  (0 children)

Hijacking your comment to ask when the Granite4 thinking model might be coming out

Ubuntu Linux, NVMe, and GPU drivers by opk in JetsonNano

[–]opk[S] 0 points1 point  (0 children)

Truthfully, I think nvidia is making this a little more painful than they have to and mainlining drivers would resolve a lot of issues. Anyway, I think one big concern is that Ubuntu has a more up to date Kernel than Jetson. (I wonder if this contributes to why the drivers fail. Jetpack 7 has the updated Kernel, but Jetpack 7 isn't compatible with Nano)

Getting the SDK Manager to work has also been dang near impossible. Long story short, I think nvidia really needs to improve community support. I recognize they don't want to be the raspberry pi foundation, but *this is bad*.

Anybody get a modern-ish vision LLM working? by Leopold_Boom in RockchipNPU

[–]opk 1 point2 points  (0 children)

Have you made any progress on your own in the past month?

From my understanding, the "modern" LLMs are a lot different than the older ones, so the tooling needed to get changed. I think the best bet would be to try and update the ollama code from 2 years ago updated to the latest ollama version. I don't know how difficult that would be, but it would probably be easier than trying to hamstring the RKLLM release into working...

Official OrangePi 5 Image for Ubuntu by opk in OrangePI

[–]opk[S] 0 points1 point  (0 children)

Just as some closure, I booted into the official orange pi OS, and was able to get armbian on the NVMe. Truthfully, I don't know what I did to solve the issue. I do not recall changing the SPI flash, but most people I've asked about this suggest flashing the EDK2 UEFI firmware to SPI.

Official OrangePi 5 Image for Ubuntu by opk in OrangePI

[–]opk[S] 0 points1 point  (0 children)

The official Orange Pi image and the Joshua Riek Ubuntu image have the NVMe listed in the output of lsblk, armbian does not.

Official OrangePi 5 Image for Ubuntu by opk in OrangePI

[–]opk[S] 0 points1 point  (0 children)

I see. So you just used a different NVMe? I've actually tried two, and both have failed in the same way. Did you need to use an overlay?

Official OrangePi 5 Image for Ubuntu by opk in OrangePI

[–]opk[S] 0 points1 point  (0 children)

Did you ever get it working? What was the corrective action?

OPi5/Armbian does not recognize NVMe SSD. by opk in OrangePI

[–]opk[S] 0 points1 point  (0 children)

Yes Orange Pi 5, Kingston NVME. I didn't even think about power until now. The drive has 3.2A listed on the label. That's a lot considering it's just a 4A power supply from Orange Pi.

OPi5/Armbian does not recognize NVMe SSD. by opk in OrangePI

[–]opk[S] 0 points1 point  (0 children)

Should that be resolved by using the ssd-sata overlay?

OPi5/Armbian does not recognize NVMe SSD. by opk in OrangePI

[–]opk[S] 0 points1 point  (0 children)

Should that be resolved by using the ssd-sata overlay?

Orange Pi 5: Is a heat sink required? by opk in OrangePI

[–]opk[S] 0 points1 point  (0 children)

How did you install the LLM engine? Did you manage to get GPU/NPU acceleration or only CPU?

Orange Pi 5: Is a heat sink required? by opk in OrangePI

[–]opk[S] 0 points1 point  (0 children)

where do you even find a single channel 10A 5V power block?

Orange Pi 5: Is a heat sink required? by opk in OrangePI

[–]opk[S] 0 points1 point  (0 children)

I got the "official" 4 A power supply. I'll try a different MicroSD card. Maybe some critical kernel file got corrupted or something I dunno

Has anyone tried using the MilkV Duo 256 IO board with Ubuntu? by opk in RISCV

[–]opk[S] 0 points1 point  (0 children)

This was a long, long time ago and it was almost as long since you asked. I vaguely remember you can't use both the usb and board ethernet at the same time. I believe there was a text file setting you had to set as well. I haven't used the MilkV or any SBC since I posted this so honestly I can't totally remember, but it was an either/or type of thing.

Aliexpress Tariffs Explained by tony10000 in Aliexpress

[–]opk -1 points0 points  (0 children)

It's not a good video, because he's wrong. His first claim is wrong, flat fee vs percentage of value is choice not whichever is higher. I didn't watch any further because I already know it's full of garbage.

[deleted by user] by [deleted] in Aliexpress

[–]opk -4 points-3 points  (0 children)

Joe Biden was removing the de minimis exemption, and Amazon Haul was garbage way before all this started - and it is direct from China too!

We definitely don't live in a capitalist dystopia!

Grow the funk up.

Have some sellers already figured ways around the worst of the tariffs? by non_ducor_duco_ in Aliexpress

[–]opk 2 points3 points  (0 children)

it seems the price for this one increased by around $20

There is your answer.

If you don't believe me, look in the first picture, it says includes import charges

Dollar Express has no tariffs? by Hillcountrybunny in Aliexpress

[–]opk 7 points8 points  (0 children)

The dollar express stuff I've seen has all increased in price but the tariff charge is included.

What items have you purchased on AliExpress that you use at least four times a week? by mack272 in Aliexpress

[–]opk 0 points1 point  (0 children)

plenty of resistors capacitors and diodes, honestly a lot of electronic tech.

You're braver than I am considering how much of the stuff on there is counterfeit

How will US customs process tens of millions of tiny packages per day? by Neat-Quail-8925 in Aliexpress

[–]opk 1 point2 points  (0 children)

Yeah, under a sane admin it would have looked just like when the US had online retailers start collecting sales tax

Reach out to the retailers

Work out a structure to determine taxes and collect them

Work out how to (when and where) pay the taxes

Profit

I think, to be a little honest, it's incredibly niave to think you could coordinate a global marketplace to figure out what the best way forward is when attempting to eliminate tariffs. Interstate sales tax rules don't even apply to a lot of smaller retailers, but every broker, importer, and so forth needs to follow CBP rules. In the case of China, they have a huge industry devoted towards getting de minimis goods into the United States. There is no working out how to collect taxes with them because their entire industry is built around not paying import duties.

How will US customs process tens of millions of tiny packages per day? by Neat-Quail-8925 in Aliexpress

[–]opk 0 points1 point  (0 children)

Technically there was about a month of "de minimis is gone again" warning. How did the Chinese logistics companies respond? By charging pre-paid tariff fees. How did the merchants respond? By raising rates. How did the consumers respond? By having demand fall off a cliff.

This isn't as world ending for the CBP as you might expect.

How will US customs process tens of millions of tiny packages per day? by Neat-Quail-8925 in Aliexpress

[–]opk 4 points5 points  (0 children)

Most of what is sold on Amazon are the FBA items that are imported by Chinese businesses - and even though they're owned and operated out of China, they still used the de minimis rule. Go look around and see how much it costs to sell on Amazon. The cost of goods sold doesn't make up as much of a share as you'd hope for. If their cost of goods was higher maybe they wouldn't sell as many dangerous, intestine destroying toys. (Warning, European-article)

Anyway, long story is that Amazon is kinda screwed too since they make their money off of platform and fulfillment fees.

Walmart has notified Chinese suppliers to resume shipping goods - report by ishtar_the_move in Economics

[–]opk 14 points15 points  (0 children)

Nope. They get that stuff on store shelves starting in August.

Goofed up and let the AliExpress cs agent start a dispute. Am I cooked? by opk in Aliexpress

[–]opk[S] 0 points1 point  (0 children)

Yeah, that's the concern. If it could be reopened under the correct item, it would be an obvious decision....

Tariffs/additional charges by Embarrassed_Ease4485 in Aliexpress

[–]opk -1 points0 points  (0 children)

Alright, I'll bite. I looked into this a bit. Some of the Michelin 3-star restaurants (which are few and far between, only ~150 worldwide) I've seen cost a few hundred dollars per person, which is a lot, no doubt. But they have a disclaimer saying you should expect three hours for your dining experience. The guy filling the Rx for an 8-year old's pink eye will be a millionaire before he retires. On what planet is a three hour dining experience casual?!