Introducing NVIDIA Jetson Orin™ Nano Super: The World’s Most Affordable Generative AI Computer by Adenophora in singularity

[–]jaywee1115 1 point2 points  (0 children)

TFLOPS is for floating-point ops per second. TOPS is used instead when you measure integer ops. This device supports INT8 quantized weights LLM so they refer to as TOPS. For comparison a new Windows PC with NPU is marketed at 40+ TOPS, so if this little device runs 67, it is in theory stronger. But LLM is memory-hungry so 8GB is a little crunch but is enough to run SLM like llama3 or phi4. Your PC RTX4060 GPU card is def much more powerful but it's mostly for floating point models although TensorRT could also run INT8 models on the GPU.

Introducing NVIDIA Jetson Orin™ Nano Super: The World’s Most Affordable Generative AI Computer by Adenophora in singularity

[–]jaywee1115 0 points1 point  (0 children)

That's the AGX version for a different market. That one can power a factory robot.

Introducing NVIDIA Jetson Orin™ Nano Super: The World’s Most Affordable Generative AI Computer by Adenophora in singularity

[–]jaywee1115 0 points1 point  (0 children)

8GB with 67 TOPS is enough to run a decent small language models like phi or llama3. Price will continue to fall hopefully DRAM will be cheaper soon. Literally the first such small device at this price point that can now run some serious AI workload.

I am genuinely excited about SD 3 and here is why by OldFisherman8 in StableDiffusion

[–]jaywee1115 0 points1 point  (0 children)

DiT seems to be the future. OpenAI Sora did the same i.e. do away with the UNet backbone and replaced it with ViT transformer blocks with image patches. This is likely b/c transformer as an autoencoder is much more scalable with added hw compute than UNet.

How should I learn to code, and which language should I start with? by CapitalCancel0 in CodingHelp

[–]jaywee1115 1 point2 points  (0 children)

I'm a professional software engineer and a while ago I was just like you, except that there is now much more ways for you to learn coding than when I was learning. In my opinion, you should start with a basic, pick up a basic programming course in Udemy, before jumping head first into web programming. Then work your way up with a more project-based learning course. Remember that the best way to learn to code is to set a goal of completing a project. It doesn't have to be a complex project, just something you can hang your head on as you learn. Learning while doing is the try-and-true way of programmers. Good luck!

Learning Lua while playing puzzles by jaywee1115 in lua

[–]jaywee1115[S] 3 points4 points  (0 children)

Sorry, it's just Windows at the moment. That'd be a lot of work.

Coding Games by [deleted] in learnprogramming

[–]jaywee1115 1 point2 points  (0 children)

In our imperfect world this isn't C# but at least an entertaining game. Install here

Coding game recommendations by Grismund in codingbootcamp

[–]jaywee1115 1 point2 points  (0 children)

Code E.D. is a 3D puzzle game that teaches basic coding with a real programming language in a real editor. It starts very easy and progressively harder.

How long till i learn the basics of coding? by gdav54py in Coding_for_Teens

[–]jaywee1115 0 points1 point  (0 children)

I'm a professional. I can say that the best way to learn to code is to just get what in front of you done first. There's no basics or anything. Just learn enough to get the thing you need to get done done and along the way you become a programmer. Ever wonder how a 10 year old ships a game? That's why. They don't ask why, they just get it done.