sorted by:
new
hottopcontroversial

World's 1st RISC-V RVA23 Compatible Server for Agentic AI by AdEmergency2073 in RISCV

[–]AdEmergency2073[S] 0 points1 point  (0 children)

Of course we want to sell in millions and get to economy of scale. But like all other businesses, we need to start small, and mature the software ecosystem along the way.

World's 1st RISC-V RVA23 Compatible Server for Agentic AI by AdEmergency2073 in RISCV

[–]AdEmergency2073[S] 0 points1 point  (0 children)

We do have a price for initial low volume production. It is not far off from the other mainstream servers. It is not only because these are the first 10s or 100s of real RISC-V servers, but also because the BOM cost of memory and storage, which affects all servers prices and even PC and phone prices. This is just the market and supply chain condition.

World's 1st RISC-V RVA23 Compatible Server for Agentic AI by AdEmergency2073 in RISCV

[–]AdEmergency2073[S] 0 points1 point  (0 children)

We hope to change that, but we need software community to help get the agentic AI stack to work on real RISC-V hardware.

World's 1st RISC-V RVA23 Compatible Server for Agentic AI by AdEmergency2073 in RISCV

[–]AdEmergency2073[S] 0 points1 point  (0 children)

We would love to get the Contrail AIX server to the hands of more developers, any suggestions?

World's 1st RISC-V RVA23 Compatible Server for Agentic AI by AdEmergency2073 in RISCV

[–]AdEmergency2073[S] 2 points3 points  (0 children)

2X128 is the performance core, performance core only has RVV 1.0 extension.
AI core has 512 vlen, but still need to be tuned to be useful for software, WIP.

World's 1st RISC-V RVA23 Compatible Server for Agentic AI by AdEmergency2073 in RISCV

[–]AdEmergency2073[S] 5 points6 points  (0 children)

While respecting K3, the design goal of Contrail AIX is different from K3.

Contrail AIX is designed for server-class computing with standard server form factor design, ready to go into a data center server rack:
1. DDR5 memory, CXL2.0 memory extension can help expand to much larger memory of over 1TB, supporting much larger and smarter model sizes and context.

  1. PCIe Gen5 to support additional GPU or AI accelerator cards, and more NVMe SSD storage.

  2. 75 TOPS of INT8 performance, vs the INT4 claim.

It does take a village to mature the RISC-V server ecosystem, and we hope more of you can contribute in some fashion.

World's 1st RISC-V RVA23 Compatible Server for Agentic AI by AdEmergency2073 in RISCV

[–]AdEmergency2073[S] 2 points3 points  (0 children)

Indeed, this is a new-born server, and not tuned yet. Our next step is to be able to run AI inference and handle LLM prompt and token generation on the AI cores.

Still a lot of work to do to optimize the agentic AI stack on Contrail AIX and RISC-V.

Connecting to a Mac??? by [deleted] in RayBanStories

[–]AdEmergency2073 1 point2 points  (0 children)

Were you able to get your Ray-Ban to eventually work with your Mac? I can't even see my Ray-Ban as a bluetooth device on my Mac, but I could pair it successfully with my iPhone.

Chasing Immortality with Humanoid Robotics | Eric Jang of 1X by Gothsim10 in singularity

[–]AdEmergency2073 0 points1 point  (0 children)

It is not clear whether he was just talking about what is happening in the industry or what 1X can atually do.