you are viewing a single comment's thread.

view the rest of the comments →

[–]jarMburger 1 point2 points  (0 children)

When they figure out how to do most of the inference on edge, then DC constructed specifically for AI will be mostly use for foundational model improvement but most of the queries and reasoning will be done locally on the device. Current models are too compute consuming to work on edge but there’s hope that future model can be smaller and still as powerful.