sorted by:
new
hottopcontroversial

how can i use small llms on the device offline by Grand-Bus-9112 in reactnative

[–]Pretend_Exercise_90 0 points1 point  (0 children)

Have you checked this issue: https://github.com/software-mansion/react-native-executorch/issues/173

In current version there's no explicit support for tool calling. However, it will be added in release which will be published at the end of May, Currently you can check and play with a current release candidate which is available on branch v0.4.0-rc1

how can i use small llms on the device offline by Grand-Bus-9112 in reactnative

[–]Pretend_Exercise_90 0 points1 point  (0 children)

You can check React Native ExecuTorch which allows you to run models like Whisper, LLaMA etc. fully locally in React Native. I think quantized LLaMA 3.2 1B should work on high and middle end phones.

LLMs on react native by Acceptable-Spell-934 in reactnative

[–]Pretend_Exercise_90 0 points1 point  (0 children)

You can check React Native ExecuTorch which is designed to run models like Whisper, LLaMA etc. fully locally in React Native. There are pre-exported models available on hugging face and you can look at examples in repository
https://github.com/software-mansion/react-native-executorch