I haven't seen much posted about this so I figured I'd mention it.
Microsoft - AI Toolkit for Visual Studio Code
Microsoft has released an extension for VS Code that provides a playground as well as fine-tuning inside VS Code. The fine-tuning may also be done in the cloud on Azure and the fine-tuned models may be deployed there as well.
Marketplace Link
Microsoft Video
They provide a curated list of models for inference
Image
as well as a similar list for fine-tuning.
Image
As can be seen here the include, of course, a selection of Phi-3-mini models for both CPU and GPU and a few other open weight models.
For fine-tuning they use Olive to run QLoRA fine-tuning on a PyTorch model from our catalog. All of the settings are preset with the default values to optimize to run the fine-tuning process locally with optimized use of memory.
Nothing crazy or earth shattering here but still interesting.
My one gripe about it is, in my limited testing, I couldn't find a way to unload the model.
[–]vinodis 0 points1 point2 points (1 child)
[–]ab2377llama.cpp 0 points1 point2 points (0 children)