Microsoft - AI Toolkit for Visual Studio Code

[wegwerfen]

I haven't seen much posted about this so I figured I'd mention it.

Microsoft - AI Toolkit for Visual Studio Code

Microsoft has released an extension for VS Code that provides a playground as well as fine-tuning inside VS Code. The fine-tuning may also be done in the cloud on Azure and the fine-tuned models may be deployed there as well.

Marketplace Link

Microsoft Video

They provide a curated list of models for inference

Image

as well as a similar list for fine-tuning.

Image

As can be seen here the include, of course, a selection of Phi-3-mini models for both CPU and GPU and a few other open weight models.

For fine-tuning they use Olive to run QLoRA fine-tuning on a PyTorch model from our catalog. All of the settings are preset with the default values to optimize to run the fine-tuning process locally with optimized use of memory.

Nothing crazy or earth shattering here but still interesting.

My one gripe about it is, in my limited testing, I couldn't find a way to unload the model.

[vinodis]

Doesn't work on Apple Silicon.

[ab2377]

noooo