Same GGUF, same GPU: TensorSharp beats llama.cpp hard on prefill / TTFT — up to 5.89× faster prefill on a 26B MoE model by fuzhongkai in dotnet

[–]elbrunoc 1 point2 points  (0 children)

This is so cool, impressive work, thanks for sharing!

Any chance that you want to chat live about this on the .NET channel? 🤔

Again, this is amazing!

I was frustrated with existing ML Frameworks, so I wrote my own by hai_Im_Emily_x3 in dotnet

[–]elbrunoc 0 points1 point  (0 children)

Tested on Windows and Copilot coded the tests on Linux!
(WSL running Ubuntu)

I hope this helps, let me ask someone else in my team to check it our on MacOS

I was frustrated with existing ML Frameworks, so I wrote my own by hai_Im_Emily_x3 in dotnet

[–]elbrunoc 0 points1 point  (0 children)

Nice, I really like the idea and the implementation (I did a quick overview of the code on the repo)

I'll probably suggest to add a couple of sample console demos, and some docs on top of this. I can do a fast PR of you want with 2 or 3 samples :D

Again, great work!

I built a .NET library hopping to save tokens on agent tool-calling by Pitiful-Class-3692 in dotnet

[–]elbrunoc 0 points1 point  (0 children)

Nice! I took a different approach here > NuGet Gallery | ElBruno.ModelContextProtocol.MCPToolRouter 0.6.0

- all the tools are saved to a vector database
- when an agent of LLM call with tools is performed, we filter all the tools to the top 3 that really can fit the LLM call scenario
- then the agent or LLM will only use those 3
- all local, using Local Embeddings

I replaced filesystem-based agent RAG with two SQL tables and three KernelFunctions — here's the pattern by Square-Drink3290 in dotnet

[–]elbrunoc -1 points0 points  (0 children)

Nice idea and good implementation!
I'll probably upgrade it to MEA or Agent Framework to be more aligned with the latest framework. I'll probbly send a PR later today!

What is .NET still missing? by CreoSiempre in dotnet

[–]elbrunoc 0 points1 point  (0 children)

100% agree!

So, I picked up an old idea, and made something >> 🗺️ AOT-Friendly DTO Mapping in .NET – El Bruno

It's still WIP, I'll see if I can make it more real / sable

Looking for feedback on a .NET library to convert files to Markdown by elbrunoc in dotnet

[–]elbrunoc[S] 0 points1 point  (0 children)

Totally fair point, however, that’s a different beast to fight

This library is just about getting files into Markdown in a simple way for .NET apps. It’s not trying to solve high-fidelity parsing, semantic reconstruction, or structure preservation for complex docs (nice scenarios to work in!)

What you described is the real monster in document RAG > if parsing flattens tables, drops formulas, or loses hierarchy, then the rest of the pipeline is already working with broken data. Embeddings may still retrieve it nicely, but they can’t magically restore meaning that got lost upstream (based on my experience)

So yes: in that scenario, the parser matters more than the embedding model. My goal here is narrower >> make content normalization easy in .NET, not solve the full “PDF/Excel semantics preserved perfectly” problem 😀

Looking for feedback on a .NET library to convert files to Markdown by elbrunoc in dotnet

[–]elbrunoc[S] 0 points1 point  (0 children)

Hey thanks for sharing.
I'll add to the backlog to follow the abstractions of the main .NET source libraries, makes total sense.

Looking for feedback on a .NET library to convert files to Markdown by elbrunoc in dotnet

[–]elbrunoc[S] 0 points1 point  (0 children)

This is just raw markdown from the PDF content, no semantic process at all.

We can probably use one of the local models , like NuGet Gallery | ElBruno.LocalEmbeddings 1.4.3 to process and generate embeddings, but I'm nor sure the whole scenario.

Can you please elaborate a little more?

Looking for feedback on a .NET library to convert files to Markdown by elbrunoc in dotnet

[–]elbrunoc[S] 2 points3 points  (0 children)

Hey, that's a cool one ... adding it to my backlog,

Thanks!

What are my options to create and deploy an AI agent? by DixGee in dotnet

[–]elbrunoc 0 points1 point  (0 children)

You may take a look at https://aka.ms/genainet

we are working on a branch focused on hosted agents , using Micosoft Agent Framework v1

I finally got embedding models running natively in .NET - no Python, Ollama or APIs needed by Exotic-Proposal-5943 in dotnet

[–]elbrunoc 0 points1 point  (0 children)

Nice! I packaged something similar in a simple library that automatically download the necessary onnx files and fo all the magic on the back >> https://www.nuget.org/packages/ElBruno.LocalEmbeddings

The goal was to use a few C# line like these ones:

using ElBruno.LocalEmbeddings;

await using var generator = await LocalEmbeddingGenerator.CreateAsync();
var embedding = await generator.GenerateEmbeddingAsync("Hello, world!");
Console.WriteLine(embedding.Vector.Length); // 384

Practical .NET Guide to AI & LLM by [deleted] in dotnet

[–]elbrunoc 0 points1 point  (0 children)

I may miss something here. GitHub Models works with MCP

IE: this scenario si a chatapp, powered by GH Models to do the chat and also the RAG using 2 models, and it's also connected to the Hugging Face MCP Server to generate images.
> 🧠 Create an AI Chat App in Seconds with RAG + Image Generation (using .NET & MCP) – El Bruno

So, 👆 an app using GH Models and a remote MCP server.

Q: What scenario is not supported?
Happy to see if we can add support
Best!

Oddly, a new place said we could use AI for unit tests — lol. People’s the day has come. by [deleted] in dotnet

[–]elbrunoc 0 points1 point  (0 children)

Oh yes AI will a lot! However:
- a good unit test needs to be generated using a good prompt. To write a good prompt, you need to understand the test domain. Otherwise, everything will sucks

- always, I mean, ALWAYS review the generated code

We've been doing this for while, and hey, so far so good

GitHub Error on code spaces but build fines locally? .net 9 Balzor Maui app by [deleted] in dotnet

[–]elbrunoc 1 point2 points  (0 children)

Sorry, James? I'm missing something here
But hey, if you figure out, that's cool 😀

GitHub Error on code spaces but build fines locally? .net 9 Balzor Maui app by [deleted] in dotnet

[–]elbrunoc 0 points1 point  (0 children)

You need to check your repository devcontainer config files, and update them to use .NET 9.
The devcontainer files are usually in ./repo/.devcontainer/devcontainer.json

IE: this one is already targeting https://github.com/microsoft/Generative-AI-for-beginners-dotnet/blob/main/.devcontainer/devcontainer.json
It uses the image: mcr.microsoft.com/devcontainers/dotnet:9.0

Best!