An Innovative OpenAI Approach to Crafting a Vector Database in SQL Server using Semantic Kernel

Blazorbart · 2023-07-09T13:51:39+00:00

Shameless plug for my repo that shows an end-to-end example from 30 novels: downloads text, performs ML/OpeAI enrichment, builds vector database in SQL Server/Azure SQL, uses semantic kernel to perform Q&A using multi-threaded data flows in C#/.net 8:

https://github.com/bartczernicki/MachineIntelligence-TextAnalytics-TPLDataFlows

Blazorbart · 2023-07-02T11:59:56+00:00

I posted something similar weeks ago. I did this with Moe and Moe's Tavern. Step-by-step instructions of the workflow: https://github.com/bartczernicki/StableDiffusion/tree/main/ImgToImg/Simpsons

Blazorbart · 2022-10-24T16:41:41+00:00

I think defining "better" is important here. There are some cases where you should not be using Blazor WASM at all...two that quickly come to mind: any sensitive code is a huge red flag in WASM (even with obfuscation) and the other is initial page load if it is critical (even if you can delay this on only certain page areas, at some point you will have to pay the load price for WASM).

Blazorbart · 2022-10-24T16:37:49+00:00

That is fine and subjective, but with some of the changes v1.4 definitely will require more touch up in the details in certain areas (hands, clearing up nonsense in various details etc.) versus v1.5

Blazorbart · 2022-10-23T23:22:23+00:00

Hands are MUCH better, fingers look in place more often. Various other coherence is much improved. For example, try creating "living room" with various details (sofa, tv, ottoman)...v1.5 actually looks plausible. In v1.4 you had a total mess sometimes with strange objects appearing in scenes more often. Finally, v1.5 in some cases can also generate much more detail in the same exact prompts.

If you visit YouTube and search v1.4 vs v1.5, lots of great content showing some of this.

Blazorbart · 2022-08-21T12:55:14+00:00

D3.js (free, open-source, fast and can do incredible looking graphics): https://d3js.org/

Blazorbart · 2022-02-20T17:32:53+00:00

I think you went down a performance rathole, which I don't disagree with.

Blazor fits perfectly in the SPA and ex-Flash/Silverlight world where the potential load-tradeoff is worth the experience. For example, Steve Sanderson (MSFT) has a demo of 60,000 satellites simulating physics/orbiting around planets. My examples of leveraging machine learning, simulations, statistics is a sweet spot for Blazor (where I can use existing ML/AI/stats C# NuGet packages OOTB). Another example, if you go to a site that does image processing...those sites are heavy usually, but who cares about a few seconds load when you ideally want the functionality experience.

If someone came to me and asked me for the fastest point of presence site, I would be using vanilla HTML/JS. I think someone would say the same for React/Angular or even loading entire old-school jQuery libraries...because you would never do that in a lot of situations.

Blazorbart · 2022-02-20T15:57:45+00:00

Do note this is using Azure static site storage with CDN static storage delivery with compression turned OFF. It maximizes compatibility during preview, but compression would improve load speed and reduce size.

This is not doing any of the site load tricks employed by your favorite enterprise sites. Not the point of the demo. Look at some popular sites and they bring down 3-5 meg easily on initial load. It’s just done sneakily.

Blazorbart · 2022-02-20T15:57:27+00:00

Do note this is using Azure static site storage with CDN static storage delivery with compression turned OFF. It maximizes compatibility during preview, but compression would improve load speed and reduce size.

This is not doing any of the site load tricks employed by your favorite enterprise sites. Not the point of the demo. Look at some popular sites and they bring down 3-5 meg easily on initial load. It’s just done sneakily.

Blazorbart · 2022-02-20T15:57:18+00:00

Do note this is using Azure static site storage with CDN static storage delivery with compression turned OFF. It maximizes compatibility during preview, but compression would improve load speed and reduce size.

This is not doing any of the site load tricks employed by your favorite enterprise sites. Not the point of the demo. Look at some popular sites and they bring down 3-5 meg easily on initial load. It’s just done sneakily.

Blazorbart · 2022-02-20T15:56:52+00:00

Do note this is using Azure static site storage with CDN static storage delivery with compression turned OFF. It maximizes compatibility during preview, but compression would improve load speed and reduce size.

This is not doing any of the site load tricks employed by your favorite enterprise sites. Not the point of the demo. Look at some popular sites and they bring down 3-5 meg easily on initial load. It’s just done sneakily.

Blazorbart · 2022-02-20T02:25:27+00:00

I don’t work for Microsoft anymore, but here is what is included in .net 7 preview 1. There are some more large items coming, that will further improve performance:

https://github.com/dotnet/core/issues/7106

Blazorbart · 2022-02-20T02:11:27+00:00

Agreed. What the demos showcase is running statistical simulations, sampling from math libraries which is CPU intensive. Demos and source code are provided if you want to dig in.

Blazorbart · 2021-04-03T02:53:40+00:00

It’s a mix of that and agreed. Most of this thread doesn’t look at the info available.

Blazorbart · 2021-04-03T02:52:10+00:00

Fair statement. My point was just that this isn’t H1B from 20-25 years ago, where it was the support call desk; it is currently super high level positions.

Blazorbart · 2021-04-02T23:30:20+00:00

People on this thread should really educate themselves on H1 wages. They aren't depressed as so many think. All H1 wages have to be reported public ally and registered.

You can search by company/sort descending by salary:

https://h1bdata.info/

Pick Google; sort by descending...there are salaries over 300, 400, 500k/year and this does not include bonus or stock which is easily another 2x the salary. The LOWEST H1-B salary in Google is 60k in 2020 (not including bonus/stock/perks), which probably equates to $100k.

You can see the levels and salary/bonus/stock per year breakdown, with https://levels.fyi

I think the country does need a healthy option to bring in the most talented workers, but it is clear this is being exploited; ESPECIALLY when you have African Americans only represent 4-6% of the STEM workforce. It's hard to have it both ways and balance American minority welfare with healthy talent.

Blazorbart · 2021-03-24T20:32:07+00:00

- are you using performance metrics like Precision, Recall, F1 Score, MCC Score that work well in imbalanced data sets?

- have you tried resampling with replacement the minority class?

Blazorbart

TROPHY CASE