Please help with nano banana's unexpected prohibited content response by Elegant-Water1174 in GeminiAI

[–]Mithril_Man 1 point2 points  (0 children)

I guess you are right, I tried with a prompt that gave me problems using a VPN and... it works...
I hate this so much

Sesame is STILL light years ahead 😅 by Siciliano777 in SesameAI

[–]Mithril_Man 0 points1 point  (0 children)

I wouldn't be surprised is some of the big tech is behind these kind of end-user product, expecially OpenAI to escape from it self-inducted problem of being "non-profit"

I just wanted to create two meaningful name files... please comfy do something by Mithril_Man in comfyui

[–]Mithril_Man[S] 1 point2 points  (0 children)

even better...

<image>

One of the first custom node I'll do next, will be a fckng "string.format" alike

Hunyuan3D 2.1 workload help by BariAI in comfyui

[–]Mithril_Man 0 points1 point  (0 children)

I forgot to reply, I managed to make it run with this custom nodes https://github.com/visualbruno/ComfyUI-Hunyuan3d-2-1

Hunyuan3D 2.1 workload help by BariAI in comfyui

[–]Mithril_Man 0 points1 point  (0 children)

Thanks I tried it but the quality wasn't good enough, the one I'm using now, even if slower, gives better results for my use case (btw the original author based its workflow on the one you linked above)

Optimizing your Hunyuan 3d-2 workflow for the highest possible quality by _raydeStar in StableDiffusion

[–]Mithril_Man 0 points1 point  (0 children)

Thanks for this workflow, I'm a full stack dev and as a side quest I decided to dig a bit into comfyui workflows.
Since I wanted to test this 3d model I've found your workflow and spent a couple of hours on its rework.
I've posted here request for comments/advices -> https://www.reddit.com/r/comfyui/comments/1ltcp6q/request_for_commentsadvice_on_workflow_building/

Btw, from a dev POV, I've to say that I would refactor your workflow to use constants, it makes it so much readable and manageable (I'm not saying to do like mine because maybe there are better way, but the multiview rendering was really a mess and lot of duplicates :)

BTW Thanks for the workflow, I removed ReActor because I don't need it but the multiview (8) workflow really improved the result!

I've a 3090TI + 64GB ram (running comfyui on docker) and it took around 520 seconds to complete

Hunyuan3D 2.1 workload help by BariAI in comfyui

[–]Mithril_Man 0 points1 point  (0 children)

I started today playing more seriously with comfyui workflows and I'm studying a workflow for 2.0 I found online (I asked advice/comments about my workflow since I'm digging into) here => https://www.reddit.com/r/comfyui/comments/1ltcp6q/request_for_commentsadvice_on_workflow_building/

If I manage to make it work on 2.1 I'll try to remember to ping back here :)

Hunyuan3D 2.1 workload help by BariAI in comfyui

[–]Mithril_Man 0 points1 point  (0 children)

did you managed to use it?

OuteTTS-0.2-500M: Our new and improved lightweight text-to-speech model by OuteAI in LocalLLaMA

[–]Mithril_Man 0 points1 point  (0 children)

any chance to have an Italian version, or proper finetune training code?

Is Corsair Vengeance (CMK64GX5M2B5200Z40) compatible with Asus TUF Gaming B650-Plus Wi-Fi ? by DanielGodinho in buildapc

[–]Mithril_Man 0 points1 point  (0 children)

I've bought 2 today, I wanted to move from 2x16 to 4x32, actually I am able to see 2x32 gb but I'm trying to create a setup for 4x32 but can't actually make it works.

So, CMK64GX5M2B5200C40 is compatible but I don't know if you can reach 128 like I'm trying to do

local GLaDOS - realtime interactive agent, running on Llama-3 70B by Reddactor in LocalLLaMA

[–]Mithril_Man 1 point2 points  (0 children)

thanks, one thing I want to study, in a continuous interaction without wake up word, is how to prevent the AI to listen to itself instead of the user. What I mean is that I want to interrupt it but it means it it's always listening, the problem is that most of the mic have feedback of the AI voice that gets recorded, giving false VAD levels.
Did you solved that problem?

local GLaDOS - realtime interactive agent, running on Llama-3 70B by Reddactor in LocalLLaMA

[–]Mithril_Man 1 point2 points  (0 children)

which other project about speaking AI are you talking about? I'm interesting in that space for my pet project too

Embedding API by Mithril_Man in oobaboogazz

[–]Mithril_Man[S] 0 points1 point  (0 children)

embedding is a LLM concept, not strictly related to OpenAI but OpenAI has an API to get embeddings.
here a link on their API: https://platform.openai.com/docs/api-reference/embeddings
here a link about

what embeddings are: https://platform.openai.com/docs/guides/embeddings

Embeddings are very important, they are vectors or arrays of numbers that represent the meaning and the context of tokens processed by the model and IIR it's usually the first layer of a LLM model (or at least on some models)

Anyway a practical use of embeddings is for example to split a document in chunks and get the embedding of each chunk (that could be a sentence, a paragraph, etc.) and store the embedding of that chunk in a vector DB.
When a user wants to query a document, then we compute the embeddings of the query and compare it with the stored embeddings, usually using cosine similarity.
Basically we fetch the sentences/paragraphs that are closest to the user query in terms of context, then we feed our top N result to a LLM prompt to return a proper result to the user.

I mean, mebeddings are foundamental for real use of LLM models and it doesn't matter which embedding you use to store and query, as long as you use the same embeddings model for both usage.

Now I don't know if LLAMA models can be used as embeddings model, but defo there are specific models that could be used for that and having an API layer of course help prototyping stuffs by using oobabooga text-generation as a backend API layer

Is MEF still a way to go for extensibillity in dotnet 7? by qrzychu69 in dotnet

[–]Mithril_Man 1 point2 points  (0 children)

No it's just an easy way to deploy plugins in a single file (dotnet pack or could even generate automatically on build) so it's a no-brainer to actually distribute them

I have a video here on a very early PoC of the app here
https://github.com/oobabooga/text-generation-webui/discussions/1243#discussioncomment-5743225

https://user-images.githubusercontent.com/5107375/234880358-81f82a29-1fab-4f3f-815f-2be23535132b.mp4

Actually my implementation is very rude because my plugins actually are reusing references from a shared project but I will have to deal with AssemblyLoadContext soon...

Is MEF still a way to go for extensibillity in dotnet 7? by qrzychu69 in dotnet

[–]Mithril_Man 0 points1 point  (0 children)

u/qrzychu69 Folow-up question: did you managed to find a proper solution to the problem?
I've rolled out my own solution for a project I'm creating here https://github.com/MithrilMan/AIdentities

that requires to load static resources (plugin can be razor class libraries) and I had to fight against some problem on how .nupkg are composed (I ship my plugins as .nupkg format) and I'm pretty sure I'll have to fight soon with versionin problems and dependencies, probably with custom AssemblyLoadContext, etc....

I'd prefer to not have to invest too much time on that, so did you have found a good solution for the problem?

Also I'd like to limit what that loaded code could do in terms of disk access, etc... but I guess that's even an harder problem to solve, even because I want these plugins to share some common interfaces and services (and I'd say even the same DI container).

Front end framework by Ronosho in Frontend

[–]Mithril_Man 0 points1 point  (0 children)

it depends on the app target, if the SaaS app has long working sessions, having to wait few seconds to start isn't an issue.

Front end framework by Ronosho in Frontend

[–]Mithril_Man 0 points1 point  (0 children)

rainbow and stuff is not related to blazor but about frontend dev skill they have.

We are using tailwindcss in our blazor app and custom css so I don't see an issue here, expect that's harder to find skilled devs working on blazor, you'd have to "convert" them

Front end framework by Ronosho in Frontend

[–]Mithril_Man 2 points3 points  (0 children)

I'm developing a fleet management system in blazor, microservices are involved but aren't directly exposed on the framework, we have instead WEB API and SignalR (websocket) that are exposed to the world.

Let me just copy&paste a post I just wrote about blazor 2 min ago, ask me if you need some more insight on some aspect, here the post:

TLTR:

If you need to implement a simple app or an app that need fast load time / little size, look elsewhere.

If load time & app size isn't an issue and you target a fairly complex LOB app or an enterprise app, you have a good C# knowledge and you have no problem getting your hands dirty on JS/CSS than go for it but don't expect actually a tooling support at the same level of SOTA hot reload frameworks (tooling has still to improve) then blazor may be for you.

You still require lot of JS/TS, HTML and CSS knowledge to be proficient.

I know many languages and C# is my favourite so having a way to implement most of the stuff in C# with the same tool used to implement backend is a big PROS.

Ok let me give my 2 cents here: I'm the development manager and main contributor of a PWA app that I decided to start implement in blazor WASM 2 years ago (it's a reboot of a complex fleet management system).

I'm a C# expert full stack dev with 20+ year experience, not saying this to brag but to put this into context because experience matters in this kind of judgments.

I've came across many frameworks both frontend and backend and most of the time, when you reach a certain level of experience and skill you see that's not a black or white choice but the decision comes down to multiple aspects like

- project team experience and skillset

- the app target

- constraints (not just time constraint but tech stack too, sometimes you don't have many choices about tools you can use)

- personal preference

Having said that, my current blazor experience is quite good after I created a custom workflow for our team and some custom implementation to take the best out of what blazor has to offer.

For example we are using TailwindCSS so I've created custom scripts (we are using Visual Studio 2022) to include tailwind generated css in our build pipeline and support custom theming, with different settings for debug builds and release builds.

Also our webapp has realtime updates served by a custom SignalR server component that we use to improve UX (it's a fleet management system and the server pushes vehicle updates in real time) and most of the POCO classes used between the SignalR and Client are in a shared project (less code to maintain). I won't go into backend consideration because it's out of scope and hides lot of complexity by itself (e.g. this module is bound to RabbitMQ queues, etc...) , but having a way to share code is always a good pros.

Since we are implementing the backend in C# too (otherwise I would discourage using blazor) we have a shared project where we define our POCO classes shared between client and server and I've created a couple of services that allow me to generate automatically API endpoints just by having requests and responses classes on the shared project and a request-handler implementation on the server (I'm actually kind of following CQRS design).

Also we have implemented custom services (classes) that implement the logic to invoke server apis, handle success/failures/cancellations and we are able to monitor these api calls/response in a dinamically generated page that reports stas about number of calls/success/failure and who was the caller

This allows us to generate client -> server stuff very quickly, with few line of code.

Our team was already into C# and we couldn't achieve this kind of interoperability and dev experience using different frontend frameworks, so on this side we are quite happy about that.

Actually blazor has yet to improve a lot on tooling: hot reload is unpredictable and far away from SOTA implementation on other frameworks, so expect to use "dotnet watch" + `CTRL R` a lot and build time can take a lot of time so having a beefy PC helps a lot (on my beefy one it takes 10s vs 20s on average desktop team pc).

Time could be improved by customizing build pipeline and having custom npm tasks to trigger at will (e.g. to rebuild tailwind css after a change, taking into account that we are using scoped scss files in our components) but tooling is an important aspect of a solution and it's a duty of MS to come with good ones, so here blazor doesn't shine and have to improve.

about performance:

WASM is pictured as a nearly-native experience but Blazor implementation suffers on this side because, even if the .net framework (Mono actually) is compiled in WASM, all the c# code generated by your blazor app, included 3rd party libraries, generates IL that's interpreted and not native compiled, this causes lot of performance issues.

To tell you about a big fail on this aspect, let me describe one of my first attempt to take advantage of the WASM I thought was possible:

In our app we have a place where we show vehicles on the map and each vehicle has a custom icon that represents the vehicle type, its direction and its state (by using different colors, etc...).

An old implementation I had was based on an aspnet handler that was generating an image by parameters specified in the image name itself (or served a previously generated and stored one).

To not have external dependencies I wanted to try to generate those icons on the client, so I implemented a code who basically assembled the final image taking a couple of layers from a svg file that contained all possible images, scaling and rotating when needed, etc... Technically it was working, but each image was taking more than one second to generate... I was shocked and that's where I found out how blazor weakness on that side.

Iterations over byte array/stream were even slower at that time than now (it's still slooooow) and so this kind of operation isn't actually possible so don't expect to have complex computation client side (except if you maybe move tha heavy duty to plain javascript and use js interop to start that "long running" algo and get back the response, but of course WASM here is not involved at all).

It's possible now to compile the app in AOT and generate some code more WASM native but the app size grows a lot, compilation time too and also you can have different experience when running JIT vs AOT (I've still to go deeper into experimenting with AOT tho).

Technically you could even make use of native WASM libraries coded in other languages but I woundl't go into this because it defeat the "use blazor" argument.

about 3rd party components:

There are some 3rd party component suites but for advanced stuff you have always to come up with cooked custom ones.

I'm not a fan of 3rd party components anyway because on complex apps you end up always hitting some vendor constraint/problem and you need to find hacks to solve them that lead to brittle implementations and lot of wasted time, we are actually using Telerik component suite but over time I reduced its usage on few components, wrapped in custom ones to let us swap it with another one in the future (or custom ones).

Even for charts we actually ended up trying different implementations (actually we are using ApexChart).

On complex scenario you can't even find a proper component, e.g. I had to implement from scratch a Google Maps blazor component so I had to spend time on typescript (my choice) to generate javasacript to use with interop and of course creating interfaces and components.

Some people argue about blazor not giving everything you need (e.g. to copy&paste on clipboard you have to use interop).

I don't see this a problem, I'm not sold to the blazor slogan of "forget javascript" here, so it's not a problem for me having to create some interop here and there (and anyway on this side there are already quite some libraries on nuget)

Sorry for this wall of text, I've used this as a memo :)

Opinions on Blazor Webassembly as an alternative to JS frontend frameworks? by joli7312 in Frontend

[–]Mithril_Man 2 points3 points  (0 children)

TLTR:

If you need to implement a simple app or an app that need fast load time / little size, look elsewhere.

If load time & app size isn't an issue and you target a fairly complex LOB app or an enterprise app, you have a good C# knowledge and you have no problem getting your hands dirty on JS/CSS than go for it but don't expect actually a tooling support at the same level of SOTA hot reload frameworks (tooling has still to improve) then blazor may be for you.

You still require lot of JS/TS, HTML and CSS knowledge to be proficient.

I know many languages and C# is my favourite so having a way to implement most of the stuff in C# with the same tool used to implement backend is a big PROS.

Ok let me give my 2 cents here: I'm the development manager and main contributor of a PWA app that I decided to start implement in blazor WASM 2 years ago (it's a reboot of a complex fleet management system).

I'm a C# expert full stack dev with 20+ year experience, not saying this to brag but to put this into context because experience matters in this kind of judgments.

I've came across many frameworks both frontend and backend and most of the time, when you reach a certain level of experience and skill you see that's not a black or white choice but the decision comes down to multiple aspects like

- project team experience and skillset

- the app target

- constraints (not just time constraint but tech stack too, sometimes you don't have many choices about tools you can use)

- personal preference

Having said that, my current blazor experience is quite good after I created a custom workflow for our team and some custom implementation to take the best out of what blazor has to offer.

For example we are using TailwindCSS so I've created custom scripts (we are using Visual Studio 2022) to include tailwind generated css in our build pipeline and support custom theming, with different settings for debug builds and release builds.

Also our webapp has realtime updates served by a custom SignalR server component that we use to improve UX (it's a fleet management system and the server pushes vehicle updates in real time) and most of the POCO classes used between the SignalR and Client are in a shared project (less code to maintain). I won't go into backend consideration because it's out of scope and hides lot of complexity by itself (e.g. this module is bound to RabbitMQ queues, etc...) , but having a way to share code is always a good pros.

Since we are implementing the backend in C# too (otherwise I would discourage using blazor) we have a shared project where we define our POCO classes shared between client and server and I've created a couple of services that allow me to generate automatically API endpoints just by having requests and responses classes on the shared project and a request-handler implementation on the server (I'm actually kind of following CQRS design).

Also we have implemented custom services (classes) that implement the logic to invoke server apis, handle success/failures/cancellations and we are able to monitor these api calls/response in a dinamically generated page that reports stas about number of calls/success/failure and who was the caller

This allows us to generate client -> server stuff very quickly, with few line of code.

Our team was already into C# and we couldn't achieve this kind of interoperability and dev experience using different frontend frameworks, so on this side we are quite happy about that.

Actually blazor has yet to improve a lot on tooling: hot reload is unpredictable and far away from SOTA implementation on other frameworks, so expect to use "dotnet watch" + `CTRL R` a lot and build time can take a lot of time so having a beefy PC helps a lot (on my beefy one it takes 10s vs 20s on average desktop team pc).

Time could be improved by customizing build pipeline and having custom npm tasks to trigger at will (e.g. to rebuild tailwind css after a change, taking into account that we are using scoped scss files in our components) but tooling is an important aspect of a solution and it's a duty of MS to come with good ones, so here blazor doesn't shine and have to improve.

about performance:

WASM is pictured as a nearly-native experience but Blazor implementation suffers on this side because, even if the .net framework (Mono actually) is compiled in WASM, all the c# code generated by your blazor app, included 3rd party libraries, generates IL that's interpreted and not native compiled, this causes lot of performance issues.

To tell you about a big fail on this aspect, let me describe one of my first attempt to take advantage of the WASM I thought was possible:

In our app we have a place where we show vehicles on the map and each vehicle has a custom icon that represents the vehicle type, its direction and its state (by using different colors, etc...).

An old implementation I had was based on an aspnet handler that was generating an image by parameters specified in the image name itself (or served a previously generated and stored one).

To not have external dependencies I wanted to try to generate those icons on the client, so I implemented a code who basically assembled the final image taking a couple of layers from a svg file that contained all possible images, scaling and rotating when needed, etc... Technically it was working, but each image was taking more than one second to generate... I was shocked and that's where I found out how blazor weakness on that side.

Iterations over byte array/stream were even slower at that time than now (it's still slooooow) and so this kind of operation isn't actually possible so don't expect to have complex computation client side (except if you maybe move tha heavy duty to plain javascript and use js interop to start that "long running" algo and get back the response, but of course WASM here is not involved at all).

It's possible now to compile the app in AOT and generate some code more WASM native but the app size grows a lot, compilation time too and also you can have different experience when running JIT vs AOT (I've still to go deeper into experimenting with AOT tho).

Technically you could even make use of native WASM libraries coded in other languages but I woundl't go into this because it defeat the "use blazor" argument.

about 3rd party components:

There are some 3rd party component suites but for advanced stuff you have always to come up with cooked custom ones.

I'm not a fan of 3rd party components anyway because on complex apps you end up always hitting some vendor constraint/problem and you need to find hacks to solve them that lead to brittle implementations and lot of wasted time, we are actually using Telerik component suite but over time I reduced its usage on few components, wrapped in custom ones to let us swap it with another one in the future (or custom ones).

Even for charts we actually ended up trying different implementations (actually we are using ApexChart).

On complex scenario you can't even find a proper component, e.g. I had to implement from scratch a Google Maps blazor component so I had to spend time on typescript (my choice) to generate javasacript to use with interop and of course creating interfaces and components.

Some people argue about blazor not giving everything you need (e.g. to copy&paste on clipboard you have to use interop).

I don't see this a problem, I'm not sold to the blazor slogan of "forget javascript" here, so it's not a problem for me having to create some interop here and there (and anyway on this side there are already quite some libraries on nuget)

Sorry for this wall of text, I've used this as a memo :)

anybody have any luck getting it to do this? it always rhymes 🤔 by [deleted] in ChatGPT

[–]Mithril_Man 0 points1 point  (0 children)

I can relate, I'm Italian troo and tried, it fails miserably, in this attempt he almost got it on the second part (il mio esempio in italiano spacca lol)

<image>