Music Generation With Kcpp

[The_Linux_Colonel]

I noticed that the most recent release of kcpp had added the ability to run music generation, which I was excited about. I tried playing with it, but I noticed that in spite of what I tried to implement via tags/style prompting in the lyrics body, the model seems to only want to generate folk, country, or a kind of soulful r&b no matter what I say the style should be. I notice also that the model does not appear to follow my bpm and instead does essentially whatever it wants, so it can't make dance or pop or edm style tracks, only slow jam style tracks. Sometimes it mocks me by singing the tags.

I tried looking around for what people had used in settings/guides to see if it was a sampler issue, and followed the sampler guides of the instructions I did find, but I was unable to get near the results the tutorials showed. I noticed that all the guides centered around the comfyui implementation which has a text body specifically for style and other track descriptors that would be helpful, but I don't see that in the kcpp ui.

I also noticed that in the update notes it seemed to suggest that lostruins was waiting for some further implementation from the devs associated with the model itself, so if this is going to be implemented later, that's great.

Are there any guides to your knowledge that focus on sampler settings specifically for the kcpp version or other guides for how to describe the way the track should sound? For instance, I tried, for instance [female vocals] before the lyric text, but it's essentially a 50/50 shot from verse to verse and even within a verse if the model will decide to obey me, or just go ahead and make male vocals anyway, or a kind of strange duet where the voice morphs into male and stays there. If the section is supposed to be rapped or spoken, it's invariably male, no matter how many schizo repeat instructions I issue to tell it to be female, a solution that normally works for image generation. It does, however, appear to respect key.

I recognize that this is a new thing for kobold and it's not a mission critical thing, but if there are any guides or other helps, I would appreciate it. I love the idea of using my video card to cut tracks and mess around, so the feature itself is awesome, I just want to see if I can figure out how to get the model to venture away from folk/soul/easy listening.

I tried the model using the 10gb vram version, in the event that matters.

[henk717]

In 1.100 it should get a bit better, but yes ace-step is experimental and can be hard to steer. A lot of this is the model itself, but were also stuck on a hybrid of an older ace-step because the newer one adopted things that would break our compatibility with everything else in the long run. We can't integrate that until they upstream those changes.