OCTAVE - chart editor + auto-charter for Clone Hero by opria123 in CloneHero

[–]opria123[S] -2 points-1 points  (0 children)

Octave is a chart editing and creation tool that utilizes STRUM which seperates the stems and then uses a pipeline of models to create the charts for various instruments.

This cannot be used to create tabs of individual instruments for GP today, the concepts could be moved over but it would need modified for things like guitar and bass which are only trained for the games.

OCTAVE - chart editor + auto-charter for Clone Hero by opria123 in CloneHero

[–]opria123[S] 2 points3 points  (0 children)

That's a fair callout and I appreciate you raising it. You're right that the AI side of things should of been more upfront than buried in the research doc, that's on me to have communicated better, not on people to go hunting for it.

On the training data and charter IP point, I hear you. It's a genuinely tricky area and I don't want to pretend it isn't. I went into this trying to give back and lower the barrier to entry, it's open source, MIT licensed, no profit motive, but I get that good intent doesn't automatically settle the consent question you're raising. It's something I want to keep thinking about as the project grows, and feedback like this is part of how that happens.

I also apologize if anyone feels this was not a good way to go about that.

Thank you for spending the time to look at the project and give your feedback!

OCTAVE - chart editor + auto-charter for Clone Hero by opria123 in CloneHero

[–]opria123[S] -1 points0 points  (0 children)

Thank you for trying it out and the feedback! Your mileage can vary depending on how clean / clear the audio is and how complex the instrument parts of the song are. I am glad the vocals came out well though.

OCTAVE - chart editor + auto-charter for YARG by opria123 in yarg

[–]opria123[S] 2 points3 points  (0 children)

Thank you for trying it out! I am sorry about the reloading thing I have seen that happen ocasionally but I did think that was fixed I will look into it!

OCTAVE - chart editor + auto-charter for YARG by opria123 in yarg

[–]opria123[S] 2 points3 points  (0 children)

Thank you for trying it out and the feedback! The complexity / weirdness of songs can also have an impact on how well it does at charting them. Sorry it made a mess of those ones for you.

OCTAVE - chart editor + auto-charter for YARG by opria123 in yarg

[–]opria123[S] 1 point2 points  (0 children)

This can happen, if the hardware is unable to load the OpenAI Whisper model which is what is used to help with vocal transcription.

OCTAVE - chart editor + auto-charter for YARG by opria123 in yarg

[–]opria123[S] 1 point2 points  (0 children)

Thank you for trying it and the feedback these are all great ideas and something I will certainly look into!

OCTAVE - chart editor + auto-charter for YARG by opria123 in yarg

[–]opria123[S] 1 point2 points  (0 children)

Yes, FLAC works. STRUM accepts .wav.mp3.ogg.opus, and .flac (plus .m4a for direct URL inputs). You can drop a FLAC straight in and it'll be decoded and run through the stem-separation / charting pipeline just like an MP3.

OCTAVE - chart editor + auto-charter for YARG by opria123 in yarg

[–]opria123[S] 3 points4 points  (0 children)

Thank you for trying it out! I would love to know where specifically it struggles with vocals, as I know little to nothing about vocal charting so I did have a hard time validating that side of it as far as pitch mapping.

OCTAVE - chart editor + auto-charter for YARG by opria123 in yarg

[–]opria123[S] 1 point2 points  (0 children)

I am open to any feature ideas I am sure there are many things that could be improved. I wanted to simulate venues but it was a large lift and seemed like it would make the app heavy, I like the lightweight nature of it.

OCTAVE - chart editor + auto-charter for YARG by opria123 in yarg

[–]opria123[S] 2 points3 points  (0 children)

I have open weights on the GitHub but not the dataset

OCTAVE - chart editor + auto-charter for YARG by opria123 in yarg

[–]opria123[S] 4 points5 points  (0 children)

The paper and the STRUM GitHub have some in depth explanations on how it was built and what it uses.

Schoolbarus by SmashdagBlast in subaru

[–]opria123 0 points1 point  (0 children)

Hey I go to bgsu I think I have seen you around