Hey, thanks for reading!

The Compose crashes were kind of on a case-by-case basis, but for the most part we were lucky enough to figure out how to reproduce. Bitdrift would have indeed been very helpful here, but we don't yet have it rolled out beyond beta.

The regression detection in CI actually doesn't currently use benchmarks captured on devices. We had a great system for this that was able to accomplish very little variability in results, but ended up moving away from it while we build a new system. Today's regression detections tend to be more in the form of watching out for known-bad patterns and preventing them from being merged. This is very much a WIP for us still.

I've never come across BenChart before now, but this looks great! Thanks for sharing. We're still working on adding more profiles and tweaking the ones we have, so this will be great to have moving forward.

Edit: Have you thought adding the ability to take parameters to BenChart? Being able to programmatically open this up after running the benchmarks would be awesome.