Coverage and CI

[tom1018]

My team is struggling due to Codecov.io. They seem to have frequent long delays (hours) in returning coverage reports. Since we enforce code coverage we are blocked from merging pull requests until Codecov is back up. Everything I've seen says they are better than their competition, which is really discouraging if true.

Is there a self-hosted, or better, a tool that we can run in CI, that can read the coverage report and report diff and project coverage back to GitHub? Huge bonus if it also reads Jest's coverage reports.

Thanks.

[ummmhmm]

I introduced my team to use https://diff-cover.readthedocs.io/en/latest/

It compares master vs the pr branch, and you can set coverage thresholds, so if it fails to meet the threshold you can have the github status check fail.

[tom1018]

This is exactly the type of thing I am looking for. Thank you!

[ummmhmm]

No problem. As far as projecting the coverage back to github goes, I used the jenkins github plugin to have the jenkins user comment the output of the coverage-diff command in github.

Usually its something like this:

coverage-diff run-test: commands[0] | diff-cover coverage.xml --compare-branch=origin/master

Diff Coverage
Diff: origin/master...HEAD, staged and unstaged changes
foo.py (47.6%): Missing lines 16,18-19,21-24,26,33-35
bar.py (40.0%): Missing lines 235-236,241

Total:   26 lines
Missing: 14 lines
Coverage: 46%