In the past week the code coverage reported by codecov for one of my Python projects dropped. The results do not match those observed by using Python’s “coverage” package directly. What’s more, some of the lines reported as uncovered are blank lines or comments!
An example of a comment line reported as “uncovered”:
And a bunch more here:
(this file has 6 missing lines according to “coverage”, 17 according to codecov)
Steps to Reproduce
- Run the test suite
- Observe the results
Expected behavior: Blank or comment lines should not appear “uncovered”
Actual behavior: codecov reports spurious uncovered lines
Flakiness? This is fully reproducible.
The tests are run using Travis CI, and Python 3.6, 3.7 and pypy3.