I saw some new flakiness with codecov this morning which I wanted to report in hopes of getting it fixed either in codecov or in a workaround on our end.
This morning codecov was reporting a large drop in reported code coverage in the GitHub status check for our
windows flag for one of our PRs. All CI builds successfully uploaded coverage data which did not show a large drop in coverage.
I reran CI which caused a new set of coverage reports to be uploaded and the status check passed. The reported coverage between the first and second CI run are identical. Any idea what may have happened?
You can see the builds for the commit at https://codecov.io/gh/certbot/certbot/commit/ba31a111bf924b409933097ba4395a41b93da2e6/build.