"No coverage information found on head" on Github, and no PR comment

Description

Code coverage reports are being uploaded correctly to codecove, the website shows what seems to be correct data/reports, BUT the github status check state “No coverage information found on head” and the PR comment isn’t being added.

What is most bizarre is that doing identical changes to a fork of the project performs as-expected, with PR comments being added promptly etc.

As suggested elsewhere, I have removed the codecov app and then re-added it but this has been without success.

Commit SHAs

e9372bef21515cf89a3b710c39b3b6eca720f0d1

Repository

CI/CD or Build URL

Github Actions – Fix surefire configuration to allow jacoco to run correctly on JSS tests by MysterAitch · Pull Request #3208 · javaparser/javaparser · GitHub

Uploader

Github Action

Codecov Output

Note that this is one of many uploads within the build matrix (27 in total:: JDK8-16 on ubuntu/mac/windows).

Run codecov/codecov-action@v1
  with:
    file: javaparser-symbol-solver-testing/target/site/jacoco/jacoco.xml
    fail_ci_if_error: false
    verbose: false
    flags: javaparser-symbol-solver,AlsoSlowTests,ubuntu-latest,jdk-8
    env_vars: OS,JDK
  env:
    OS: ubuntu-latest
    JDK: 8
    JAVA_HOME_8.0.282_x64: /opt/hostedtoolcache/jdk/8.0.282/x64
    JAVA_HOME: /opt/hostedtoolcache/jdk/8.0.282/x64
    JAVA_HOME_8_0_282_X64: /opt/hostedtoolcache/jdk/8.0.282/x64
/usr/bin/bash codecov.sh -n  -F javaparser-symbol-solver,AlsoSlowTests,ubuntu-latest,jdk-8 -Q github-action -e OS,JDK -f javaparser-symbol-solver-testing/target/site/jacoco/jacoco.xml -C e9372bef21515cf89a3b710c39b3b6eca720f0d1

  _____          _
 / ____|        | |
| |     ___   __| | ___  ___ _____   __
| |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
| |___| (_) | (_| |  __/ (_| (_) \ V /
 \_____\___/ \__,_|\___|\___\___/ \_/
                              Bash-20210309-2b87ace


==> git version 2.31.0 found
==> curl 7.68.0 (x86_64-pc-linux-gnu) libcurl/7.68.0 OpenSSL/1.1.1f zlib/1.2.11 brotli/1.0.7 libidn2/2.2.0 libpsl/0.21.0 (+libidn2/2.2.0) libssh/0.9.3/openssl/zlib nghttp2/1.40.0 librtmp/2.3
Release-Date: 2020-01-08
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtmp rtsp scp sftp smb smbs smtp smtps telnet tftp 
Features: AsynchDNS brotli GSS-API HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL TLS-SRP UnixSockets
==> GitHub Actions detected.
    Env vars used:
      -> GITHUB_ACTIONS:    true
      -> GITHUB_HEAD_REF:   re_enable_jacoco_on_jss
      -> GITHUB_REF:        refs/pull/3208/merge
      -> GITHUB_REPOSITORY: javaparser/javaparser
      -> GITHUB_RUN_ID:     692910328
      -> GITHUB_SHA:        f2864337d7f496c8a6d4460d8e35f9086dbfe196
      -> GITHUB_WORKFLOW:   Build and test (using maven)
    project root: .
    Yaml found at: codecov.yml
    -> Found 1 reports
==> Detecting git/mercurial file structure
==> Appending build variables
    + OS
    + JDK
==> Reading reports
    + javaparser-symbol-solver-testing/target/site/jacoco/jacoco.xml bytes=5518572
==> Appending adjustments
    https://docs.codecov.io/docs/fixing-reports
    -> No adjustments found
==> Gzipping contents
        340K	/tmp/codecov.H5FrLF.gz
==> Uploading reports
    url: https://codecov.io
    query: branch=re_enable_jacoco_on_jss&commit=e9372bef21515cf89a3b710c39b3b6eca720f0d1&build=692910328&build_url=http%3A%2F%2Fgithub.com%2Fjavaparser%2Fjavaparser%2Factions%2Fruns%2F692910328&name=&tag=&slug=javaparser%2Fjavaparser&service=github-actions&flags=javaparser-symbol-solver,AlsoSlowTests,ubuntu-latest,jdk-8&pr=3208&job=Build%20and%20test%20%28using%20maven%29&cmd_args=n,F,Q,e,f,C
->  Pinging Codecov
https://codecov.io/upload/v4?package=github-action-20210309-2b87ace&token=secret&branch=re_enable_jacoco_on_jss&commit=e9372bef21515cf89a3b710c39b3b6eca720f0d1&build=692910328&build_url=http%3A%2F%2Fgithub.com%2Fjavaparser%2Fjavaparser%2Factions%2Fruns%2F692910328&name=&tag=&slug=javaparser%2Fjavaparser&service=github-actions&flags=javaparser-symbol-solver,AlsoSlowTests,ubuntu-latest,jdk-8&pr=3208&job=Build%20and%20test%20%28using%20maven%29&cmd_args=n,F,Q,e,f,C
->  Uploading to
https://storage.googleapis.com/codecov/v4/raw/2021-03-27/1FEC948195A8431A51B39B2D25154F8B/e9372bef21515cf89a3b710c39b3b6eca720f0d1/9607eb02-3061-4aba-a8c8-53f36b3244a3.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1EQX6OZVJGHKK3633AAFGLBUCOOATRACRQRQF6HMSMLYUP6EAD6XSWAAY%2F20210327%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20210327T134226Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=4e6339fa1704dadef879d5742aa1e26b8953dc6982fbf61a693f5624cb7d0f97
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  338k    0     0  100  338k      0  1685k --:--:-- --:--:-- --:--:-- 1685k
    -> Reports have been successfully queued for processing at https://codecov.io/github/javaparser/javaparser/commit/e9372bef21515cf89a3b710c39b3b6eca720f0d1

Expected Results

Github status checks to report coverage, and a PR comment to be posted.

Here is a working example from an arbitrarily “old” PR (about two weeks ago):

Actual Results

No PR comment being added. At the time of writing this, PR 3208 (linked to below) status checks completed over five hours ago and I can see all uploads in the “build” tab – screenshots included within the PR.

“No coverage information on head” on the status check

image

Additional Information

Context: The JavaParser project has two parts – “core” and “symbol solver”.

It was noted recently that code coverage for the symbol solver section isn’t being reported – investigating this, it seems that it is a surefire error on our part (argline being overwritten).

Fixing this introduces a new problem of the PR comments not being shown, and the status checks reporting “No coverage information found on head”.

I am now (reasonably) confident that coverage reports are being produced correctly but the

@MysterAitch there seems to be a lot of things going on here, so apologies if I miss something. What I noticed is that for this PR, you didn’t get a comment because there were not enough builds and when there were enough, the PR was already closed/merged.

@tom – Cheers for looking into it!

I’m not entirely sure your description matches what happened. To confirm the timeline:

  • The PR was created at 13:34
  • At 14:05 there were 54 (of 54) uploads (per the screenshot) and no comment
  • At 19:03 there was still no comment, and I merged it.

When during this should the comment have been added? And at what point after the merging of the PR did additional reports come in?

Cheers,
Roger

To follow up on this, I see that codecov still shows 54 uploads.

If it’s a problem with processing the uploads, note that I was running similar PRs on a branch to try and test things out – comments there were being added within minutes.