Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve CI reporting #2482

Closed
wants to merge 2 commits into from
Closed

Conversation

dopplershift
Copy link
Member

Description Of Changes

Trying to use the new GHA job summary to improve CI output. Right now, this is using pytest-html to generate a report from our test step.

Other alternatives are pytest-md-report and pytest-md.

Another idea with pytest-html would be to try to include some/all of the failed images there.

Checklist

  • Closes #xxxx
  • Tests added
  • Fully documented

@dopplershift dopplershift added Area: Infrastructure Pertains to project infrastructure (e.g. CI, linting) Type: Enhancement Enhancement to existing functionality labels May 17, 2022
@dopplershift
Copy link
Member Author

Ok, pytest-html was a terrible idea (for this). Way too long, doesn't parse correctly in a markdown "pane".

@dopplershift
Copy link
Member Author

Also looks like pytest-md-report can't write a file directly (so you'd have to pipe to a file which would include the regular output) 🤨 and pytest-md is minimal in functionality and not particularly active, either (but at least they can write a file).

Looks like we'll want to make a custom plugin/hook for pytest for now for this (#2483).

@dopplershift dopplershift deleted the improve-reports branch May 17, 2022 23:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area: Infrastructure Pertains to project infrastructure (e.g. CI, linting) Type: Enhancement Enhancement to existing functionality
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant