Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: Updates for Metrics release 1.3.0 #118

Merged
merged 55 commits into from
Jun 28, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
55 commits
Select commit Hold shift + click to select a range
a5931bb
Updates for Metrics release 1.2.0 (#95)
raits Oct 4, 2023
831184f
chore: Fixes #99 incorrect filename in docs
raits Oct 19, 2023
6943084
Merge pull request #100 from nordic-institute/231910-docfix
raits Oct 19, 2023
ef21725
chore: removed UI elements under the opendata module web interface that
raits Oct 23, 2023
ce07b95
Merge pull request #101 from nordic-institute/232310-opendata-ui-fix
raits Oct 23, 2023
7f5fa03
Add ORT configuration file
petkivim Jan 29, 2024
be0aad4
Update ORT configuration
petkivim Mar 16, 2024
eed0e9b
Update ORT configuration
petkivim Mar 19, 2024
4533466
Update ORT configuration
petkivim Mar 23, 2024
64060ec
Update ORT configuration
petkivim Apr 3, 2024
3a11037
feat: Add ability to disable certificate verification during connecti…
melbeltagy May 13, 2024
41af075
docs: Update README and collector module's documentation
melbeltagy May 13, 2024
77c4738
docs: Update collector module's documentation
melbeltagy May 14, 2024
3ec4841
fix: Stop using dictionary unpacking for single members to fix failin…
melbeltagy May 14, 2024
3a826e2
Merge pull request #112 from nordic-institute/OPMONDEV-181-minimum-fixes
melbeltagy May 17, 2024
9f0c807
Fix duplicate logging
VitaliStupin Nov 22, 2023
a3d181a
Merge pull request #105 from VitaliStupin/logger-handler-fix
melbeltagy May 21, 2024
87283d1
Corrector optimization
VitaliStupin Nov 23, 2023
54ca76c
Optimizing deletion of duplicates
VitaliStupin Nov 27, 2023
1757cf0
Fix duplicate detection
VitaliStupin Nov 28, 2023
fdfe59c
Optimizing updating status for old documents
VitaliStupin Nov 29, 2023
0373557
Optimizing processing documents without xRequestId
VitaliStupin Nov 29, 2023
28637e1
Optimizing document sanitizer
VitaliStupin Nov 29, 2023
9999439
Merge pull request #106 from VitaliStupin/corrector-optimization
melbeltagy May 29, 2024
959ec6a
Reports query optimization using index hints
VitaliStupin Nov 9, 2023
799e610
Better index hints
VitaliStupin Feb 13, 2024
84996fa
Optimize reports
VitaliStupin Feb 15, 2024
a990d90
Merge pull request #103 from VitaliStupin/reports-index-hints
melbeltagy Jun 3, 2024
63c5f41
Adding support for CSV reports
VitaliStupin Jan 19, 2024
bf943d1
Merge pull request #108 from VitaliStupin/csv-report
melbeltagy Jun 4, 2024
b136768
chore: Remove obsolete bitbucket pipeline
melbeltagy Jun 10, 2024
f4837a9
chore: Upgrade dependencies
melbeltagy Jun 10, 2024
dd82df8
chore: Update run_tests.sh to generate HTML reports, add dependency, …
melbeltagy Jun 10, 2024
b3cf55c
chore: Add make clean command for all modules
melbeltagy Jun 10, 2024
fdcef10
chore: Add make clean command for all modules
melbeltagy Jun 10, 2024
df3a69a
chore: Update tox configs to fail on failing tests (to affect pipelin…
melbeltagy Jun 10, 2024
5668f3b
chore: Remove opendata_collector_module from github actions (only kee…
melbeltagy Jun 10, 2024
dc21730
fix: Fix failing reports tests
melbeltagy Jun 10, 2024
9412c68
fix: Fix mongopy APIs usage after library upgrade
melbeltagy Jun 10, 2024
8ce1ba7
docs: Update docs for collector, corrector, and reports modules for c…
melbeltagy Jun 10, 2024
0a24daf
chore: Add dependabot configurations
melbeltagy Jun 11, 2024
bbcfa45
chore: Add github jobs' names
melbeltagy Jun 10, 2024
aed1a53
chore: Add caching for setup.py projects in github actions
melbeltagy Jun 11, 2024
5caf5f9
chore: Remove reviewers from dependabot.yml
melbeltagy Jun 11, 2024
2c40419
Merge pull request #113 from nordic-institute/OPMONDEV-182
melbeltagy Jun 11, 2024
1d647c7
chore(deps): bump the actions-update group
dependabot[bot] Jun 11, 2024
0f6f061
chore(deps): bump freezegun
dependabot[bot] Jun 11, 2024
cfefdf7
chore: bump to version 1.3.0
melbeltagy Jun 13, 2024
95f9f48
Merge pull request #115 from nordic-institute/dependabot/pip/correcto…
dependabot[bot] Jun 13, 2024
3222202
Merge pull request #114 from nordic-institute/dependabot/github_actio…
dependabot[bot] Jun 13, 2024
3c3090c
Merge pull request #116 from nordic-institute/OPMONDEV-185-version
melbeltagy Jun 13, 2024
4015e21
doc: fix typos and broken links
melbeltagy Jun 26, 2024
19cf313
doc: fix typos and broken links
melbeltagy Jun 26, 2024
848d669
Merge pull request #117 from nordic-institute/OPMONDEV-185-docs
melbeltagy Jun 26, 2024
462217e
docs: Update 3rd party notices
petkivim Jun 27, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
37 changes: 37 additions & 0 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
version: 2

updates:
- package-ecosystem: pip
directories:
#- "/analysis_module"
#- "/analysis_ui_module"
- "/anonymizer_module"
- "/collector_module"
- "/corrector_module"
#- "/opendata_collector_module"
- "/opendata_module"
- "/reports_module"
schedule:
interval: "weekly"
day: "thursday"
groups:
python-minor-patch:
applies-to: version-updates
update-types:
- "minor"
- "patch"
python-major:
applies-to: version-updates
update-types:
- "major"

- package-ecosystem: "github-actions"
directory: "/.github/workflows"
schedule:
interval: "weekly"
day: "thursday"
groups:
actions-update:
applies-to: version-updates
patterns:
- "*"
70 changes: 41 additions & 29 deletions .github/workflows/run-tests.yml
Original file line number Diff line number Diff line change
@@ -1,108 +1,120 @@
name: X-Road Metrics tests
name: X-Road Metrics Tests
on: [pull_request]
jobs:
Test-Anonymizer:
name: Anonymizer Tests
runs-on: ubuntu-22.04
defaults:
run:
working-directory: ./anonymizer_module
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python 3.8
uses: actions/setup-python@v4
uses: actions/setup-python@v5
with:
python-version: '3.8'
cache: 'pip'
cache-dependency-path: ./anonymizer_module/setup.py
- name: Install dependencies
run: pip install -r test_requirements.txt
- name: Install tox
run: pip install tox
- name: Run tox tests
run: tox
Test-Collector:
name: Collector Tests
runs-on: ubuntu-22.04
defaults:
run:
working-directory: ./collector_module
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python 3.8
uses: actions/setup-python@v4
uses: actions/setup-python@v5
with:
python-version: '3.8'
cache: 'pip'
cache-dependency-path: ./collector_module/setup.py
- name: Install dependencies
run: pip install -r test_requirements.txt
- name: Install tox
run: pip install tox
- name: Run tox tests
run: tox
Test-Corrector:
name: Corrector Tests
runs-on: ubuntu-22.04
defaults:
run:
working-directory: ./corrector_module
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python 3.8
uses: actions/setup-python@v4
uses: actions/setup-python@v5
with:
python-version: '3.8'
cache: 'pip'
cache-dependency-path: ./corrector_module/setup.py
- name: Install dependencies
run: pip install -r test_requirements.txt
- name: Install tox
run: pip install tox
- name: Run tox tests
run: tox
Test-Opendata:
name: OpenData Tests
runs-on: ubuntu-22.04
defaults:
run:
working-directory: ./opendata_module
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python 3.8
uses: actions/setup-python@v4
with:
python-version: '3.8'
cache: 'pip'
- name: Install dependencies
run: pip install -r test_requirements.txt
- name: Install tox
run: pip install tox
- name: Run tox tests
run: tox
Test-Opendata-Collector:
runs-on: ubuntu-22.04
defaults:
run:
working-directory: ./opendata_collector_module
steps:
- uses: actions/checkout@v3
- name: Set up Python 3.8
uses: actions/setup-python@v4
uses: actions/setup-python@v5
with:
python-version: '3.8'
cache: 'pip'
cache-dependency-path: ./opendata_module/setup.py
- name: Install dependencies
run: pip install -r test_requirements.txt
- name: Install tox
run: pip install tox
- name: Run tox tests
run: tox
# Test-Opendata-Collector:
# name: OpenData Collector Tests
# runs-on: ubuntu-22.04
# defaults:
# run:
# working-directory: ./opendata_collector_module
# steps:
# - uses: actions/checkout@v4
# - name: Set up Python 3.8
# uses: actions/setup-python@v5
# with:
# python-version: '3.8'
# cache: 'pip'
# cache-dependency-path: ./opendata_collector_module/setup.py
# - name: Install dependencies
# run: pip install -r test_requirements.txt
# - name: Install tox
# run: pip install tox
# - name: Run tox tests
# run: tox
Test-Reports:
name: Reports Tests
runs-on: ubuntu-22.04
defaults:
run:
working-directory: ./reports_module
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python 3.8
uses: actions/setup-python@v4
uses: actions/setup-python@v5
with:
python-version: '3.8'
cache: 'pip'
cache-dependency-path: ./reports_module/setup.py
- name: Install dependencies
run: pip install -r test_requirements.txt
- name: Install tox
Expand Down
2 changes: 1 addition & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ nosetests.xml
coverage.xml
*,cover
.hypothesis/
test_results.xml
test_results.*

# Translations
*.mo
Expand Down
68 changes: 68 additions & 0 deletions .ort.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,68 @@
---
excludes:
paths:
- pattern: "**/test_requirements.txt"
reason: "TEST_OF"
comment: "Requirements for testing."
- pattern: "3RD-PARTY-NOTICES.txt"
reason: "DOCUMENTATION_OF"
comment: "3rd party notices."

scopes:
- pattern: "checkstyle"
reason: "BUILD_DEPENDENCY_OF"
comment: "Packages for code styling checks (testing) only."

- pattern: "devDependencies"
reason: "DEV_DEPENDENCY_OF"
comment: "Packages for development only."

- pattern: "jacocoAgent"
reason: "TEST_DEPENDENCY_OF"
comment: "Packages for code coverage (testing) only."

- pattern: "jacocoAnt"
reason: "TEST_DEPENDENCY_OF"
comment: "Packages for code coverage (testing) only."

- pattern: "test.*"
reason: "TEST_DEPENDENCY_OF"
comment: "Packages for testing only."

- pattern: "annotationProcessor"
reason: "DEV_DEPENDENCY_OF"
comment: "Packages for development only."

- pattern: "compileClasspath"
reason: "DEV_DEPENDENCY_OF"
comment: "Packages for development only."

- pattern: "compileOnly"
reason: "DEV_DEPENDENCY_OF"
comment: "Packages for development only."

resolutions:
rule_violations:
- message: "copyleft-strong license GPL-2.0-or-later in PyPI::jinja2:2.10.1."
reason: "LICENSE_ACQUIRED_EXCEPTION"
comment: "The files meant by this license hit are not in use in X-Road-Metrics."

- message: "copyleft-strong license GPL-3.0-or-later WITH GCC-exception-3.1 in PyPI::scipy:1.10.1."
reason: "LICENSE_ACQUIRED_EXCEPTION"
comment: "The exception applies, hence license acquired."

- message: "copyleft-strong license GPL-3.0-or-later WITH GCC-exception-3.1 in PyPI::numpy:1.24.4."
reason: "LICENSE_ACQUIRED_EXCEPTION"
comment: "The exception applies, hence license acquired."

- message: "copyleft-strong license GPL-3.0-only WITH GCC-exception-3.1 in PyPI::numpy:1.24.4."
reason: "LICENSE_ACQUIRED_EXCEPTION"
comment: "The exception applies, hence license acquired."

- message: "free-restricted license Bitstream-Vera in PyPI::matplotlib:3.1.2."
reason: "LICENSE_ACQUIRED_EXCEPTION"
comment: "Font files that are not modified, hence license acquired."

- message: "free-restricted license Bitstream-Vera in PyPI::matplotlib:3.1.2."
reason: "LICENSE_ACQUIRED_EXCEPTION"
comment: "Font files that are not modified, hence license acquired."
Loading
Loading