[Test] Creating CADMIN 1.15 python test module #35524
Open
+401
−356
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Creating TC_CADMIN_1_15.py test module following test steps in draft PR from Cecille here: CHIP-Specifications/chip-test-plans#4636 - Removing test_TC_CADMIN_1_15.yaml as no longer needed once python module is created.
|
Review changes with Changed Files
|
github-actions
bot
added
app
tests
matter-1.4-te2-script-change
|
PR #35524: Size comparison from d1279a8 to fb1ce98 Full report (77 builds for bl602, bl702, bl702l, cyw30739, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
|
PR #35524: Size comparison from d1279a8 to ff650d5 Full report (12 builds for nrfconnect, nxp, qpg, stm32, tizen)
|
- Fixing linting errors
|
PR #35524: Size comparison from d1279a8 to ed04de6 Full report (12 builds for nrfconnect, nxp, qpg, stm32, tizen)
|
- Made minor linting fixes
|
PR #35524: Size comparison from d1279a8 to cdad862 Full report (77 builds for bl602, bl702, bl702l, cyw30739, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
- Updated comment verbage to correct information - Updated and removed some expected results for test steps as necessary
|
PR #35524: Size comparison from d1279a8 to a62f7c6 Increases above 0.2%:
Full report (5 builds for nxp, stm32, tizen)
|
|
PR #35524: Size comparison from d1279a8 to 9aa3455 Increases above 0.2%:
Full report (77 builds for bl602, bl702, bl702l, cyw30739, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
cecille
reviewed
Sep 20, 2024
src/python_testing/TC_CADMIN_1_15.py
Outdated
|
|
||
|
|
||
| class TC_CADMIN_1_15(MatterBaseTest): | ||
| async def OpenCommissioningWindow(self, th, expectedErrCode) -> CommissioningParameters: |
There was a problem hiding this comment.
Given that this function appears in a couple of CADMIN tests, it seems like it would make sense to consolidate. Let's get these all in as-is, and then pull them into a single file with a single implementation of this function. The bonus there is we can run them all in one go and save some time at testing. Well, not through the TH, but in the CI.
There was a problem hiding this comment.
Created a follow-up task here: 514
Added changes from Ceciile to this test module Co-authored-by: C Freeman <cecille@google.com>
- Added type annotations for OpenCommissioningWindow function - Added None type expectedErrorCode variable - Updated test step numbering to match test plan
- Updated test step 15 failure assertion to not start from number 1, but instead to correctly make sure that fabric_idx_cr2 does not exist in current fabric indexes list
cecille
removed
the
matter-1.4-te2-script-change
|
PR #35524: Size comparison from 958c1cb to 3043332 Full report (71 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
- Implementing DNS-SD feature from Raul to cover test step 8
- Resolving linting errors
|
PR #35524: Size comparison from 789e941 to 05c032d Full report (3 builds for cc32xx, stm32)
|
|
PR #35524: Size comparison from 57ff3e6 to 20cdc63 Increases above 0.2%:
Full report (71 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
- Changing method for test step 8 as needed
- Changed discovery to return last entry instead of first entry when run multiple times - Updated TC_CADMIN_1_15 to include Raul's latest changes to mdns_discovery in order to complete test step 8
- Resolving linting error
|
PR #35524: Size comparison from 57ff3e6 to 26187af Increases above 0.2%:
Full report (71 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
- To change to searching discovered_services dictionary values for expected mdns value instead of taking last or first value in list.
|
PR #35524: Size comparison from 57ff3e6 to 634041a Increases above 0.2%:
Full report (71 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
|
PR #35524: Size comparison from df5ee33 to d0bf508 Full report (72 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
| @@ -493,7 +494,8 @@ def _get_instance_name(self, service_info: AsyncServiceInfo) -> str: | |||
|
|
|||
| async def _get_service(self, service_type: MdnsServiceType, | |||
| log_output: bool, | |||
| discovery_timeout_sec: float | |||
| discovery_timeout_sec: float, | |||
| expected_value: str = None, | |||
There was a problem hiding this comment.
Please add this new argument to the description
There was a problem hiding this comment.
Thank you, this has been updated in the latest code changes here now
|
Please remove the Test_TC_CADMIN_1_15 line from manualTests.json |
raul-marquez-csa
approved these changes
Feb 21, 2025
cecille
approved these changes
Feb 24, 2025
raju-apple
approved these changes
Feb 24, 2025
- Updated manualTests.json to remove Test_TC_CADMIN_1_15 from the list of CADMIN yaml scripts - Updated mdns_discovery module to include description of "expected_value" arg.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Testing