-
Notifications
You must be signed in to change notification settings - Fork 2.2k
Automating TC-LWM-2.1 (step 7) and updating pics #39972
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request automates a manual test step for the Laundry Washer Mode cluster and updates the PICS values for the CI environment. The automation of the test step is a welcome improvement, and the implementation correctly validates a comprehensive set of failure status codes. The change to the ci-pics-values
file to disable this test in CI is also appropriate, given that the underlying functionality is not yet supported in the SDK sample app.
PR #39972: Size comparison from 7dc2506 to 9b57160 Full report (59 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
@@ -759,7 +759,7 @@ LWM.S.C01.Tx=1 | |||
PIXIT.LWM.MODE_CHANGE_FAIL=1 | |||
PIXIT.LWM.MODE_CHANGE_OK=1 | |||
|
|||
LWM.S.M.CAN_TEST_MODE_FAILURE=1 | |||
LWM.S.M.CAN_TEST_MODE_FAILURE=0 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
if we turn off this in CI, how can we ensure that the test works?
I am conflicted here: on one hand an automated test is better than manual, however on the other side I wonder if this will bitrot. Are there any plans/issues to support this in sample apps? Or would we just accept that if devices fail they will turn off the PICS (I find that likely as it is easier to change an enabling and get certified instead of trying to fix things that the SDK does not test to be correctly implemented in CI)
@r-recchia the |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Suggest adding a note to Step 7 in the test plan (/allclusters.html#_tc_lwm_2_1_change_to_mode_functionality_with_dut_as_server
): This step is only executed if the PICS value LWM.S.M.CAN_TEST_MODE_FAILURE
is set to 1
. If the PICS is set to 0
, this step is skipped during test execution.
Please confirm this approach with @cecille
This PR Fixes #622
Updates
It automates test step 7. The SDK does not implement this command so the PICS value LWM.S.M.CAN_TEST_MODE_FAILURE was updated to 0 in order to skip the test step. Also updated constraint values.
Testing
In the first terminal:
rm /tmp/chip_*
In the second terminal: