Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Provide test execution times per ztest testcase #32137

Closed
nashif opened this issue Feb 9, 2021 · 2 comments · Fixed by #33014
Closed

Provide test execution times per ztest testcase #32137

nashif opened this issue Feb 9, 2021 · 2 comments · Fixed by #33014
Assignees
@enjiamai
Labels
area: Test Framework Issues related not to a particular test, but to the framework instead area: Testsuite Testsuite Enhancement Changes/Updates/Additions to existing features

Comments

@nashif
Copy link
Member

nashif commented Feb 9, 2021

Is your enhancement proposal related to a problem? Please describe.
We do not have any information about how long each test runs when running tests using ztest.

Describe the solution you'd like
For each test, print our the execution time as part of the results

Describe alternatives you've considered
Provide test execution time per testcase.

For example:

now:

START - test_sem_multi_take_timeout_diff_sem
 PASS - test_sem_multi_take_timeout_diff_sem

with per test execution time:

START - test_sem_multi_take_timeout_diff_sem
 PASS - test_sem_multi_take_timeout_diff_sem in 2.54 seconds
@nashif nashif added Enhancement Changes/Updates/Additions to existing features area: Test Framework Issues related not to a particular test, but to the framework instead area: Testsuite Testsuite labels Feb 9, 2021
@nashif
Copy link
Member Author

nashif commented Feb 9, 2021 •
edited
Loading

@jocelyn-li @LeiW000 FYI

@enjiamai
Copy link
Collaborator

enjiamai commented Mar 6, 2021

Ok, got it, will add this.

@enjiamai enjiamai mentioned this issue Mar 6, 2021
Merged
enjiamai pushed a commit to enjiamai/zephyr that referenced this issue Mar 11, 2021
tests: ztest: provide test execution times per ztest testcase
3eb2c60 
Add execution time for testing result of each ztest testcase as:

START - test_sem_multi_take_timeout_diff_sem
PASS - test_sem_multi_take_timeout_diff_sem in 2.54 seconds

Fix zephyrproject-rtos#32137.

Signed-off-by: Enjia Mai <enjiax.mai@intel.com>
nashif pushed a commit that referenced this issue Mar 11, 2021
@nashif
tests: ztest: provide test execution times per ztest testcase
2c5e2c2 
Add execution time for testing result of each ztest testcase as:

START - test_sem_multi_take_timeout_diff_sem
PASS - test_sem_multi_take_timeout_diff_sem in 2.54 seconds

Fix #32137.

Signed-off-by: Enjia Mai <enjiax.mai@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@enjiamai enjiamai

Labels
area: Test Framework Issues related not to a particular test, but to the framework instead area: Testsuite Testsuite Enhancement Changes/Updates/Additions to existing features
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

tests: ztest: provide test execution times per ztest testcase enjiamai/zephyr
2 participants
@nashif @enjiamai