Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests: benchmarks: Collect coverage data from multicore benchmarks #19978

Merged

Conversation

nordic-bami
Copy link
Contributor

Add coverage calculation test case for each multicore idle* test

@github-actions github-actions bot added the changelog-entry-required Update changelog before merge. Remove label if entry is not needed or already added. label Jan 17, 2025
@NordicBuilder
Copy link
Contributor

NordicBuilder commented Jan 17, 2025

CI Information

To view the history of this post, clich the 'edited' button above
Build number: 6

Inputs:

Sources:

sdk-nrf: PR head: ac7e766336991707fc2a5af56ea2518c744a41bf

more details

sdk-nrf:

PR head: ac7e766336991707fc2a5af56ea2518c744a41bf
merge base: 5e125259f131cb4b5b7c1c72588df0fd0ae7f0c1
target head (main): 533f31cb851fd7f76c173c58ce230f9cdf5f4b59
Diff

Github labels

Enabled Name Description
ci-disabled Disable the ci execution
ci-all-test Run all of ci, no test spec filtering will be done
ci-force-downstream Force execution of downstream even if twister fails
ci-run-twister Force run twister
ci-run-zephyr-twister Force run zephyr twister
List of changed files detected by CI (37)
tests
│  ├── benchmarks
│  │  ├── multicore
│  │  │  ├── idle_adc
│  │  │  │  ├── Kconfig.sysbuild
│  │  │  │  ├── coverage.conf
│  │  │  │  ├── src
│  │  │  │  │  │ main.c
│  │  │  │  ├── sysbuild
│  │  │  │  │  │ nrf54h20dk_nrf54h20_cpurad.conf
│  │  │  │  │ testcase.yaml
│  │  │  ├── idle_comp
│  │  │  │  ├── Kconfig.sysbuild
│  │  │  │  ├── coverage.conf
│  │  │  │  ├── src
│  │  │  │  │  │ main.c
│  │  │  │  ├── sysbuild
│  │  │  │  │  │ nrf54h20dk_nrf54h20_cpurad.conf
│  │  │  │  │ testcase.yaml
│  │  │  ├── idle_exmif
│  │  │  │  ├── coverage.conf
│  │  │  │  ├── src
│  │  │  │  │  │ main.c
│  │  │  │  │ testcase.yaml
│  │  │  ├── idle_ipc
│  │  │  │  ├── coverage.conf
│  │  │  │  ├── src
│  │  │  │  │  │ main.c
│  │  │  │  │ testcase.yaml
│  │  │  ├── idle_pwm_led
│  │  │  │  ├── coverage.conf
│  │  │  │  ├── src
│  │  │  │  │  │ main.c
│  │  │  │  │ testcase.yaml
│  │  │  ├── idle_pwm_loopback
│  │  │  │  ├── coverage.conf
│  │  │  │  ├── src
│  │  │  │  │  │ main.c
│  │  │  │  │ testcase.yaml
│  │  │  ├── idle_spim
│  │  │  │  ├── coverage.conf
│  │  │  │  ├── prj.conf
│  │  │  │  ├── src
│  │  │  │  │  │ main.c
│  │  │  │  │ testcase.yaml
│  │  │  ├── idle_spim_loopback
│  │  │  │  ├── coverage.conf
│  │  │  │  ├── src
│  │  │  │  │  │ main.c
│  │  │  │  │ testcase.yaml
│  │  │  ├── idle_twim
│  │  │  │  ├── Kconfig.sysbuild
│  │  │  │  ├── coverage.conf
│  │  │  │  ├── src
│  │  │  │  │  │ main.c
│  │  │  │  ├── sysbuild
│  │  │  │  │  │ nrf54h20dk_nrf54h20_cpurad.conf
│  │  │  │  │ testcase.yaml
│  │  │  ├── idle_uarte
│  │  │  │  ├── coverage.conf
│  │  │  │  ├── src
│  │  │  │  │  │ main.c
│  │  │  │  │ testcase.yaml

Outputs:

Toolchain

Version: 342151af73
Build docker image: docker-dtr.nordicsemi.no/sw-production/ncs-build:342151af73_912848a074

Test Spec & Results: ✅ Success; ❌ Failure; 🟠 Queued; 🟡 Progress; ◻️ Skipped; ⚠️ Quarantine

  • ◻️ Toolchain - Skipped: existing toolchain is used
  • ✅ Build twister
    • sdk-nrf test count: 139
  • ✅ Integration tests
Disabled integration tests
    • desktop52_verification
    • doc-internal
    • test_ble_nrf_config
    • test-fw-nrfconnect-apps
    • test-fw-nrfconnect-ble_mesh
    • test-fw-nrfconnect-ble_samples
    • test-fw-nrfconnect-boot
    • test-fw-nrfconnect-chip
    • test-fw-nrfconnect-fem
    • test-fw-nrfconnect-nfc
    • test-fw-nrfconnect-nrf-iot_libmodem-nrf
    • test-fw-nrfconnect-nrf-iot_lwm2m
    • test-fw-nrfconnect-nrf-iot_mosh
    • test-fw-nrfconnect-nrf-iot_positioning
    • test-fw-nrfconnect-nrf-iot_samples
    • test-fw-nrfconnect-nrf-iot_serial_lte_modem
    • test-fw-nrfconnect-nrf-iot_zephyr_lwm2m
    • test-fw-nrfconnect-nrf_crypto
    • test-fw-nrfconnect-ps
    • test-fw-nrfconnect-rpc
    • test-fw-nrfconnect-rs
    • test-fw-nrfconnect-tfm
    • test-fw-nrfconnect-thread
    • test-fw-nrfconnect-zigbee
    • test-low-level
    • test-sdk-audio
    • test-sdk-dfu
    • test-sdk-find-my
    • test-sdk-mcuboot
    • test-sdk-pmic-samples
    • test-sdk-sidewalk
    • test-sdk-wifi
    • test-secdom-samples-public

Note: This message is automatically posted and updated by the CI

@nordic-bami nordic-bami force-pushed the gather_coverag_for_idle_benchmarks branch from 4ac078c to 423d567 Compare January 20, 2025 08:09
@nordic-bami nordic-bami marked this pull request as ready for review January 20, 2025 08:15
@nordic-bami nordic-bami requested review from a team and adamkondraciuk as code owners January 20, 2025 08:15
@nordic-bami nordic-bami force-pushed the gather_coverag_for_idle_benchmarks branch 2 times, most recently from 91734a3 to 4065e8a Compare January 20, 2025 09:11
Add coverage calculation test case for each multicore idle* test

Signed-off-by: Bartosz Miller <[email protected]>
@nordic-bami nordic-bami force-pushed the gather_coverag_for_idle_benchmarks branch from 4065e8a to ac7e766 Compare January 20, 2025 09:42
@nordic-bami
Copy link
Contributor Author

@nrfconnect/ncs-co-build-system please review

@nordicjm nordicjm merged commit 403c28c into nrfconnect:main Jan 20, 2025
12 checks passed
@nordic-bami nordic-bami deleted the gather_coverag_for_idle_benchmarks branch January 20, 2025 10:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
changelog-entry-required Update changelog before merge. Remove label if entry is not needed or already added.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants