Skip to content

Releases: cnti-testcatalog/testsuite

main-2024-04-09-160846-358ae0d1 April 09, 2024

09 Apr 16:08
358ae0d
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

  • #1939 - Adapt cert tests for CNTI certification V2.0
  • #1956 - Update all cnf examples README
  • #1932 - [Documentation] update results log to reflect CNTI Certification V2 tests
  • #1950 - Update envoy examples README

Artifact info:

  • Commit: main-2024-04-09-160846-358ae0d1
  • SHA256SUM: 9b0c1e3c6220e185651933852e7509d2e107e0f59031261855347506482c34a0 cnf-testsuite-main-2024-04-09-160846-358ae0d1.tar.gz

main-2024-04-05-141343-a6ae8de9 April 05, 2024

05 Apr 14:13
a6ae8de
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

  • #1897 - Update Kind and its image versions in gates
  • #1886 - [BUG] Update Kind in gates as kind v0.17.0 ships by default Kubernetes v1.25.3 (EOL)

Artifact info:

  • Commit: main-2024-04-05-141343-a6ae8de9
  • SHA256SUM: c7bf012c974ae4f517d53efacae52b92d560ea33916272734aff243795b49f51 cnf-testsuite-main-2024-04-05-141343-a6ae8de9.tar.gz

main-2024-04-01-220724-83f08b67 April 01, 2024

01 Apr 22:07
83f08b6
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

  • #1942 - Adding local helm binary for spec tests
  • #1909 - [BUG] Spec tests are unable to find local Helm installation.
  • #1940 - Adding sig_term_handled and zombie_handled to the docs
  • #1924 - [BUG] zombie_handled test documentation is missing from USAGE and RATIONALE
  • #1925 - [BUG] sig_term_handled test documentation is missing from USAGE and RATIONALE

Artifact info:

  • Commit: main-2024-04-01-220724-83f08b67
  • SHA256SUM: 22ce74494b997ce8fa53f215a10aeaa821bf7efee91b68e2055b84b5cee64b4e cnf-testsuite-main-2024-04-01-220724-83f08b67.tar.gz

main-2024-04-01-192004-31d8cd49 April 01, 2024

01 Apr 19:20
31d8cd4
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

  • #1941 - Fix wrong description for zombie_handled

Artifact info:

  • Commit: main-2024-04-01-192004-31d8cd49
  • SHA256SUM: 524cf9ddf547db7dccb950abc698e78caa64c3c990365813790614ee757ff2e4 cnf-testsuite-main-2024-04-01-192004-31d8cd49.tar.gz

main-2024-03-25-221702-daccafa4 March 25, 2024

25 Mar 22:17
daccafa
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

  • #1935 - Remove unused and duplicated points-all.yml
  • #1934 - Platform tests adapted to centralized result logging

Artifact info:

  • Commit: main-2024-03-25-221702-daccafa4
  • SHA256SUM: 70af9e6068020ee464d4a3af3d74849b9c714509e4ddbe4af8b09b252bb12f85 cnf-testsuite-main-2024-03-25-221702-daccafa4.tar.gz

main-2024-03-19-154828-0b34594e March 19, 2024

19 Mar 15:48
0b34594
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

  • #1910 - Workload tests adapted to centralized result logging

Artifact info:

  • Commit: main-2024-03-19-154828-0b34594e
  • SHA256SUM: 075f45ff8605e3743dfe6bf8a1a9b4e93c78d54e2e999a80ddcdc239377993f8 cnf-testsuite-main-2024-03-19-154828-0b34594e.tar.gz

v0.46.0 March 06, 2024

07 Mar 22:37
aa79990
Compare
Choose a tag to compare

Release Notes for v0.46.0 (Wednesday, March 6, 2024)

Changes since v0.45.0 (Friday, October 27, 2023)

🙌 Kudos

We appreciate everyone who helped with Release v0.46.0! 🎉

Special thanks to contributors:

Please submit a PR to add your name to the MAINTAINERS.md.

✨ Enhancements

  • #868 - [Feature] Add emojis to test called ip_addresses
  • #875 - [Feature] Add emojis to test called helm_deploy
  • #878 - [Feature] Adding missing ⏭️ for SKIPPED test output on command line and update SKIPPED with ❌ emoji
  • #1436 - [Feature] Add spec test for increase_decrease_capacity test
  • #1806 - [Feature] Need UERANSIM installation for test suite
  • #1840 - [Workload] 5g Core Validator
  • #1848 - [Feature] 5g and Oran need new categories
  • #1870 - Testsuite Repo URL Migration and Github Runner Updates

🐛 Bug Fixes

  • #1422 - [BUG] cnf-testsuite errors when KUBECONFIG not set
  • #1735 - [BUG] When increase fails, the testsuite should not attempt a decrease during the increase_decrease_capacity test
  • #1802 - [BUG] cnf-testsuite throws crystal output error if ran in a directory the user doesn't have permissions to
  • #1860 - [BUG] Change amf_pod_name to amf_service_name
  • #1861 - [Feature] Improve modularity of test cases implementation
  • #1864 - [BUG] wrong usage of named arguments across the code
  • #1865 - [BUG] embedded_files/points.yml: "tags" is a list by semantic, but not by yaml syntax
  • #1871 - [BUG] Platform tests missing platform:security and clusterapi_enabled
  • #1874 - [BUG] Fix github runners after Repo Migration
  • #1878 - [BUG] Failing platform observability spec tests
  • #1879 - [BUG] Failing curl_install spec tests
  • #1880 - [BUG] Failing utils spec tests
  • #1884 - [BUG] Incorrect logic of elastic_volumes and database_persistence tests
  • #1900 - [BUG] Resolve build issue with "Publish Release" task for GitHub Actions
  • #1902 - [BUG] Resolve issue with PR-1895 causing build failures
  • #1904 - [BUG] Log lines are now displayed when setup command is run

🔧 Maintenance

  • #1891 - [MAINTENANCE] remove non_root_user test along with Falco

📖 Documentation

  • #1851 - [RESEARCH] Prepare to Transfer CNF Test Suite repo to new GitHub org
  • #1853 - [Documentation] Link to non-existent file in README.md - CNF WG
  • #1856 - Update community meeting time on CONTRIBUTING.md
  • #1873 - [Documentation] Update GitHub description, README, etc to reflect new CNTI program
  • #1908 - [Documentation] update CONTRIBUTING.md to reflect CNTI Test Catalog
  • #1912 - [Documentation] update TEST-CATEGORIES.md to reflect CNTI Test Catalog
  • #1914 - [Documentation] update USAGE.md to reflect CNTI Test Catalog
  • #1915 - [Documentation] update SOURCE_INSTALL.md to reflect CNTI Test Catalog

Artifact info:

  • Commit: v0.46.0
  • SHA256SUM: 6811bdae929af847d89b8878a2fec39a01aee5a36e692b71dce8dc0cbd5da313 cnf-testsuite-v0.46.0.tar.gz

main-2024-03-06-213608-aa799902 March 06, 2024

06 Mar 21:36
aa79990
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

  • #1881 - Add default kubeconfig path if KUBECONFIG is unset

Artifact info:

  • Commit: main-2024-03-06-213608-aa799902
  • SHA256SUM: b6466ca13e677e0bb087177f7fe188693e46eb2963732a5ee9c2ea350a5b5f3e cnf-testsuite-main-2024-03-06-213608-aa799902.tar.gz

main-2024-03-05-161437-a1797d39 March 05, 2024

05 Mar 16:14
a1797d3
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

Artifact info:

  • Commit: main-2024-03-05-161437-a1797d39
  • SHA256SUM: fa2471284060f07f7de57a19d57d56acc62601beea8ad750974e2fad39571ee8 cnf-testsuite-main-2024-03-05-161437-a1797d39.tar.gz

main-2024-03-04-232724-6d09d1ba March 04, 2024

04 Mar 23:27
6d09d1b
Compare
Choose a tag to compare

UPDATES

Issues addressed in this release:

  • #1919 - #1806 ueransim cli messaging now exists
  • #1806 - [Feature] Need UERANSIM installation for test suite
  • #1920 - update USAGE.md to reflect CNTI
  • #1921 - update SOURCE_INSTALL.md to reflect CNTI
  • #1915 - [Documentation] update SOURCE_INSTALL.md to reflect CNTI Test Catalog

Artifact info:

  • Commit: main-2024-03-04-232724-6d09d1ba
  • SHA256SUM: 43631ac0524f5af4a8b9a0af1276da94fabde7b6d50cc0a97b0d06510e9913f7 cnf-testsuite-main-2024-03-04-232724-6d09d1ba.tar.gz