promptflow-release-testing-matrix #265
ninghupromptflow-release-testing-matrix.yml
on: workflow_dispatch
build
1m 4s
id
2s
Matrix: promptflow_core_azureml_serving_tests
Matrix: promptflow_azure_tests
Matrix: promptflow_core_tests
Matrix: promptflow_devkit_tests
Matrix: promptflow_executor_tests
Matrix: promptflow_tracing_tests
Publish Tests Results
7s
Annotations
51 errors and 30 warnings
|
promptflow_tracing_tests (ubuntu-latest, 3.11)
Process completed with exit code 1.
|
|
promptflow_tracing_tests (ubuntu-latest, 3.10)
Process completed with exit code 1.
|
|
promptflow_tracing_tests (ubuntu-latest, 3.9)
Process completed with exit code 1.
|
|
promptflow_tracing_tests (macos-13, 3.9)
Process completed with exit code 1.
|
|
promptflow_tracing_tests (macos-13, 3.10)
Process completed with exit code 1.
|
|
promptflow_tracing_tests (macos-13, 3.11)
Process completed with exit code 1.
|
|
promptflow_tracing_tests (windows-latest, 3.11)
Process completed with exit code 1.
|
|
promptflow_tracing_tests (windows-latest, 3.10)
Process completed with exit code 1.
|
|
promptflow_tracing_tests (windows-latest, 3.9)
Process completed with exit code 1.
|
|
promptflow_core_tests (ubuntu-latest, 3.10)
Process completed with exit code 1.
|
|
promptflow_core_tests (ubuntu-latest, 3.9)
Process completed with exit code 1.
|
|
promptflow_core_tests (ubuntu-latest, 3.11)
Process completed with exit code 1.
|
|
promptflow_core_tests (macos-13, 3.10)
Process completed with exit code 1.
|
|
promptflow_core_tests (macos-13, 3.11)
Process completed with exit code 1.
|
|
promptflow_executor_tests (macos-13, 3.10)
Process completed with exit code 1.
|
|
promptflow_core_tests (windows-latest, 3.11)
Process completed with exit code 1.
|
|
promptflow_core_tests (windows-latest, 3.10)
Process completed with exit code 1.
|
|
promptflow_core_tests (macos-13, 3.9)
Process completed with exit code 1.
|
|
promptflow_core_tests (windows-latest, 3.9)
Process completed with exit code 1.
|
|
promptflow_executor_tests (ubuntu-latest, 3.10)
Process completed with exit code 1.
|
|
promptflow_executor_tests (ubuntu-latest, 3.9)
Process completed with exit code 1.
|
|
promptflow_executor_tests (macos-13, 3.9)
Process completed with exit code 1.
|
|
promptflow_executor_tests (macos-13, 3.11)
Process completed with exit code 1.
|
|
promptflow_executor_tests (ubuntu-latest, 3.11)
Process completed with exit code 1.
|
|
promptflow_executor_tests (windows-latest, 3.10)
Process completed with exit code 1.
|
|
promptflow_executor_tests (windows-latest, 3.9)
Event loop is closed
|
|
promptflow_executor_tests (windows-latest, 3.9)
Event loop is closed
|
|
promptflow_executor_tests (windows-latest, 3.9)
Process completed with exit code 1.
|
|
promptflow_executor_tests (windows-latest, 3.11)
Process completed with exit code 1.
|
|
promptflow_azure_tests (macos-13, 3.11)
Process completed with exit code 1.
|
|
promptflow_azure_tests (ubuntu-latest, 3.9)
Event loop is closed
|
|
promptflow_azure_tests (ubuntu-latest, 3.9)
Process completed with exit code 1.
|
|
promptflow_azure_tests (ubuntu-latest, 3.11)
Process completed with exit code 1.
|
|
promptflow_azure_tests (macos-13, 3.9)
Event loop is closed
|
|
promptflow_azure_tests (macos-13, 3.9)
Process completed with exit code 1.
|
|
promptflow_azure_tests (windows-latest, 3.10)
Process completed with exit code 1.
|
|
promptflow_azure_tests (windows-latest, 3.11)
Process completed with exit code 1.
|
|
promptflow_azure_tests (macos-13, 3.10)
Event loop is closed
|
|
promptflow_azure_tests (macos-13, 3.10)
Process completed with exit code 1.
|
|
promptflow_azure_tests (ubuntu-latest, 3.10)
Event loop is closed
|
|
promptflow_azure_tests (ubuntu-latest, 3.10)
Process completed with exit code 1.
|
|
promptflow_devkit_tests (ubuntu-latest, 3.11)
Process completed with exit code 1.
|
|
promptflow_devkit_tests (ubuntu-latest, 3.9)
Process completed with exit code 1.
|
|
promptflow_devkit_tests (ubuntu-latest, 3.10)
Process completed with exit code 1.
|
|
promptflow_azure_tests (windows-latest, 3.9)
Process completed with exit code 1.
|
|
promptflow_devkit_tests (macos-13, 3.10)
Process completed with exit code 1.
|
|
promptflow_devkit_tests (macos-13, 3.11)
Process completed with exit code 1.
|
|
promptflow_devkit_tests (macos-13, 3.9)
Process completed with exit code 1.
|
|
promptflow_devkit_tests (windows-latest, 3.9)
Process completed with exit code 1.
|
|
promptflow_devkit_tests (windows-latest, 3.11)
Process completed with exit code 1.
|
|
promptflow_devkit_tests (windows-latest, 3.10)
Process completed with exit code 1.
|
|
id
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
build
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_tracing_tests (ubuntu-latest, 3.11)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_tracing_tests (ubuntu-latest, 3.10)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_tracing_tests (ubuntu-latest, 3.9)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_core_azureml_serving_tests (ubuntu-latest, 3.11)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_core_azureml_serving_tests (ubuntu-latest, 3.9)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_core_azureml_serving_tests (ubuntu-latest, 3.10)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_core_tests (ubuntu-latest, 3.10)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_core_tests (ubuntu-latest, 3.9)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_core_tests (ubuntu-latest, 3.11)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_executor_tests (ubuntu-latest, 3.10)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_executor_tests (ubuntu-latest, 3.9)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_executor_tests (ubuntu-latest, 3.11)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_azure_tests (ubuntu-latest, 3.9)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_azure_tests (ubuntu-latest, 3.11)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_azure_tests (ubuntu-latest, 3.10)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_devkit_tests (ubuntu-latest, 3.11)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_devkit_tests (ubuntu-latest, 3.9)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
promptflow_devkit_tests (ubuntu-latest, 3.10)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
1 out of 9 runs failed: test_gen_tool_meta_all_completed (tests.executor.unittests.executor._service.apis.test_tool.TestToolApis):
tests.executor.unittests.executor._service.apis.test_tool.TestToolApis#L0
artifacts/promptflow_executor_tests Test Results (Python 3.10) (OS macos-13)/test-results-executor-unit.xml [took 10s]
|
|
1 out of 8 runs failed: test_otel_trace_with_prompt[llm_tool-inputs0-joke.jinja2] (tests.executor.e2etests.test_traces.TestOTelTracer):
tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 4m 50s]
|
|
All 8 runs failed: test_otel_trace_with_llm[openai_chat_api_flow-inputs0-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer):
tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/promptflow_executor_tests Test Results (Python 3.10) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 2s]
artifacts/promptflow_executor_tests Test Results (Python 3.10) (OS windows-latest)/test-results-executor-e2e.xml [took 4s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS macos-13)/test-results-executor-e2e.xml [took 7s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 2s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS windows-latest)/test-results-executor-e2e.xml [took 5s]
artifacts/promptflow_executor_tests Test Results (Python 3.9) (OS macos-13)/test-results-executor-e2e.xml [took 6s]
artifacts/promptflow_executor_tests Test Results (Python 3.9) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 2s]
artifacts/promptflow_executor_tests Test Results (Python 3.9) (OS windows-latest)/test-results-executor-e2e.xml [took 4s]
|
|
All 8 runs failed: test_otel_trace_with_llm[openai_completion_api_flow-inputs2-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer):
tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/promptflow_executor_tests Test Results (Python 3.10) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 2s]
artifacts/promptflow_executor_tests Test Results (Python 3.10) (OS windows-latest)/test-results-executor-e2e.xml [took 5s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS macos-13)/test-results-executor-e2e.xml [took 5s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 2s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS windows-latest)/test-results-executor-e2e.xml [took 5s]
artifacts/promptflow_executor_tests Test Results (Python 3.9) (OS macos-13)/test-results-executor-e2e.xml [took 6s]
artifacts/promptflow_executor_tests Test Results (Python 3.9) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 2s]
artifacts/promptflow_executor_tests Test Results (Python 3.9) (OS windows-latest)/test-results-executor-e2e.xml [took 5s]
|
|
All 8 runs failed: test_otel_trace_with_llm[llm_tool-inputs4-False-4] (tests.executor.e2etests.test_traces.TestOTelTracer):
tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/promptflow_executor_tests Test Results (Python 3.10) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 2s]
artifacts/promptflow_executor_tests Test Results (Python 3.10) (OS windows-latest)/test-results-executor-e2e.xml [took 4s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS macos-13)/test-results-executor-e2e.xml [took 6s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 2s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS windows-latest)/test-results-executor-e2e.xml [took 5s]
artifacts/promptflow_executor_tests Test Results (Python 3.9) (OS macos-13)/test-results-executor-e2e.xml [took 5s]
artifacts/promptflow_executor_tests Test Results (Python 3.9) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 2s]
artifacts/promptflow_executor_tests Test Results (Python 3.9) (OS windows-latest)/test-results-executor-e2e.xml [took 4s]
|
|
All 8 runs failed: test_otel_trace_with_llm[flow_with_async_llm_tasks-inputs5-False-6] (tests.executor.e2etests.test_traces.TestOTelTracer):
tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/promptflow_executor_tests Test Results (Python 3.10) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 2s]
artifacts/promptflow_executor_tests Test Results (Python 3.10) (OS windows-latest)/test-results-executor-e2e.xml [took 4s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS macos-13)/test-results-executor-e2e.xml [took 4s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 2s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS windows-latest)/test-results-executor-e2e.xml [took 5s]
artifacts/promptflow_executor_tests Test Results (Python 3.9) (OS macos-13)/test-results-executor-e2e.xml [took 5s]
artifacts/promptflow_executor_tests Test Results (Python 3.9) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 2s]
artifacts/promptflow_executor_tests Test Results (Python 3.9) (OS windows-latest)/test-results-executor-e2e.xml [took 4s]
|
|
3 out of 8 runs failed: test_executor_exec_line_fail_with_exception[sync_tools_failures-sync_fail-In tool raise_an_exception: dummy_input] (tests.executor.e2etests.test_executor_execution_failures.TestExecutorFailures):
tests.executor.e2etests.test_executor_execution_failures.TestExecutorFailures#L0
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS macos-13)/test-results-executor-e2e.xml [took 0s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 0s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS windows-latest)/test-results-executor-e2e.xml [took 0s]
|
|
3 out of 8 runs failed: test_executor_exec_line_fail_with_exception[async_tools_failures-async_fail-In tool raise_an_exception_async: dummy_input] (tests.executor.e2etests.test_executor_execution_failures.TestExecutorFailures):
tests.executor.e2etests.test_executor_execution_failures.TestExecutorFailures#L0
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS macos-13)/test-results-executor-e2e.xml [took 0s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor-e2e.xml [took 0s]
artifacts/promptflow_executor_tests Test Results (Python 3.11) (OS windows-latest)/test-results-executor-e2e.xml [took 0s]
|
|
Publish Tests Results
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "promptflow_executor_tests Test Results (Python 3.10) (OS macos-13)", "promptflow_executor_tests Test Results (Python 3.10) (OS ubuntu-latest)", "promptflow_executor_tests Test Results (Python 3.10) (OS windows-latest)", "promptflow_executor_tests Test Results (Python 3.11) (OS macos-13)", "promptflow_executor_tests Test Results (Python 3.11) (OS ubuntu-latest)", "promptflow_executor_tests Test Results (Python 3.11) (OS windows-latest)", "promptflow_executor_tests Test Results (Python 3.9) (OS macos-13)", "promptflow_executor_tests Test Results (Python 3.9) (OS ubuntu-latest)", "promptflow_executor_tests Test Results (Python 3.9) (OS windows-latest)", "wheel".
Please update your workflow to use v4 of the artifact actions.
Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
promptflow_core_azureml_serving_tests report-macos-13-py3.10
|
587 Bytes |
|
|
promptflow_core_azureml_serving_tests report-macos-13-py3.11
|
577 Bytes |
|
|
promptflow_core_azureml_serving_tests report-macos-13-py3.9
|
583 Bytes |
|
|
promptflow_core_azureml_serving_tests report-ubuntu-latest-py3.10
|
570 Bytes |
|
|
promptflow_core_azureml_serving_tests report-ubuntu-latest-py3.11
|
565 Bytes |
|
|
promptflow_core_azureml_serving_tests report-ubuntu-latest-py3.9
|
571 Bytes |
|
|
promptflow_core_azureml_serving_tests report-windows-latest-py3.10
|
570 Bytes |
|
|
promptflow_core_azureml_serving_tests report-windows-latest-py3.11
|
570 Bytes |
|
|
promptflow_core_azureml_serving_tests report-windows-latest-py3.9
|
571 Bytes |
|
|
promptflow_executor_tests Test Results (Python 3.10) (OS macos-13)
|
135 KB |
|
|
promptflow_executor_tests Test Results (Python 3.10) (OS ubuntu-latest)
|
201 KB |
|
|
promptflow_executor_tests Test Results (Python 3.10) (OS windows-latest)
|
202 KB |
|
|
promptflow_executor_tests Test Results (Python 3.11) (OS macos-13)
|
208 KB |
|
|
promptflow_executor_tests Test Results (Python 3.11) (OS ubuntu-latest)
|
212 KB |
|
|
promptflow_executor_tests Test Results (Python 3.11) (OS windows-latest)
|
209 KB |
|
|
promptflow_executor_tests Test Results (Python 3.9) (OS macos-13)
|
201 KB |
|
|
promptflow_executor_tests Test Results (Python 3.9) (OS ubuntu-latest)
|
201 KB |
|
|
promptflow_executor_tests Test Results (Python 3.9) (OS windows-latest)
|
202 KB |
|
|
wheel
|
8.39 MB |
|