Skip to content

PR #3220 #16490

Sign in to view logs

PR #3220

PR #3220 #16490

GitHub Actions / SDK CLI Test Result [chenyzhang/update_build_test](https://github.com/microsoft/promptflow/actions/workflows/promptflow-sdk-cli-test.yml?query=branch:chenyzhang/update_build_test++) failed May 11, 2024 in 0s

1 fail, 41 skipped, 673 pass in 1h 2m 51s

    4 files      4 suites   1h 2m 51s ⏱️
  715 tests   673 ✅  41 💤 1 ❌
2 860 runs  2 692 ✅ 164 💤 4 ❌

Results for commit 998c9a5.

Annotations

Check warning on line 0 in tests.sdk_cli_test.e2etests.test_cli.TestCli

See this annotation in the file changed.

@github-actions github-actions / SDK CLI Test Result [chenyzhang/update_build_test](https://github.com/microsoft/promptflow/actions/workflows/promptflow-sdk-cli-test.yml?query=branch:chenyzhang/update_build_test++)

All 4 runs failed: test_flex_flow_build (tests.sdk_cli_test.e2etests.test_cli.TestCli) 

artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 0s]
artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 0s]
artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 0s]
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
Raw output 
Exception: /home/runner/work/promptflow/promptflow/src/promptflow/tests/test_configs/flows/export/flex_flow_build/flow, /tmp/tmpeixect1e/connections are different.
self = <sdk_cli_test.e2etests.test_cli.TestCli object at 0x7f1a836b3160>

    def test_flex_flow_build(self):
        from promptflow._cli._pf.entry import main
    
        origin_build = Path(f"{FLOWS_DIR}/export/flex_flow_build")
        with tempfile.TemporaryDirectory() as temp:
            temp = Path(temp)
            cmd = (
                "pf",
                "flow",
                "build",
                "--source",
                f"{EAGER_FLOWS_DIR}/chat-basic/flow.flex.yaml",
                "--output",
                temp.as_posix(),
                "--format",
                "docker",
            )
            sys.argv = list(cmd)
            main()
>           compare_directories(origin_build, temp)

/home/runner/work/promptflow/promptflow/src/promptflow-devkit/tests/sdk_cli_test/e2etests/test_cli.py:1364: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

dir1 = PosixPath('/home/runner/work/promptflow/promptflow/src/promptflow/tests/test_configs/flows/export/flex_flow_build')
dir2 = PosixPath('/tmp/tmpeixect1e')

    def compare_directories(dir1, dir2):
        dir1_content = list(dir1.iterdir())
        dir2_content = list(dir2.iterdir())
    
        sorted(dir1_content)
        sorted(dir2_content)
    
        for path1, path2 in zip(dir1_content, dir2_content):
            if path1.name == "__pycache__" and path2.name == "__pycache__":
                continue
            if path1.relative_to(dir1) != path2.relative_to(dir2):
>               raise Exception(f"{path1}, {path2} are different.")
E               Exception: /home/runner/work/promptflow/promptflow/src/promptflow/tests/test_configs/flows/export/flex_flow_build/flow, /tmp/tmpeixect1e/connections are different.

/home/runner/work/promptflow/promptflow/src/promptflow-devkit/tests/sdk_cli_test/e2etests/test_cli.py:79: Exception
View more details on GitHub Actions