Functional tests for WP-CLI commands

[swissspidy]

Description of the Change

This PR sets up the necessary infrastructure for running Behat tests for the built-in WP-CLI commands.

Also sets up code coverage, which is quite convenient.

How to test the Change

Run the tests locally or check out the CI build status.

Changelog Entry

Added - Functional tests for WP-CLI command

Credits

Checklist:

• I agree to follow this project's Code of Conduct.
• I have updated the documentation accordingly.
• I have added tests to cover my change.
• All new and existing tests pass.

[mukeshpanchal27]

Thank you, @swissspidy, for the PR. I have reviewed it initially and would like to discuss a few questions:

• Do we have any plans to add new tests in Behat?
• Considering that Behat uses Gherkin syntax, there might be a learning curve for us. How do we plan to address this?
• Are we going to maintain both Unit tests and Behat tests simultaneously?

[swissspidy]

Great questions!

• Do we have any plans to add new tests in Behat?

Right now this PR just lays the foundation for the tests. New tickets can be created to add a few more tests. Not too many tests are needed because the command is rather straightforward and only has a few options.

• Considering that Behat uses Gherkin syntax, there might be a learning curve for us. How do we plan to address this?

Luckily the syntax is pretty easy to grasp, making it easy to understand and write tests, plus there's plenty of documentation and tutorials out there. And of course I'm happy to do an intro as well if there's interest.

• Are we going to maintain both Unit tests and Behat tests simultaneously?

Yes, these tests are an addition to the existing PHPUnit-based tests in the repo, focusing on how users interact with the WP-CLI command. There is little overlap. Just like e2e tests and unit/integration tests are not mutually exclusive. So I guess these could be seen as e2e tests for the WP-CLI command :-)

[codecov]

Welcome to Codecov 🎉

Once merged to your default branch, Codecov will compare your coverage reports and display the results in this comment.

Thanks for integrating Codecov - We've got you covered ☂️

[swissspidy]

@felixarntz @westonruter @joemcgill @mukeshpanchal27 Pinging you since this PR has been around for a long time but it's still valuable — this adds some initial Behat tests for the WP-CLI command added by this plugin.

We need this to ensure the command works properly, especially when making changes. Also with #153 in mind.

[mukeshpanchal27]

Thanks @swissspidy, LGTM.

[felixarntz]

@swissspidy LGTM, just one question before merge.