Optionally push benchmark results to bencher.dev

[aochagavia]

Supersedes #4

Thanks @epompeii for the initial implementation!

@cpu do we need to adjust the flake file regarding the new git dependency? I tested nix develop followed by cargo check and it worked, so maybe no changes are necessary.

[epompeii]

Maybe make this a method for BencherDev?

[cpu]

@cpu do we need to adjust the flake file regarding the new git dependency? I tested nix develop followed by cargo check and it worked, so maybe no changes are necessary.

Yup! Because of the git patch the Cargo.lock isn't sufficient to specify the expected hashes for Nix. You'll see errors if you use nix build .# to build this branch's Rust application with Nix. When you use nix develop and then cargo the Nix parts are supplying the tooling but you're building with vanilla cargo instead of the package derivation.

We can fix the vendoring hashes for the git dependency, but I run into problems building bencher in the isolated Nix build environment that need more investigation.

Flake update for the cargoLock outputHashes:

39c39,49
<             cargoLock = { lockFile = "${crateDir}/Cargo.lock"; };
---
>             cargoLock = {
>               lockFile = "${crateDir}/Cargo.lock";
>               outputHashes = {
>                 "bencher_client-0.3.15" =
>                   "sha256-VWCQvcszAkny0VANH0o4FoIhe+6w0MgBJveWum44wS4=";
>                 "progenitor-0.4.0" =
>                   "sha256-XbZ0ioirI4sYYGyyhstNXEs2v3azlT5z8YE6Fyl3uB4=";
>                 "typify-0.0.14" =
>                   "sha256-PYX6I0qBTrCeRK6zMFxqwaRUvIrx9md7kGz+nRo/jIo=";
>               };
>             };

bencher_client build err:

   Compiling bencher_client v0.3.15 (https://github.com/bencherdev/bencher?rev=d0532976#d0532976)
error: failed to run custom build command for `bencher_client v0.3.15 (https://github.com/bencherdev/bencher?rev=d0532976#d0532976)`

Caused by:
  process didn't exit successfully: `/build/ci-bench-runner/target/release/build/bencher_client-6ab86101c605e1d5/build-script-build` (exit status: 101)
  --- stdout
  cargo:rerun-if-changed=../../services/console/src/content/api/swagger.json

  --- stderr
  thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Os { code: 2, kind: NotFound, message: "No such file or directory" }', /build/cargo-vendor-dir/bencher_client-0.3.1>
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

I think given the way this repo is being used we should remove the package derivation and just use Nix to manage the dev. environment. The package isn't very useful right now since the Ansible deployment isn't going to use it (it builds from src on the host). It probably isn't worth debugging this too deeply - we can merge as is and I'll remove the package from the flake.

[cpu]

Looks good!

[cpu]

Suggested change

	* (Optional) A Bencher.dev project and testbed, configured according to the
	* (Optional) A [Bencher.dev](https://bencher.dev/) project and testbed, configured according to the

[cpu]

I think given the way this repo is being used we should remove the package derivation and just use Nix to manage the dev. environment.

Here's a small patch for that: #7 No docs updates required, we only described the dev env in README.