Release hydroflow_lang v0.9.0, hydroflow_datalog_core v0.9.0, hydrofl…

…ow_datalog v0.9.0, hydroflow_deploy_integration v0.9.0, hydroflow_macro v0.9.0, lattices_macro v0.5.6, lattices v0.5.7, multiplatform_test v0.2.0, variadics v0.0.6, pusherator v0.0.8, hydroflow v0.9.0, stageleft_macro v0.3.0, stageleft v0.4.0, stageleft_tool v0.3.0, hydroflow_plus v0.9.0, hydro_deploy v0.9.0, hydro_cli v0.9.0, hydroflow_plus_deploy v0.9.0, safety bump 8 crates SAFETY BUMP: hydroflow_datalog_core v0.9.0, hydroflow_datalog v0.9.0, hydroflow_macro v0.9.0, hydroflow v0.9.0, stageleft v0.4.0, hydroflow_plus v0.9.0, hydro_cli v0.9.0, hydroflow_plus_deploy v0.9.0
nickjiang2378 · Aug 30, 2024 · 0750117 · 0750117
1 parent a2ec110
commit 0750117
Show file tree

Hide file tree

Showing 41 changed files with 1,326 additions and 466 deletions.
diff --git a/Cargo.lock b/Cargo.lock
diff --git a/hydro_deploy/core/CHANGELOG.md b/hydro_deploy/core/CHANGELOG.md
@@ -5,8 +5,146 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## v0.9.0 (2024-08-30)
+
+### Chore
+
+ - <csr-id-a2ec110ccadb97e293b19d83a155d98d94224bba/> manually set versions for crates renamed in #1413
+ - <csr-id-11af32828bab6e4a4264d2635ff71a12bb0bb778/> lower min dependency versions where possible, update `Cargo.lock`
+   Moved from #1418
+
+   ---------
+
+### Documentation
+
+ - <csr-id-f5f1eb0c612f5c0c1752360d972ef6853c5e12f0/> cleanup doc comments for clippy latest
+
+### New Features
+
+ - <csr-id-6568263e03899d4e96837690e6e59284c194d7ff/> Add end-to-end flamegraph generation for macos and linux localhost, fix #1351
+ - <csr-id-fedd3ef60fe16ab862244d816f7973269a7295e8/> improve progress UX by collapsing nested groups
+   Now, when a group only has a single active task, we skip printing a line
+   for the group itself and instead collapse its information into the line
+   for the inner task (recursively as necessary). This allows us to show
+   more fine grained progress without overflowing the console.
+ - <csr-id-46a8a2cb08732bb21096e824bc4542d208c68fb2/> use trybuild to compile subgraph binaries
+
+### Bug Fixes
+
+ - <csr-id-c4683caca43f2927694c920b43ef35a6d1629eaa/> only record usermode events in perf
+   When kernel stacks are included, the DWARF traces can become corrupted /
+   overflown leading to flamegraphs with broken parents. We only are
+   interested in usermode, anyways, and can measure I/O overhead through
+   other methods.
+ - <csr-id-63b528feeb2e6dac2ed12c02b2e39e0d42133a74/> only instantiate `Localhost` once
+ - <csr-id-654b77d8f65ae6eb62c164a2d736168ff96cb168/> avoid Terraform crashing on empty provider block
+
+### Refactor
+
+ - <csr-id-a88a550cefde3a56790859127edc6a4e27e07090/> adjust `ProgressTracker::println`
+   A small refactor pulled out of the perf tracing work, barely related to
+   #1359
+ - <csr-id-77246e77df47a0006dcb3eaeeb76882efacfd25c/> cleanup handling of arc `Weak` in `deployment.rs`
+
+### Style
+
+ - <csr-id-3fde68d0db0414017cfb771a218b14b8f57d1686/> use `name_of!` macro
+
+### New Features (BREAKING)
+
+ - <csr-id-749a10307f4eff2a46a1056735e84ed94d44b39e/> Perf works over SSH
+   See documentation on how to use in
+   [Notion](https://www.notion.so/hydro-project/perf-Measuring-CPU-usage-6135b6ce56a94af38eeeba0a55deef9c).
+
+### Refactor (BREAKING)
+
+ - <csr-id-0a465e55dd39c76bc1aefb020460a639d792fe87/> rename integration crates to drop CLI references
+ - <csr-id-128aaecd40edce57dc254afdcd61ecd5b9948d71/> simplify process/cluster specs
+   ---
+   [//]: # (BEGIN SAPLING FOOTER)
+   Stack created with [Sapling](https://sapling-scm.com). Best reviewed
+   with
+   [ReviewStack](https://reviewstack.dev/hydro-project/hydroflow/pull/1394).
+   * #1395
+   * __->__ #1394
+ - <csr-id-bb081d3b0af6dbce9630e23dfe8b7d1363751c2b/> end-to-end flamegraph generation, fix #1365
+   Depends on #1370
+ - <csr-id-a2147864b24110c9ae2c1553e9e8b55bd5065f15/> `Deployment.stop()` for graceful shutdown including updated `perf` profile downloading
+   * `perf` profile downloading moved from the `drop()` impl to `async fn
+   stop()`
+   * download perf data via stdout
+   * update async-ssh2-lite to 0.5 to cleanup tokio compat issues
+
+   WIP for #1365
+ - <csr-id-8856c8596d5ad9d5f24a46467690bfac1549fae2/> use `buildstructor` to handle excessive `Deployment` method arguments, fix #1364
+   Adds new method `Deployment::AzureHost`
+
+### Commit Statistics
+
+<csr-read-only-do-not-edit/>
+
+ - 19 commits contributed to the release.
+ - 18 commits were understood as [conventional](https://www.conventionalcommits.org).
+ - 17 unique issues were worked on: [#1313](https://github.com/hydro-project/hydroflow/issues/1313), [#1360](https://github.com/hydro-project/hydroflow/issues/1360), [#1366](https://github.com/hydro-project/hydroflow/issues/1366), [#1369](https://github.com/hydro-project/hydroflow/issues/1369), [#1370](https://github.com/hydro-project/hydroflow/issues/1370), [#1372](https://github.com/hydro-project/hydroflow/issues/1372), [#1378](https://github.com/hydro-project/hydroflow/issues/1378), [#1394](https://github.com/hydro-project/hydroflow/issues/1394), [#1396](https://github.com/hydro-project/hydroflow/issues/1396), [#1398](https://github.com/hydro-project/hydroflow/issues/1398), [#1403](https://github.com/hydro-project/hydroflow/issues/1403), [#1411](https://github.com/hydro-project/hydroflow/issues/1411), [#1413](https://github.com/hydro-project/hydroflow/issues/1413), [#1423](https://github.com/hydro-project/hydroflow/issues/1423), [#1428](https://github.com/hydro-project/hydroflow/issues/1428), [#1429](https://github.com/hydro-project/hydroflow/issues/1429), [#1431](https://github.com/hydro-project/hydroflow/issues/1431)
+
+### Commit Details
+
+<csr-read-only-do-not-edit/>
+
+<details><summary>view details</summary>
+
+ * **[#1313](https://github.com/hydro-project/hydroflow/issues/1313)**
+    - Fixup! feat(hydro_deploy)!: Perf works over SSH ([`220b5bc`](https://github.com/hydro-project/hydroflow/commit/220b5bce4fbf1af5e14ebe5aa73da7a7e668fea7))
+    - Perf works over SSH ([`749a103`](https://github.com/hydro-project/hydroflow/commit/749a10307f4eff2a46a1056735e84ed94d44b39e))
+ * **[#1360](https://github.com/hydro-project/hydroflow/issues/1360)**
+    - Avoid Terraform crashing on empty provider block ([`654b77d`](https://github.com/hydro-project/hydroflow/commit/654b77d8f65ae6eb62c164a2d736168ff96cb168))
+ * **[#1366](https://github.com/hydro-project/hydroflow/issues/1366)**
+    - Use `buildstructor` to handle excessive `Deployment` method arguments, fix #1364 ([`8856c85`](https://github.com/hydro-project/hydroflow/commit/8856c8596d5ad9d5f24a46467690bfac1549fae2))
+ * **[#1369](https://github.com/hydro-project/hydroflow/issues/1369)**
+    - Cleanup handling of arc `Weak` in `deployment.rs` ([`77246e7`](https://github.com/hydro-project/hydroflow/commit/77246e77df47a0006dcb3eaeeb76882efacfd25c))
+ * **[#1370](https://github.com/hydro-project/hydroflow/issues/1370)**
+    - `Deployment.stop()` for graceful shutdown including updated `perf` profile downloading ([`a214786`](https://github.com/hydro-project/hydroflow/commit/a2147864b24110c9ae2c1553e9e8b55bd5065f15))
+ * **[#1372](https://github.com/hydro-project/hydroflow/issues/1372)**
+    - End-to-end flamegraph generation, fix #1365 ([`bb081d3`](https://github.com/hydro-project/hydroflow/commit/bb081d3b0af6dbce9630e23dfe8b7d1363751c2b))
+ * **[#1378](https://github.com/hydro-project/hydroflow/issues/1378)**
+    - Adjust `ProgressTracker::println` ([`a88a550`](https://github.com/hydro-project/hydroflow/commit/a88a550cefde3a56790859127edc6a4e27e07090))
+ * **[#1394](https://github.com/hydro-project/hydroflow/issues/1394)**
+    - Simplify process/cluster specs ([`128aaec`](https://github.com/hydro-project/hydroflow/commit/128aaecd40edce57dc254afdcd61ecd5b9948d71))
+ * **[#1396](https://github.com/hydro-project/hydroflow/issues/1396)**
+    - Add end-to-end flamegraph generation for macos and linux localhost, fix #1351 ([`6568263`](https://github.com/hydro-project/hydroflow/commit/6568263e03899d4e96837690e6e59284c194d7ff))
+ * **[#1398](https://github.com/hydro-project/hydroflow/issues/1398)**
+    - Use trybuild to compile subgraph binaries ([`46a8a2c`](https://github.com/hydro-project/hydroflow/commit/46a8a2cb08732bb21096e824bc4542d208c68fb2))
+ * **[#1403](https://github.com/hydro-project/hydroflow/issues/1403)**
+    - Only instantiate `Localhost` once ([`63b528f`](https://github.com/hydro-project/hydroflow/commit/63b528feeb2e6dac2ed12c02b2e39e0d42133a74))
+ * **[#1411](https://github.com/hydro-project/hydroflow/issues/1411)**
+    - Improve progress UX by collapsing nested groups ([`fedd3ef`](https://github.com/hydro-project/hydroflow/commit/fedd3ef60fe16ab862244d816f7973269a7295e8))
+ * **[#1413](https://github.com/hydro-project/hydroflow/issues/1413)**
+    - Rename integration crates to drop CLI references ([`0a465e5`](https://github.com/hydro-project/hydroflow/commit/0a465e55dd39c76bc1aefb020460a639d792fe87))
+ * **[#1423](https://github.com/hydro-project/hydroflow/issues/1423)**
+    - Lower min dependency versions where possible, update `Cargo.lock` ([`11af328`](https://github.com/hydro-project/hydroflow/commit/11af32828bab6e4a4264d2635ff71a12bb0bb778))
+ * **[#1428](https://github.com/hydro-project/hydroflow/issues/1428)**
+    - Cleanup doc comments for clippy latest ([`f5f1eb0`](https://github.com/hydro-project/hydroflow/commit/f5f1eb0c612f5c0c1752360d972ef6853c5e12f0))
+ * **[#1429](https://github.com/hydro-project/hydroflow/issues/1429)**
+    - Use `name_of!` macro ([`3fde68d`](https://github.com/hydro-project/hydroflow/commit/3fde68d0db0414017cfb771a218b14b8f57d1686))
+ * **[#1431](https://github.com/hydro-project/hydroflow/issues/1431)**
+    - Only record usermode events in perf ([`c4683ca`](https://github.com/hydro-project/hydroflow/commit/c4683caca43f2927694c920b43ef35a6d1629eaa))
+ * **Uncategorized**
+    - Manually set versions for crates renamed in #1413 ([`a2ec110`](https://github.com/hydro-project/hydroflow/commit/a2ec110ccadb97e293b19d83a155d98d94224bba))
+</details>
+
 ## v0.8.0 (2024-07-23)
 
+<csr-id-e3e69334fcba8488b6fad3975fb0ba88e82a4b02/>
+<csr-id-0feae7454e4674eea1f3308b3d6d4e9d459cda67/>
+<csr-id-947ebc1cb21a07fbfacae4ac956dbd0015a8a418/>
+<csr-id-22865583a4260fe401c28aa39a74987478edc73d/>
+<csr-id-c5a8de28e7844b3c29d58116d8340967f2e6bcc4/>
+<csr-id-f536eccf7297be8185108b60897e92ad0efffe4a/>
+<csr-id-057a0a510568cf81932368c8c65e056f91af7202/>
+<csr-id-60390782dd7dcec18d193c800af716843a944dba/>
+<csr-id-141eae1c3a1869fa42756250618a21ea2a2c7e34/>
+<csr-id-12b8ba53f28eb9de1318b41cdf1e23282f6f0eb6/>
+
 ### Refactor
 
  - <csr-id-e3e69334fcba8488b6fad3975fb0ba88e82a4b02/> remove unneeded `Arc<RwLock<` wrapping of `launch_binary` return value (1/3)
@@ -57,8 +195,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 <csr-read-only-do-not-edit/>
 
- - 10 commits contributed to the release over the course of 10 calendar days.
- - 59 days passed between releases.
+ - 11 commits contributed to the release.
  - 10 commits were understood as [conventional](https://www.conventionalcommits.org).
  - 10 unique issues were worked on: [#1334](https://github.com/hydro-project/hydroflow/issues/1334), [#1338](https://github.com/hydro-project/hydroflow/issues/1338), [#1339](https://github.com/hydro-project/hydroflow/issues/1339), [#1340](https://github.com/hydro-project/hydroflow/issues/1340), [#1343](https://github.com/hydro-project/hydroflow/issues/1343), [#1345](https://github.com/hydro-project/hydroflow/issues/1345), [#1346](https://github.com/hydro-project/hydroflow/issues/1346), [#1347](https://github.com/hydro-project/hydroflow/issues/1347), [#1348](https://github.com/hydro-project/hydroflow/issues/1348), [#1356](https://github.com/hydro-project/hydroflow/issues/1356)
 
@@ -88,6 +225,8 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
     - Make `Service::collect_resources` take `&self` instead of `&mut self` ([`2286558`](https://github.com/hydro-project/hydroflow/commit/22865583a4260fe401c28aa39a74987478edc73d))
  * **[#1356](https://github.com/hydro-project/hydroflow/issues/1356)**
     - Replace `async-channel` with `tokio::sync::mpsc::unbounded_channel` ([`6039078`](https://github.com/hydro-project/hydroflow/commit/60390782dd7dcec18d193c800af716843a944dba))
+ * **Uncategorized**
+    - Release hydroflow_lang v0.8.0, hydroflow_datalog_core v0.8.0, hydroflow_datalog v0.8.0, hydroflow_macro v0.8.0, lattices_macro v0.5.5, lattices v0.5.6, variadics v0.0.5, pusherator v0.0.7, hydroflow v0.8.0, hydroflow_plus v0.8.0, hydro_deploy v0.8.0, hydro_cli v0.8.0, hydroflow_plus_cli_integration v0.8.0, safety bump 7 crates ([`ca6c16b`](https://github.com/hydro-project/hydroflow/commit/ca6c16b4a7ce35e155fe7fc6c7d1676c37c9e4de))
 </details>
 
 ## v0.7.0 (2024-05-24)
@@ -105,8 +244,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 <csr-read-only-do-not-edit/>
 
- - 3 commits contributed to the release over the course of 41 calendar days.
- - 44 days passed between releases.
+ - 3 commits contributed to the release.
  - 2 commits were understood as [conventional](https://www.conventionalcommits.org).
  - 2 unique issues were worked on: [#1129](https://github.com/hydro-project/hydroflow/issues/1129), [#1157](https://github.com/hydro-project/hydroflow/issues/1157)
 
@@ -136,8 +274,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 <csr-read-only-do-not-edit/>
 
- - 4 commits contributed to the release over the course of 34 calendar days.
- - 38 days passed between releases.
+ - 4 commits contributed to the release.
  - 1 commit was understood as [conventional](https://www.conventionalcommits.org).
  - 1 unique issue was worked on: [#1090](https://github.com/hydro-project/hydroflow/issues/1090)
 
@@ -178,8 +315,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 <csr-read-only-do-not-edit/>
 
- - 4 commits contributed to the release over the course of 6 calendar days.
- - 31 days passed between releases.
+ - 4 commits contributed to the release.
  - 3 commits were understood as [conventional](https://www.conventionalcommits.org).
  - 3 unique issues were worked on: [#1015](https://github.com/hydro-project/hydroflow/issues/1015), [#1043](https://github.com/hydro-project/hydroflow/issues/1043), [#1084](https://github.com/hydro-project/hydroflow/issues/1084)
 
@@ -238,7 +374,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 <csr-read-only-do-not-edit/>
 
- - 12 commits contributed to the release over the course of 39 calendar days.
+ - 12 commits contributed to the release.
  - 11 commits were understood as [conventional](https://www.conventionalcommits.org).
  - 9 unique issues were worked on: [#1010](https://github.com/hydro-project/hydroflow/issues/1010), [#1014](https://github.com/hydro-project/hydroflow/issues/1014), [#986](https://github.com/hydro-project/hydroflow/issues/986), [#987](https://github.com/hydro-project/hydroflow/issues/987), [#992](https://github.com/hydro-project/hydroflow/issues/992), [#994](https://github.com/hydro-project/hydroflow/issues/994), [#995](https://github.com/hydro-project/hydroflow/issues/995), [#996](https://github.com/hydro-project/hydroflow/issues/996), [#999](https://github.com/hydro-project/hydroflow/issues/999)
 

diff --git a/hydro_deploy/core/Cargo.toml b/hydro_deploy/core/Cargo.toml
@@ -1,7 +1,7 @@
 [package]
 name = "hydro_deploy"
 publish = true
-version = "0.8.0"
+version = "0.9.0"
 edition = "2021"
 license = "Apache-2.0"
 documentation = "https://docs.rs/hydro_deploy/"