Demo a local daemonized cache with turborepo #475
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
🚀 Deployed on https://62864a4918eb9c04da106e91--limber.netlify.app |
NullVoxPopuli
force-pushed
the
local-daemoned-cache
branch
from
3c0f4c9
to
ff9e113
Compare
NullVoxPopuli
commented
May 6, 2022
| @@ -0,0 +1,5 @@ | |||
| { | |||
| "teamId": "team_my-fake-but-local-team", | |||
There was a problem hiding this comment.
per the docs, the teamId must begin with team_
NullVoxPopuli
commented
May 6, 2022
| @@ -21,6 +25,7 @@ | |||
| }, | |||
| "devDependencies": { | |||
| "concurrently": "^7.0.0", | |||
| "pm2": "^5.2.0", | |||
There was a problem hiding this comment.
NullVoxPopuli
commented
May 6, 2022
| "daemon": "pm2 start ./launch-daemon.sh", | ||
| "daemon:status": "pm2 ls", | ||
| "daemon:stop": "pm2 stop ./launch-daemon.sh", | ||
| "reset": "git clean -Xfd && pnpm install", |
There was a problem hiding this comment.
reset, before I learned rm -rf node_modules/.cache was sufficient for testing turbo's cache
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uses: https://github.com/fox1t/turborepo-remote-cache
Start the daemon with
pnpm run daemon(orpnpm exec pm2 start turborepo-remote-cache).pnpm exec pm2 lsThis PR demonstrates running from source (storing locally) because I didn't feel like re-figuring out docker installation or deal with s3 credentials.
For real usage, if using a local daemon, the booting of the daemon should be abstracted in the scripts themselves. This is done here. This way, starting the daemon is not a separate command folks have to remember.
Two ways to test that this works:
with just one repo (easiest)
This demo doesn't represent distributed usage, but would demonstrate how you can save time in larger monorepos when you delete node_modules, and start from scratch. (but in this case, you don't need to actually re-build everything)
local-daemoned-cachepnpm installpnpm run build-- these will all be "cache miss"node_modules/.cachepnpm run build-- these will all be "cache hit", as they are re-downloaded from the cache daemon. Without the daemon all packages will be "cache miss"with git worktrees (more realistic)
You will need two terminals
In Terminal 1
local-daemoned-cachegit worktree add -b daemon-2 ../tmp-limber-work-treepnpm installset -a; source ./.env.turboto load the environment variablespnpm run daemon:statusshows the daemon as stopped, runpnpm run daemonpnpm run build-- these will all be "cache miss", but will store the built assets in the build cacheIn Terminal 2
tmp-limber-work-treepnpm installset -a; source ./.env.turboto load the environment variablespnpm run build-- this should show "FULL TURBO", as the cache was hit for all packagesYou can verify built assets exist now by
ls -la **/*/dist/and verify again via
git clean -Xfd,pnpm install,pnpm run build-> FULL TURBO -> dist assets all exist again.