-
Notifications
You must be signed in to change notification settings - Fork 125
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update the default buildpacks to use paketo and add a tip for tilt #119
base: main
Are you sure you want to change the base?
Changes from 1 commit
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -43,7 +43,7 @@ to run the image build on the cloud and continuously build/deploy new versions f | |
|
||
### Use pack to build and push the custom model server image | ||
```bash | ||
pack build --builder=heroku/buildpacks:20 ${DOCKER_USER}/custom-model:v1 | ||
pack build --builder paketobuildpacks/builder:base ${DOCKER_USER}/custom-model:v1 | ||
sambhav marked this conversation as resolved.
Show resolved
Hide resolved
|
||
docker push ${DOCKER_USER}/custom-model:v1 | ||
``` | ||
|
||
|
@@ -93,6 +93,8 @@ curl localhost:8080/v1/models/custom-model:predict -d @./input.json | |
|
||
{"predictions": [[14.861763000488281, 13.94291877746582, 13.924378395080566, 12.182709693908691, 12.00634765625]]} | ||
``` | ||
!!! tip | ||
You can also use [`tilt`](https://tilt.dev/) along with `pack` and [`paketo`](https://paketo.io/) Buildpacks allowing you make code changes and have them reflected live in your custom inference service. For more details see - [Paketo Python Buildpacks - Enable Process Reloading](https://paketo.io/docs/howto/python/#enable-process-reloading) | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. This looks cool, you can create the Tiltfile like following for continuous dev development, we might want to add a bit more instruction for how to do this.
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. The tiltfile I am using looks a bit like - # -*- mode: Python -*-
version_settings(constraint='>=0.22.1')
load('ext://pack', 'pack')
docker_compose('docker-compose.yml')
pack('myapp',
builder="paketobuildpacks/builder:full",
live_update=[
sync('.', '/workspace'),
]
) |
||
|
||
## Deploy the Custom Predictor on KServe | ||
### Create the InferenceService | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@samj1912 getting the following error with paketobuildpack, it is working fine with heroku buildpack or manually crafted Dockerfile.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@yuzisun it should work now.