Skip to content
This repository has been archived by the owner on Sep 13, 2023. It is now read-only.

build: more formats to export your model #208

Open
2 of 11 tasks
aguschin opened this issue Apr 26, 2022 · 4 comments
Open
2 of 11 tasks

build: more formats to export your model #208

aguschin opened this issue Apr 26, 2022 · 4 comments
Labels
build Exporting models (building model packages) enhancement New feature or request help wanted Extra attention is needed serialization Dumping and loading Python objects ✨ epic High-level task that should be split into small ones

Comments

@aguschin
Copy link
Contributor

aguschin commented Apr 26, 2022 •
edited
Loading

MLEM could be a powerful tool if you need to distribute your model with different channels and use it in different circumstances (or easily switch between those). This could be a part of Value Props for us. So I think MLEM should be able to convert/build/export MLEM model to any widely used format and back, including:

  • Python package
  • Docker image
  • MLflow format
  • Seldon-compatible format
  • Pickle
  • .pt
  • .h5
  • apache TVM
  • onnx
  • Nvidia tensorrt
  • Explore integration with Ivy to export to ML frameworks other than the model was trained with

This list is going to be updated. Please feel free to post a comment or upvote the existing ones if you need something we don't support yet :)
@aguschin aguschin added enhancement New feature or request serialization Dumping and loading Python objects build Exporting models (building model packages) labels Apr 26, 2022
@daavoo
Copy link
Contributor

daavoo commented May 9, 2022

Would love https://onnx.ai/

@mike0sv mike0sv added this to the Q3 milestone Jun 1, 2022
@daavoo
Copy link
Contributor

daavoo commented Jun 9, 2022

And https://developer.nvidia.com/tensorrt :)

@aguschin aguschin changed the title Add more options to package your model More options to export your model Oct 3, 2022
@aguschin aguschin pinned this issue Oct 3, 2022
@aguschin aguschin added the ✨ epic High-level task that should be split into small ones label Oct 3, 2022
@aguschin aguschin changed the title More options to export your model build: more formats to export your model Oct 3, 2022
This was referenced Oct 17, 2022
Open
Closed
@aguschin aguschin removed this from the Q3 milestone Nov 9, 2022
@omesser omesser added the help wanted Extra attention is needed label Mar 20, 2023
@judahrand
Copy link

BentoML compatible format? Alternatively, it might be good to contribute a MLEM runner to BentoML?

@aguschin
Copy link
Contributor Author

aguschin commented May 24, 2023 •
edited
Loading

last comment is related to #265

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
build Exporting models (building model packages) enhancement New feature or request help wanted Extra attention is needed serialization Dumping and loading Python objects ✨ epic High-level task that should be split into small ones
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@mike0sv @aguschin @daavoo @judahrand @omesser