Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Do your have plan to Run TFLite models in Python or Java ? #7

Open
2 tasks
caofx0418 opened this issue Jul 30, 2023 · 0 comments
Open
2 tasks

Do your have plan to Run TFLite models in Python or Java ? #7

caofx0418 opened this issue Jul 30, 2023 · 0 comments

Comments

@caofx0418
Copy link

Do your have plan to Run TFLite models in Python or Java ?

On-Device Deployment (w/ TFLite) - WIP

We have managed to convert SavedModels into TFLite models, and we are hosting them as below (thanks to @farmaker47):

These TFLite models have the same signature as the SavedModels, and all the pre/post operations are included inside. All of them are converted with float16 quantization optimize process. You can find more about how to convert SavedModels to TFLite models in this repository.

TODO

  • Implement SimpleTokenizer in JAVA and JavaScript
  • Run TFLite models on Android and Web browser
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant