Try quantizing yourself, just a suggestion.
https://github.com/pytorch/executorch/tree/main/examples/mod...
Hacker News new | past | comments | ask | show | jobs | submit Hacker News new | past | comments | ask | show | jobs | submithttps://github.com/pytorch/executorch/tree/main/examples/mod...