Hacker News new | past | comments | ask | show | jobs | submit
I've switched over to Candle. I quite like it so far, and its significantly reduced my app size while having the same speed. The compiled nature of it means you need to implement your model in a pytorch-like API, but the compiler removes all unused ops which was a pain to do in onnxruntime.