Hacker News new | past | comments | ask | show | jobs | submit
You need to optimize the KVCache part(save to disk to save compute) to achieve this goal.