Hacker News new | past | comments | ask | show | jobs | submit
Because this doesn't prompt cache? Prompt caching is dumping out the calculated values from vRAM onto disk and reloading them back into memory as necessary.