Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
maged
on Aug 18, 2024
|
parent
|
context
|
favorite
| on:
Prompt Caching
Why not? It's caching the state of the model after the cached prefix, so that inference workload doesn't need to be run again.
Consider applying for YC's Winter 2027 batch!
Applications
are open till November 2.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
