Loading...
Sleep-Time Compute(STC)
Use idle time between user interactions to do background reasoning instead of waiting for the next query. The agent reorganizes and compresses memory, precomputes likely-needed inferences, and pre-answers anticipated questions so work is shifted off the latency-critical path. At inference time the answer is largely ready, cutting test-time compute and latency.
Loading technique guide…
Sleep-Time Compute(STC)
Use idle time between user interactions to do background reasoning instead of waiting for the next query. The agent reorganizes and compresses memory, precomputes likely-needed inferences, and pre-answers anticipated questions so work is shifted off the latency-critical path. At inference time the answer is largely ready, cutting test-time compute and latency.
Loading technique guide…