Early Access
Please contact our support team for access to b10cache.torch.compile
results in a cache that can speed up future torch.compile
on the same function. This can speed up other replicasβ cold start times.
These files can be stored via b10cache. b10cache is a volume mounted over the network onto each of your pods. There are two ways files can be stored: