The cache on your terms
The cache on your terms
Turn the cache off, refresh it, or read one layer and write another. Every clone and worktree of a repo shares one store. And a pull request never writes what main reads.
A pull request should read what main built and never write where main reads. vx keeps task keys plain and lets the cache server decide: the CI token picks where a write lands, a header names which branches a read may see. How it works, and how a cache server builds its half.
A shared remote cache has two jobs that pull against each other. A
pull request should reuse everything main built, or CI is slow. And
nothing a pull request builds should ever be replayed on main, or one
non-hermetic build (or one hostile one) poisons every run after it.
Until now vx solved this on the client: a branch’s run derived a second
key per task from its branch scope and asked for either the plain key or
the scoped one. It worked, but it put the decision in the wrong place.
The client chose where to write, so only the client’s honesty kept a
branch out of main’s entries. vx now keeps task keys plain and leaves
both decisions to the server.
The OIDC token, checked against the server’s OIDC trust policy, is the only thing that decides where a write may land. A token that matches a trust rule writes the trusted cache. Any other token from the repository writes only its own branch’s cache. A missing token, or one from a repository no rule names, writes nothing. No header, key or client option can change that.
GitHub Actions and GitLab CI both mint a signed token per job that names the repository, the ref and the workflow. That is a fact the server can check, which a header or a key never is. So the server does not have to trust the client at all.
What the client still knows best is which branches a read should see.
A pull request from feat-x wants its own earlier results first, then
main’s. turboCache() names those refs on every read, own branch
first, in one header:
HEAD /v8/artifacts/0a1b2c3d4e5f6789x-artifact-read-scopes: refs/heads/feat-x, refs/heads/mainThe server walks the list and returns the first hit. The key is the
same on every branch, so a hit on main’s entry is the same bytes a
feat-x run would have built from the same inputs. A server that does
not know the header ignores it and keeps one shared cache, so nothing
breaks on a plain Turbo server.
CI’s refs come from its env: GITHUB_HEAD_REF or GITHUB_REF, then
GITHUB_BASE_REF on Actions; CI_COMMIT_REF_NAME, then
CI_MERGE_REQUEST_TARGET_BRANCH_NAME on GitLab. A merge queue reads its
base branch. On a laptop they come from git alone: the current branch,
then the default one (origin/HEAD). No API call, no PR lookup. That
works because a PR run writes to its head branch, so git checkout feat-x on a laptop asks for exactly what CI stored for feat-x.
scope | Key | Read request | For |
|---|---|---|---|
'header' (default) | hash(inputs) | plain key + x-artifact-read-scopes | servers that implement the rules below |
'key' | hash(inputs + ref) | one batch with each ref’s key, first hit wins | servers that ignore the header (Vercel) |
import { defineWorkspace } from '@vzn/vx/config'import { turboCache } from '@vzn/vx-migrate'
export default defineWorkspace({ plugins: [turboCache({ scope: 'key' })], // a server that ignores the header})'key' gives a header-blind server separate branch entries: a run
writes under its own ref’s key and asks every ref’s key in one batch.
That is isolation, not security: any writer can compute main’s key,
and that server checks nothing. Only a server can enforce, so
'header' is the default. nxCache() sends plain requests: the Nx cache spec has no
batch query, so a list of keys would cost one request per ref.
Everything below is the Turbo artifacts API (/v8/artifacts) plus one
header.
vx ships no cache server, so this is an example for one you run: a trust policy per team. A rule names token claims; each value is an exact string, a glob, or a list. A token matches a rule when every claim in it matches.
export default { trust: [ // GitHub: main and merge queue, only from the main-branch workflow { iss: 'https://token.actions.githubusercontent.com', repository_id: '123456789', event_name: ['push', 'merge_group'], // pull_request_target and issue_comment run PR code with ref=main ref: ['refs/heads/main', 'refs/heads/gh-readonly-queue/main/*'], ref_protected: 'true', // an unprotected branch can be pushed with unreviewed code job_workflow_ref: 'org/repo/.github/workflows/ci.yml@refs/heads/main', }, // GitLab: protected main, on our own runners { iss: 'https://gitlab.com', project_id: '4567', ref_path: 'refs/heads/main', ref_protected: 'true', pipeline_source: ['push', 'schedule'], // a manual pipeline can inject CI variables runner_environment: 'self-hosted', }, ],}Pin repository_id or project_id, not the name: after a rename or
delete, another repository can take the name, never the id. Trusted is main
and its merge queue only: anyone who can push can tag any commit, so a
tag’s run writes to its own scope, as a branch does.
Built into the server, not configurable. A token that matches no rule writes to:
refs/heads/<head_ref> on a PR run, otherwise ref. A PR
run writes to its head branch, so a laptop finds it from git alone.ref_path.Authorization: Bearer, and verify the signature (the issuer’s JWKS), iss, aud
and exp. Every read needs a token. Each developer creates their own
read-only token, and a shared read-only token may serve other CIs;
neither ever writes.aud must be this server’s own, so a token minted for
another service can’t be replayed here.PUT /v8/artifacts/:hash). A token that matches a rule
stores to trusted. Any other token stores to its write scope. A token
from a repository or project no rule names writes nothing. Entries
are immutable.GET and HEAD /v8/artifacts/:hash, and the batch
POST /v8/artifacts). For each ref in the header, in order: if it
matches a rule’s ref glob, look in trusted; otherwise look in that
ref’s scope. Return the first hit.repository_id,
project_id, or the read token’s repository). One team’s repositories
never share a branch.refs/... string; dedupe the
list and cap it at 8 refs. vx sends at most 8.| Run | Token holds | x-artifact-read-scopes | Server reads (first hit) | Server writes |
|---|---|---|---|---|
| main push | ref=refs/heads/main | refs/heads/main | trusted | trusted |
| merge queue | ref=refs/heads/gh-readonly-queue/main/… | refs/heads/gh-readonly-queue/main/…, refs/heads/main | trusted | trusted |
| PR #12 (feature→main) | ref=refs/pull/12/merge, head_ref=feature, base_ref=main | refs/heads/feature, refs/heads/main | feature, trusted | refs/heads/feature |
| branch push | ref=refs/heads/feature | refs/heads/feature, refs/heads/main | feature, trusted | refs/heads/feature |
| fork PR | no token | refs/heads/<head>, refs/heads/main | nothing (no token) | nothing |
| local on main | personal token (read-only) | refs/heads/main | trusted | nothing |
| local on feature | personal token (read-only) | refs/heads/feature, refs/heads/main | feature, trusted | nothing |
| Run | Token holds | x-artifact-read-scopes | Server reads (first hit) | Server writes |
|---|---|---|---|---|
| main pipeline | ref_path=refs/heads/main | refs/heads/main | trusted | trusted |
| merge train | ref_path=refs/heads/feature | refs/heads/feature, refs/heads/main | feature, trusted | nothing (client read-only) |
| MR or merged results (feature→main) | ref_path=refs/heads/feature | refs/heads/feature, refs/heads/main | feature, trusted | refs/heads/feature |
| branch pipeline | ref_path=refs/heads/feature | refs/heads/feature, refs/heads/main | feature, trusted | refs/heads/feature |
| fork MR | fork project’s token | refs/heads/feature, refs/heads/main | nothing (wrong project) | nothing (wrong project) |
| local on main | personal token (read-only) | refs/heads/main | trusted | nothing |
| local on feature | personal token (read-only) | refs/heads/feature, refs/heads/main | feature, trusted | nothing |
A GitLab token has no merge-train claim, so the server would store a train’s results in the source branch’s scope. Those results are built from the branch merged with main and the MRs ahead of it, so the branch almost never reuses them. The CI knows it is a train, so turn writes off there:
build: rules: - if: $CI_MERGE_REQUEST_EVENT_TYPE == "merge_train" variables: VX_CACHE_POLICY: local:rw,remote:r - when: on_successA stacked PR (feature-b→feature) reads feature-b, feature, main in CI
and feature-b, main on a laptop.
turboCache() gains scope: 'header' | 'key' and sends
x-artifact-read-scopes on every read. A PUT names no scope.nxCache() and turboCache() no longer send x-vx-cache-scope.VX_CACHE_SCOPE, github({ cacheScope }) and gitlab({ cacheScope })
now scope only what
plugins store themselves (ctx.cache, run records).The CI guide’s cache scopes and tokens has the setup.