Repository navigation

Add robots.txt rules from modules - #1301

Closed

Jamesr51d wants to merge 482 commits into

IABTechLab:mainfrom

jwrosewell:split/14-robots-txt

Closed

Add robots.txt rules from modules#1301
Jamesr51d wants to merge 482 commits into
IABTechLab:mainfrom
jwrosewell:split/14-robots-txt

This pull request is big! We're only showing the most recent 250 commits

Commits on Sep 25, 2026
Commits on Oct 6, 2026
Commits on Oct 7, 2026
Commits on Oct 8, 2026
- Next.js moves out of core
  jwrosewell
  committed
  215c5dc
- Google Publisher Tags moves out of core
  jwrosewell
  committed
  5f0e9c0
- A module acts on one request without core naming it
  jwrosewell
  committed
  ccdae38
- The Google Publisher Tags diagnostics module moves out of core
  jwrosewell
  committed
  4f8fd2a
- A module declares its own secret settings
  jwrosewell
  committed
  4087052
- DataDome moves out of core
  jwrosewell
  committed
  609154d
- The audit generator asks the stock list where a module is selected
  jwrosewell
  committed
  e08ef73
- A module registers and validates against the auction plan
  jwrosewell
  committed
  d31e511
- The mock ad server moves out of core
  jwrosewell
  committed
  549cbb7
- APS moves out of core
  jwrosewell
  committed
  a1339c9
- Prebid's file is divided between the page integration and the demand
  jwrosewell
  committed
  27648c0
- Prebid moves out of core
  jwrosewell
  committed
  39f1240
- The Prebid Server demand moves out of core
  jwrosewell
  committed
  dd7f232
- The Fastly adapter's test fixtures compile their plan with the stock list
  jwrosewell
  committed
  2e60184
- The guides say where an integration lives
  jwrosewell
  committed
  8aba9c4
- Prebid raises the integration error every module raises
  jwrosewell
  committed
  3481121
- Core drops an ad server model and an error variant nothing uses
  jwrosewell
  committed
  e1b6513
- Prebid's request extension types go with the provider that writes them
  jwrosewell
  committed
  036618b
- Routing's zone limit and transport headers are named for what they are
  jwrosewell
  committed
  4db59c8
- Every crate outside core names its maintainers
  jwrosewell
  committed
  7689923
- Merge upstream main 182fdf4 into split/1-ec-provider
  jwrosewell
  committed
  d33507b
- Merge split/1-ec-provider at d33507b32 into split/2-device-geo
  jwrosewell
  committed
  47551a6
- Merge split/2-device-geo at 47551a622 into split/3-permissions
  jwrosewell
  committed
  0afd715
- Merge split/3-permissions at 0afd715c5 into split/4-client-resolve
  jwrosewell
  committed
  e7623de
- Merge split/4-client-resolve at e7623de78 into split/5-response-hook-docs
  jwrosewell
  committed
  3c7ef00
- Merge split/5-response-hook-docs at 3c7ef00e7 into split/7-integration-seam-impl
  jwrosewell
  committed
  a90a141
- Every tool and test that validates settings registers the stock modules
  jwrosewell
  committed
  9ce9e3e
- Merge split/7-integration-seam-impl at a90a141bc into the move of the modules
  jwrosewell
  committed
  1e2577e
- The Viceroy generator's test loads its blob with the stock modules
  jwrosewell
  committed
  190ea05
- The plain OpenRTB demand moves out of core
  jwrosewell
  committed
  f5a2858
- Merge the move of the integration modules out of core into split/7-integration-seam-impl
  jwrosewell
  committed
  49bdf21
- Add one module context and the adapter that injects what a module names
  jwrosewell
  committed
  01305cf
- The device module is handed the module context
  jwrosewell
  committed
  8921de1
- The Edge Cookie module is handed the module context
  jwrosewell
  committed
  80a3527
- The permission signal modules are handed the module context
  jwrosewell
  committed
  4350d15
- Module routes are handed the module context
  jwrosewell
  committed
  8d18b40
- The module context carries only what a module is handed
  jwrosewell
  committed
  d48858f
- The integration guide says what a module is handed
  jwrosewell
  committed
  e8c7ef5
- The permissions resolved for a request are readable at /_ts/permissions
  jwrosewell
  committed
  52c8eba
- Core builds a masked view of the configuration it runs
  jwrosewell
  committed
  5fb5f07
- Every adapter serves the configuration at /_ts/config
  jwrosewell
  committed
  3c72517
- Core shows a reader what is held against their Edge Cookie
  jwrosewell
  committed
  16771b1
- Every adapter serves what is held against a reader at /_ts/data
  jwrosewell
  committed
  33282f0
- Record the page each module's hooks produce, before the hooks change form
  jwrosewell
  committed
  9ee13c5
Commits on Oct 9, 2026
- Write a rewritten script back as the rewriter gave it
  jwrosewell
  committed
  68cb6c3
- Write script text held for a marker in the order it came
  jwrosewell
  committed
  9500037
- A page change can be a middleware that an entry places
  jwrosewell
  committed
  0b21fe3
- A page change can run for each reader, as a serve middleware
  jwrosewell
  committed
  4600b1c
- The Fastly adapter's probe tests cover a serve entry at startup
  jwrosewell
  committed
  9b4cb4c
- Two entries for the same pages are told to share one list
  jwrosewell
  committed
  e0bf6f2
- Helpers for a module's own tests of its middleware
  jwrosewell
  committed
  e17e058
- The GPT bootstrap script reaches a page with one set of line endings
  jwrosewell
  committed
  47ab129
- Testlight's page change is a middleware
  jwrosewell
  committed
  04c7bf3
- Permutive's page change is a middleware
  jwrosewell
  committed
  1e36ef2
- lockr's page change is a middleware
  jwrosewell
  committed
  b37c64b
- Didomi's page change is a middleware
  jwrosewell
  committed
  33d6790
- Sourcepoint's page changes are one middleware
  jwrosewell
  committed
  b97c5b4
- Google Tag Manager's page changes are one middleware
  jwrosewell
  committed
  c64c9c4
- DataDome's page changes are two middleware, one in each phase
  jwrosewell
  committed
  a6c4be1
- Prebid's page changes are one middleware
  jwrosewell
  committed
  4d6e7b2
- A registration states the attributes it puts on the bundle's tag
  jwrosewell
  committed
  60732a7
- APS states its bundle tag attribute and changes no page
  jwrosewell
  committed
  99066ff
- GPT's page changes are one middleware
  jwrosewell
  committed
  cb72186
- GPT diagnostics writes into a reader's copy as a serve middleware
  jwrosewell
  committed
  847a02d
- Next.js's page changes are one middleware
  jwrosewell
  committed
  d81b56b
- The JavaScript asset proxy changes a page as a middleware
  jwrosewell
  committed
  d4d5fe1
- Core's deferred and payload stand-ins change a page as middleware
  jwrosewell
  committed
  0b6c1e3
- Core's request stand-in writes into a reader's copy as a serve middleware
  jwrosewell
  committed
  072e362
- Test the two attributes core rewrites that nothing asserted on
  jwrosewell
  committed
  a00b005
- The four page hook traits are removed
  jwrosewell
  committed
  7e039ae
- The stock list says which middleware its modules supply
  jwrosewell
  committed
  3352f8d
- `ts audit` places the page changes of the modules it selects
  jwrosewell
  committed
  21623bb
- What was named for a hook is named for the middleware
  jwrosewell
  committed
  c4c4076
- A Fastly sandbox keeps an application for each app-config key
  jwrosewell
  committed
  448f41d
- A `__KEY` selector with `{host}` names an app-config blob for each host
  jwrosewell
  committed
  e802375
- A harness serves two publishers from one local Viceroy instance
  jwrosewell
  committed
  0e4f153
- The guides say how one service serves several publishers
  jwrosewell
  committed
  64750a4
- A build reports when and from what it was made
  jwrosewell
  committed
  12301a6
- Signed evidence of who operates a deployment and which build it runs
  jwrosewell
  committed
  4edaec8
- Every adapter serves the attestation pages
  jwrosewell
  committed
  94ae6a2
- The attestation guide, for an operator, a relying party and a reviewer
  jwrosewell
  committed
  dffb3b2
- What a key schedule may hold is tested
  jwrosewell
  committed
  896942c
- A harness checks the evidence as a verifier would
  jwrosewell
  committed
  a4cebd8
- The permissions inspector's lock file takes the two signing crates
  jwrosewell
  committed
  1060456
- ts keys rotates and retires the signing keys through the host
  jwrosewell
  committed
  e95ca11
- ts cache purge asks the host to purge
  jwrosewell
  committed
  95f4346
- The Edge Cookie lookups under /_ts/admin are removed
  jwrosewell
  committed
  492f172
- Key rotation leaves the publisher's domain
  jwrosewell
  committed
  86c9344
- The signing store ids leave the settings
  jwrosewell
  committed
  f0b4379
- The service holds no token for its own platform's API
  jwrosewell
  committed
  b4a22e9
- The cache purge route is removed
  jwrosewell
  committed
  57fa6dc
- No request is asked for a password
  jwrosewell
  committed
  3720762
- Bot protection is asked about the publisher's admin paths
  jwrosewell
  committed
  a5a8704
- A module can add rules to robots.txt, and core writes the file
  jwrosewell
  committed
  31dd42d
- The seam probe supplies a robots.txt contributor
  jwrosewell
  committed
  0188f5d
- Every adapter serves /robots.txt and the refusal's response header
  jwrosewell
  committed
  3701fbc
- The guides describe [robots-txt]
  jwrosewell
  committed
  6d27af2
Commits on Oct 12, 2026
Commits on Oct 13, 2026

Commits

Commits on Sep 25, 2026

Commits on Oct 6, 2026

Commits on Oct 7, 2026

Commits on Oct 8, 2026