News Sitemap
Publisher-focused discovery for recent news content.
Discovery infrastructure
Sitemaps engineered for large content sets.
A publisher-first sitemap layer with keyset/cursor processing, persistent checkpoints and shard preparation.
Processing model
Cursor, not offset.
Large datasets can be processed with ordered keyset queries and persistent progress instead of repeatedly scanning earlier rows.
ID > cursorORDEREDPipeline
1. Prepare
Build shard state.
2. Process
Advance checkpoints.
3. Publish
Serve ready XML.
4. Refresh
Self-reschedule.
Image Sitemap
Expose image assets associated with eligible content.
Video Sitemap
Structured video discovery for supported media content.