◎ Discry Score
pagerduty.com
devtools · API
D
0 / 100
DISCOVERY0
COMPREHENSION0
Category leader: 96 (A)
Discry your API →
DEVTOOLS · RANK #33 OF 39

PagerDuty is Poor to agents.

Discry independently scored how well an AI agent can discover and understand the PagerDuty API from what’s public — not whether it’s usable. Below: every signal we checked, what’s costing the score, and what to change.

Discry your API — freeView the docs ↗

SCORED UNDER RUBRIC 1.2 · A full re-launch under Discry Score 2.5 — a new behavioral instrument, not comparable to these scores — is in progress.

Discovery

45% of score · 29/100
OpenAPI specA machine-readable OpenAPI/Swagger spec agents can parse.Pass
llms.txtAn llms.txt index that points agents to the docs that matter.Fail
llms.txt qualityThe llms.txt is focused, current, and well under the size budget.Fail
llms-full.txtA full-text bundle agents can load in one request.Fail
AGENTS.mdAn AGENTS.md that tells coding agents how to build on the API.Fail
.well-known/mcp.jsonA discoverable MCP manifest at a well-known path.Fail
MCP registryThe API is listed in a public MCP registry.Pass
robots.txt AI directivesrobots.txt allows (or explicitly guides) AI crawlers.Fail
SitemapA sitemap so agents can enumerate the docs surface.Fail

Comprehension

55% of score · 82/100
Task-oriented descriptionsEndpoints described by what they accomplish, not just their shape.Pass
Realistic examplesRunnable, real-world request/response examples.Partial
Multi-step workflowsDocs that chain calls into complete jobs an agent can follow.Pass
Error-recovery guidanceDocumented failure modes and how to recover from them.Pass
Answer-first formatThe answer leads; preamble does not bury it.Pass
Capability boundariesClear limits — what the API can and cannot do.Pass
Naming consistencyConsistent, predictable naming across endpoints.Pass
Heading hierarchyClean heading structure agents can navigate.Pass
Markdown docsDocs available as clean markdown, not JS-rendered HTML only.Partial
Token efficiencyDocs are concise enough to fit an agent context window.Partial

What we found

  • PagerDuty has the widest gap between comprehension quality (84/B) and discovery (23/F) — excellent docs exist but agents cannot find them through standard discovery channels.
  • The rate limit documentation is exemplary for agents: includes specific numbers (960 req/min), response headers (ratelimit-limit/remaining/reset), 429 response body format, and explicit retry best practices.
  • PagerDuty has a dedicated 'MCP Tooling & Remote Server' documentation page, indicating awareness of agent consumption, yet lacks the standard discovery files (llms.txt, robots.txt, sitemap) that would help agents find it.
  • The developer portal is entirely JS-rendered (Gatsby) with no static alternatives — robots.txt, sitemap.xml, and llms.txt all return empty responses, making the site invisible to crawlers and agents.
  • OpenAPI schemas exist at PagerDuty/api-schema on GitHub but are not linked from a discoverable location on the docs site.

What to change

Prioritized by impact on discoverability. You (or your docs platform) deploy these — Discry never touches your API.

  1. 01Fix the Gatsby SSR issue: robots.txt, sitemap.xml must be server-rendered as static files — currently the entire developer portal is invisible to web crawlers and AI bots.
  2. 02Add llms.txt with a structured overview of REST API, Events API v2, Webhooks, and key workflows — the content quality is already high, it just needs a discovery layer.
  3. 03Add AGENTS.md to the PagerDuty/api-schema or pagerduty-api-python-client repos with authentication setup, common patterns, and integration guidance.
  4. 04Create a sitemap.xml that covers all documentation pages — this alone would significantly improve discoverability.
  5. 05Publish the OpenAPI spec at a well-known URL on the developer portal (e.g., developer.pagerduty.com/openapi.json) in addition to the GitHub repo.

Execution coverage · INFORMATIONAL, UNSCORED

Whether an agent can actually complete a call and recover from errors is the deeper Audit layer — documented here, but not part of the Discry Score.

API key (Account)API key (User)OAuth2 (App token)OAuth2 (User token)OpenID ID Token Error format documented Rate limits documented Pagination documented Idempotency documented

Comprehensive execution documentation with multiple auth types, well-documented rate limits (960 req/min with ratelimit-* headers), structured JSON errors with codes, and cursor-based pagination. Dedicated pages for rate limits, pagination, filtering, and sorting. MCP Tooling & Remote Server page shows awareness of agent use cases.

See your own Discry Score.

Drop your API docs URL. See what an agent sees — in 60 seconds, free.

Discry your API — free