Skip to content
Mekler AIGet started

Mekler AI / Link and Sitemap Inventory

Service details

Link and Sitemap Inventory

Collect structured page links or a bounded sitemap URL inventory. Your assistant calls the service and brings the result back into your task.

Extract a bounded URL inventory from static HTML anchors or same-origin XML sitemaps

0.005 USDC per accepted request

Paid only. No free trial for this operation.

Use this service →

This operation needs paid setup. New to Mekler? Start with a free sample task →

Know its boundaries.

  • Whole-site crawling, JavaScript rendering, gzip sitemaps, cross-origin sitemap traversal or proof that listed URLs are live or indexed.

Data handling

Supplied inputs, source results and proofs are excluded from telemetry. Completed results remain encrypted for 30 day original-proof recovery. Public URLs use robots/DNS controls; currency and vehicle inputs go only to the documented fixed public source.

Input example and exact contract
{
  "url": "https://mekler.ai/",
  "mode": "links",
  "max_urls": 100,
  "max_sitemaps": 3,
  "request_id": "link-inventory-example-001"
}

API reference: input, output and error schemas →

Example output
{
  "status": "ok",
  "url": "https://mekler.ai/",
  "mode": "links",
  "observed_at": "2026-10-20T00:00:00Z",
  "links": [
    {
      "url": "https://mekler.ai/start/",
      "anchor": "Get started",
      "rel": [
        "help"
      ],
      "internal": true,
      "occurrences": 1,
      "source": "https://mekler.ai/"
    }
  ],
  "canonical_candidates": [
    "https://mekler.ai/"
  ],
  "sources_visited": [
    "https://mekler.ai/"
  ],
  "pending_sitemaps": 0,
  "truncated": false,
  "skipped": [],
  "bounds": {
    "max_urls": 100,
    "max_sitemaps": 3
  },
  "limitations": [
    "Static anchors or uncompressed XML sitemaps only; no JavaScript execution, linked-page crawling, reachability checks or search-index coverage.",
    "Fragments are removed; query strings are retained. Page links are deduplicated by normalized URL with occurrence counts. Link evidence is capped at 24 KiB; truncated marks either byte or count limits.",
    "Sitemap traversal stays on the starting origin, follows at most 5 sitemap documents of 1 MiB each, and returns at most 200 URLs. Bounds/skips describe coverage, not completeness of the site."
  ]
}
Calling, result interpretation and recovery

Calling

Endpoint

POST /v1/web/links/extract-inventory

Content type

application/json

Input

All fields, formats, defaults and limits are specified in requestBody. request_id must be 16–64 ASCII letters, digits, underscores or hyphens; use a fresh value per new purchase.

Interpret the result

Status

ok means the documented bounded operation completed; inspect explicit coverage and limitations.

Result

Response schema describes each output. Null means missing/unknown, never measured zero.

Recovery

Use the original body and payment proof after timeout, pending settlement or quote expiry.

Limits

Request bytes

24000

Semantics

  • No work occurs on unsigned quotes. Normalize and bind the complete input before payment.

  • Successful results are encrypted for 30 day original-proof recovery.

  • Incomplete operation or source/storage failure is uncharged. A completed diagnostic or zero-match lookup is charged.

Payment and recovery

Price

0.005 native USDC per completed operation

Network

Solana mainnet or Base mainnet

Protocol

x402 v2 exact

Quote

POST the intended JSON unsigned for one input-bound 402; no work/source retrieval occurs. Sign one offer and resend identical JSON. Work and encrypted storage complete before settlement.

Authorization

Choose one accepts entry with a standard x402 v2 client. Check native USDC, network, recipient, amount and intended input before signing. Solana uses an SVM transaction; Base uses an EOA EIP-3009 authorization (USD Coin version 2). Send the proof with identical JSON input. No API key, token approval, bridge or Solana wallet is needed for Base. Never automatically fall back to another network.

Retry

Preserve identical JSON and original proof for 30 day result recovery; do not buy again after a timeout or pending result. Fresh request_id creates a new paid operation.

Finality

A 202 is pending. Finalized delivery carries PAYMENT-RESPONSE; provisional delivery is separately labeled and does not establish finality. Preserve the original proof instead of buying again.

Expiry

Ongoing service under recurring monthly authority. Budget warnings do not stop service. Short-lived quotes and recovery retention still expire.

Networks

  • solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp

  • eip155:8453

Assets
Solana:5eykt4usfv8p8njdtrepy1vzqkqzkvdp

EPjFWdd5AufqSSqeM2qN1xzybapC8G4wEGGkZwyTDt1v

Eip155:8453

0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913

Fees

CDP sponsors the payment transaction gas on both networks. The service price is the same on either network; wallet funding or exchange fees are separate.

Request binding

The server authenticates the complete quote and input and atomically binds the first accepted authorization to them. Standard Base EIP-3009 signs the money terms and nonce, not HTTP content. Keep signatures private; do not reuse an authorization for another quote, operation or body.