Crawler Summary

smart-fetch answer-first brief

Fetch URLs and extract only relevant content via intent. Triggers: URL OR URL + intent, smart-fetch, what does this page say about. --- name: smart-fetch description: > Fetch URLs and extract only relevant content via intent. Triggers: URL OR URL + intent, smart-fetch, what does this page say about. --- smart-fetch Fetch URLs and extract only the relevant information. Uses playbooks (free) with Firecrawl fallback, then distills via Gemini 2.5 Flash. When to Use - User provides URL + specific question about its content - "smart-fetch this page" - Capability contract not published. No trust telemetry is available yet. Last updated 4/14/2026.

Freshness

Last checked 4/14/2026

Best For

smart-fetch is best for call workflows where OpenClaw compatibility matters.

Not Ideal For

Contract metadata is missing or unavailable for deterministic execution.

Evidence Sources Checked

editorial-content, GITHUB OPENCLEW, runtime-metrics, public facts pack

Claim this agent
Agent DossierGitHubSafety: 94/100

smart-fetch

Fetch URLs and extract only relevant content via intent. Triggers: URL OR URL + intent, smart-fetch, what does this page say about. --- name: smart-fetch description: > Fetch URLs and extract only relevant content via intent. Triggers: URL OR URL + intent, smart-fetch, what does this page say about. --- smart-fetch Fetch URLs and extract only the relevant information. Uses playbooks (free) with Firecrawl fallback, then distills via Gemini 2.5 Flash. When to Use - User provides URL + specific question about its content - "smart-fetch this page" -

OpenClawself-declared

Public facts

4

Change events

1

Artifacts

0

Freshness

Apr 14, 2026

Verifiededitorial-contentNo verified compatibility signals

Capability contract not published. No trust telemetry is available yet. Last updated 4/14/2026.

Trust evidence available

Trust score

Unknown

Compatibility

OpenClaw

Freshness

Apr 14, 2026

Vendor

Ilyasfit

Artifacts

0

Benchmarks

0

Last release

Unpublished

Executive Summary

Key links, install path, and a quick operational read before the deeper crawl record.

Verifiededitorial-content

Summary

Capability contract not published. No trust telemetry is available yet. Last updated 4/14/2026.

Setup snapshot

git clone https://github.com/ilyasfit/smart-fetch.git
  1. 1

    Setup complexity is LOW. This package is likely designed for quick installation with minimal external side-effects.

  2. 2

    Final validation: Expose the agent to a mock request payload inside a sandbox and trace the network egress before allowing access to real customer data.

Evidence Ledger

Everything public we have scraped or crawled about this agent, grouped by evidence type with provenance.

Verifiededitorial-content
Vendor (1)

Vendor

Ilyasfit

profilemedium
Observed Apr 14, 2026Source linkProvenance
Compatibility (1)

Protocol compatibility

OpenClaw

contractmedium
Observed Apr 14, 2026Source linkProvenance
Security (1)

Handshake status

UNKNOWN

trustmedium
Observed unknownSource linkProvenance
Integration (1)

Crawlable docs

6 indexed pages on the official domain

search_documentmedium
Observed Apr 15, 2026Source linkProvenance

Release & Crawl Timeline

Merged public release, docs, artifact, benchmark, pricing, and trust refresh events.

Self-declaredagent-index

Artifacts Archive

Extracted files, examples, snippets, parameters, dependencies, permissions, and artifact metadata.

Self-declaredGITHUB OPENCLEW

Extracted files

0

Examples

6

Snippets

0

Languages

typescript

Parameters

Executable Examples

bash

bun install -g github:celebi/agent-web-suite/smart-fetch

bash

git clone https://github.com/celebi/agent-web-suite.git
cd agent-web-suite/smart-fetch
bun install

bash

# Required - for content distillation
export GEMINI_API_KEY="your-gemini-api-key"

# Optional - fallback for JS-heavy pages
export FIRECRAWL_API_KEY="your-firecrawl-api-key"

bash

smart-fetch "<url>" "<intent>"

bash

smart-fetch --metrics "<url>" "<intent>"

bash

# Extract auth setup from API docs
smart-fetch "https://docs.stripe.com/api/authentication" \
  "how to authenticate API requests with examples"

# Get specific function documentation
smart-fetch "https://lodash.com/docs/4.17.15" \
  "debounce function parameters and usage example"

# Extract installation steps
smart-fetch "https://bun.sh/docs/installation" \
  "installation commands for macOS"

Docs & README

Full documentation captured from public sources, including the complete README when available.

Self-declaredGITHUB OPENCLEW

Docs source

GITHUB OPENCLEW

Editorial quality

ready

Fetch URLs and extract only relevant content via intent. Triggers: URL OR URL + intent, smart-fetch, what does this page say about. --- name: smart-fetch description: > Fetch URLs and extract only relevant content via intent. Triggers: URL OR URL + intent, smart-fetch, what does this page say about. --- smart-fetch Fetch URLs and extract only the relevant information. Uses playbooks (free) with Firecrawl fallback, then distills via Gemini 2.5 Flash. When to Use - User provides URL + specific question about its content - "smart-fetch this page" -

Full README

name: smart-fetch description: > Fetch URLs and extract only relevant content via intent. Triggers: URL OR URL + intent, smart-fetch, what does this page say about.

smart-fetch

Fetch URLs and extract only the relevant information. Uses playbooks (free) with Firecrawl fallback, then distills via Gemini 2.5 Flash.

When to Use

  • User provides URL + specific question about its content
  • "smart-fetch this page"
  • "get the relevant parts from..."
  • "what does this documentation say about..."
  • Any URL where you only need specific information, not the full page

When NOT to Use

  • User wants full page content (use WebFetch or firecrawl_scrape)
  • Need structured data extraction (use firecrawl_extract)

Installation

Prerequisites

Install globally

bun install -g github:celebi/agent-web-suite/smart-fetch

Or clone and install

git clone https://github.com/celebi/agent-web-suite.git
cd agent-web-suite/smart-fetch
bun install

Environment Variables

Set these in your shell profile (~/.zshrc or ~/.bashrc):

# Required - for content distillation
export GEMINI_API_KEY="your-gemini-api-key"

# Optional - fallback for JS-heavy pages
export FIRECRAWL_API_KEY="your-firecrawl-api-key"

After adding, restart your terminal or run source ~/.zshrc.

Cursor users: If you launched Cursor from Dock/Spotlight, restart Cursor to pick up new env vars.

Usage

smart-fetch "<url>" "<intent>"

Parameters:

  • [ ] url: The webpage to fetch
  • [ ] intent: What information you need (be specific for best results)

Output: Crystallized markdown to stdout. Status messages go to stderr.

Benchmarking:

smart-fetch --metrics "<url>" "<intent>"

Returns JSON with timing and size metrics.

Examples

# Extract auth setup from API docs
smart-fetch "https://docs.stripe.com/api/authentication" \
  "how to authenticate API requests with examples"

# Get specific function documentation
smart-fetch "https://lodash.com/docs/4.17.15" \
  "debounce function parameters and usage example"

# Extract installation steps
smart-fetch "https://bun.sh/docs/installation" \
  "installation commands for macOS"

Intent Tips

Be specific with intent for best results:

  • Bad: "API docs"
  • Good: "authentication methods and code examples for API key setup"
  • Bad: "how to use"
  • Good: "installation steps and configuration options for macOS"

Follow-Up Fetching

When the distilled response contains links to related pages (e.g., "[see X for details]"), you can call smart-fetch again on those URLs if deeper context is needed.

Pattern:

  1. First call: Get overview for user's question
  2. Review response — are there linked URLs pointing to required details?
  3. If yes → call smart-fetch on the specific link(s)
  4. If no → respond to user

This is expected behavior. Do not hesitate to chain calls when the user's question requires information from linked pages.

Cost

  • Playbooks fetch: FREE
  • Firecrawl fallback: ~$0.01-0.02 (only when needed)
  • Gemini 2.5 Flash: ~$0.003 per 10KB page

Typical: ~$3/month at 500 fetches.

Troubleshooting

| Error | Cause | Fix | | ------------------------------------------------- | ------------------------------------- | ------------------------------------------ | | GEMINI_API_KEY not set | Env var missing | Add to ~/.zshrc, restart terminal/Cursor | | FIRECRAWL_API_KEY not set - cannot use fallback | JS-heavy page, no fallback configured | Add Firecrawl key or use different URL | | Sparse content warning | Page requires JS rendering | Firecrawl fallback will handle it |

Contract & API

Machine endpoints, protocol fit, contract coverage, invocation examples, and guardrails for agent-to-agent use.

MissingGITHUB OPENCLEW

Contract coverage

Status

missing

Auth

None

Streaming

No

Data region

Unspecified

Protocol support

OpenClaw: self-declared

Requires: none

Forbidden: none

Guardrails

Operational confidence: low

No positive guardrails captured.
Invocation examples
curl -s "https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/snapshot"
curl -s "https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/contract"
curl -s "https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/trust"

Reliability & Benchmarks

Trust and runtime signals, benchmark suites, failure patterns, and practical risk constraints.

Missingruntime-metrics

Trust signals

Handshake

UNKNOWN

Confidence

unknown

Attempts 30d

unknown

Fallback rate

unknown

Runtime metrics

Observed P50

unknown

Observed P95

unknown

Rate limit

unknown

Estimated cost

unknown

Do not use if

Contract metadata is missing or unavailable for deterministic execution.
No benchmark suites or observed failure patterns are available.

Media & Demo

Every public screenshot, visual asset, demo link, and owner-provided destination tied to this agent.

Missingno-media
No screenshots, media assets, or demo links are available.

Related Agents

Neighboring agents from the same protocol and source ecosystem for comparison and shortlist building.

Self-declaredprotocol-neighbors
GITHUB_REPOSactivepieces

Rank

70

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

Traction

No public download signal

Freshness

Updated 2d ago

OPENCLAW
GITHUB_REPOScherry-studio

Rank

70

AI productivity studio with smart chat, autonomous agents, and 300+ assistants. Unified access to frontier LLMs

Traction

No public download signal

Freshness

Updated 5d ago

MCPOPENCLAW
GITHUB_REPOSAionUi

Rank

70

Free, local, open-source 24/7 Cowork app and OpenClaw for Gemini CLI, Claude Code, Codex, OpenCode, Qwen Code, Goose CLI, Auggie, and more | 🌟 Star if you like it!

Traction

No public download signal

Freshness

Updated 6d ago

MCPOPENCLAW
GITHUB_REPOSCopilotKit

Rank

70

The Frontend for Agents & Generative UI. React + Angular

Traction

No public download signal

Freshness

Updated 23d ago

OPENCLAW
Machine Appendix

Contract JSON

{
  "contractStatus": "missing",
  "authModes": [],
  "requires": [],
  "forbidden": [],
  "supportsMcp": false,
  "supportsA2a": false,
  "supportsStreaming": false,
  "inputSchemaRef": null,
  "outputSchemaRef": null,
  "dataRegion": null,
  "contractUpdatedAt": null,
  "sourceUpdatedAt": null,
  "freshnessSeconds": null
}

Invocation Guide

{
  "preferredApi": {
    "snapshotUrl": "https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/snapshot",
    "contractUrl": "https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/contract",
    "trustUrl": "https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/trust"
  },
  "curlExamples": [
    "curl -s \"https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/snapshot\"",
    "curl -s \"https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/contract\"",
    "curl -s \"https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/trust\""
  ],
  "jsonRequestTemplate": {
    "query": "summarize this repo",
    "constraints": {
      "maxLatencyMs": 2000,
      "protocolPreference": [
        "OPENCLEW"
      ]
    }
  },
  "jsonResponseTemplate": {
    "ok": true,
    "result": {
      "summary": "...",
      "confidence": 0.9
    },
    "meta": {
      "source": "GITHUB_OPENCLEW",
      "generatedAt": "2026-04-16T23:42:28.116Z"
    }
  },
  "retryPolicy": {
    "maxAttempts": 3,
    "backoffMs": [
      500,
      1500,
      3500
    ],
    "retryableConditions": [
      "HTTP_429",
      "HTTP_503",
      "NETWORK_TIMEOUT"
    ]
  }
}

Trust JSON

{
  "status": "unavailable",
  "handshakeStatus": "UNKNOWN",
  "verificationFreshnessHours": null,
  "reputationScore": null,
  "p95LatencyMs": null,
  "successRate30d": null,
  "fallbackRate": null,
  "attempts30d": null,
  "trustUpdatedAt": null,
  "trustConfidence": "unknown",
  "sourceUpdatedAt": null,
  "freshnessSeconds": null
}

Capability Matrix

{
  "rows": [
    {
      "key": "OPENCLEW",
      "type": "protocol",
      "support": "unknown",
      "confidenceSource": "profile",
      "notes": "Listed on profile"
    },
    {
      "key": "call",
      "type": "capability",
      "support": "supported",
      "confidenceSource": "profile",
      "notes": "Declared in agent profile metadata"
    }
  ],
  "flattenedTokens": "protocol:OPENCLEW|unknown|profile capability:call|supported|profile"
}

Facts JSON

[
  {
    "factKey": "docs_crawl",
    "category": "integration",
    "label": "Crawlable docs",
    "value": "6 indexed pages on the official domain",
    "href": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceUrl": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceType": "search_document",
    "confidence": "medium",
    "observedAt": "2026-04-15T05:03:46.393Z",
    "isPublic": true
  },
  {
    "factKey": "vendor",
    "category": "vendor",
    "label": "Vendor",
    "value": "Ilyasfit",
    "href": "https://github.com/ilyasfit/smart-fetch",
    "sourceUrl": "https://github.com/ilyasfit/smart-fetch",
    "sourceType": "profile",
    "confidence": "medium",
    "observedAt": "2026-04-14T22:27:04.487Z",
    "isPublic": true
  },
  {
    "factKey": "protocols",
    "category": "compatibility",
    "label": "Protocol compatibility",
    "value": "OpenClaw",
    "href": "https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/contract",
    "sourceUrl": "https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/contract",
    "sourceType": "contract",
    "confidence": "medium",
    "observedAt": "2026-04-14T22:27:04.487Z",
    "isPublic": true
  },
  {
    "factKey": "handshake_status",
    "category": "security",
    "label": "Handshake status",
    "value": "UNKNOWN",
    "href": "https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/trust",
    "sourceUrl": "https://xpersona.co/api/v1/agents/ilyasfit-smart-fetch/trust",
    "sourceType": "trust",
    "confidence": "medium",
    "observedAt": null,
    "isPublic": true
  }
]

Change Events JSON

[
  {
    "eventType": "docs_update",
    "title": "Docs refreshed: Sign in to GitHub · GitHub",
    "description": "Fresh crawlable documentation was indexed for the official domain.",
    "href": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceUrl": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceType": "search_document",
    "confidence": "medium",
    "observedAt": "2026-04-15T05:03:46.393Z",
    "isPublic": true
  }
]

Sponsored

Ads related to smart-fetch and adjacent AI workflows.