Xpersona

Crawler Summary

🥷 ShadowCrawl: The Zero-Docker "Unstoppable" Stealth Scraper & Search answer-first brief

**Pure Rust MCP Server** ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily. Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome) without complex infrastructure. Why AI Agents love ShadowCrawl: - Zero-Docker & Zero-Config: No Redis, No Qdrant, No SearXNG. Single binary setup. - God-Tier Anti-Bot Bypass: Native Chromiumoxide (CDP) with JS-level stealth injection and HITL (Human-In-The-Loop) fallback for solving CAPTCHAs. - Internal Meta-Search: Parallel search across Google, Bing, DuckDuckGo, and Brave without external API keys. - Smart Ad-Blocking: Built-in high-speed aho-corasick engine to strip ads and trackers before extraction. - Semantic Memory: Embedded LanceDB for 100% local, private research history recall. - AI-Optimized Markdown: Delivers ultra-clean content stripped of "Buddhist Era" dates and web noise. Tools list: search_web — federated search (No API Key needed) search_structured — search + top result scraping scrape_url — single URL extraction scrape_batch — multi-URL parallel scraping crawl_website — bounded recursive crawling extract_structured — schema-driven extraction research_history — semantic recall from prior runs proxy_manager — proxy list/status/switch/test/grab operations non_robot_search — [NEW] The "Nuclear Option" for Boss-level anti-bots (LinkedIn/Cloudflare) with HITL. **Pure Rust MCP Server** ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily. Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome Capability contract not published. No trust telemetry is available yet. Last updated 4/15/2026.

Freshness

Last checked 4/15/2026

Best For

🥷 ShadowCrawl: The Zero-Docker "Unstoppable" Stealth Scraper & Search is best for general automation workflows where MCP compatibility matters.

Not Ideal For

Contract metadata is missing or unavailable for deterministic execution.

Evidence Sources Checked

editorial-content, Smithery, runtime-metrics, public facts pack

CardFactsSnapshotContractTrust
Claim this agent
Agent DossierSmitherySafety: 86/100

🥷 ShadowCrawl: The Zero-Docker "Unstoppable" Stealth Scraper & Search

**Pure Rust MCP Server** ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily. Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome) without complex infrastructure. Why AI Agents love ShadowCrawl: - Zero-Docker & Zero-Config: No Redis, No Qdrant, No SearXNG. Single binary setup. - God-Tier Anti-Bot Bypass: Native Chromiumoxide (CDP) with JS-level stealth injection and HITL (Human-In-The-Loop) fallback for solving CAPTCHAs. - Internal Meta-Search: Parallel search across Google, Bing, DuckDuckGo, and Brave without external API keys. - Smart Ad-Blocking: Built-in high-speed aho-corasick engine to strip ads and trackers before extraction. - Semantic Memory: Embedded LanceDB for 100% local, private research history recall. - AI-Optimized Markdown: Delivers ultra-clean content stripped of "Buddhist Era" dates and web noise. Tools list: search_web — federated search (No API Key needed) search_structured — search + top result scraping scrape_url — single URL extraction scrape_batch — multi-URL parallel scraping crawl_website — bounded recursive crawling extract_structured — schema-driven extraction research_history — semantic recall from prior runs proxy_manager — proxy list/status/switch/test/grab operations non_robot_search — [NEW] The "Nuclear Option" for Boss-level anti-bots (LinkedIn/Cloudflare) with HITL. **Pure Rust MCP Server** ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily. Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome

MCPself-declared

Public facts

4

Change events

1

Artifacts

0

Freshness

Apr 15, 2026

Verifiededitorial-contentNo verified compatibility signals

Capability contract not published. No trust telemetry is available yet. Last updated 4/15/2026.

Trust evidence available

Trust score

Unknown

Compatibility

MCP

Freshness

Apr 15, 2026

Vendor

Devshero

Artifacts

0

Benchmarks

0

Last release

Unpublished

Executive Summary

Key links, install path, and a quick operational read before the deeper crawl record.

Verifiededitorial-content

Summary

Capability contract not published. No trust telemetry is available yet. Last updated 4/15/2026.

View Source

Setup snapshot

  1. 1

    Setup complexity is LOW. This package is likely designed for quick installation with minimal external side-effects.

  2. 2

    Final validation: Expose the agent to a mock request payload inside a sandbox and trace the network egress before allowing access to real customer data.

Evidence Ledger

Everything public we have scraped or crawled about this agent, grouped by evidence type with provenance.

Verifiededitorial-content
Vendor (1)

Vendor

Devshero

profilemedium
Observed Apr 15, 2026Source linkProvenance
Compatibility (1)

Protocol compatibility

MCP

contractmedium
Observed Apr 15, 2026Source linkProvenance
Security (1)

Handshake status

UNKNOWN

trustmedium
Observed unknownSource linkProvenance
Integration (1)

Crawlable docs

6 indexed pages on the official domain

search_documentmedium
Observed Apr 15, 2026Source linkProvenance

Release & Crawl Timeline

Merged public release, docs, artifact, benchmark, pricing, and trust refresh events.

Self-declaredagent-index

Docs Update

Docs refreshed: Sign in to GitHub · GitHub

search_documentmedium

Fresh crawlable documentation was indexed for the official domain.

Observed Apr 15, 2026

Artifacts Archive

Extracted files, examples, snippets, parameters, dependencies, permissions, and artifact metadata.

Self-declaredSmithery

Extracted files

0

Examples

0

Snippets

0

Languages

Unknown

Docs & README

Full documentation captured from public sources, including the complete README when available.

Self-declaredSmithery

Docs source

Smithery

Editorial quality

ready

**Pure Rust MCP Server** ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily. Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome) without complex infrastructure. Why AI Agents love ShadowCrawl: - Zero-Docker & Zero-Config: No Redis, No Qdrant, No SearXNG. Single binary setup. - God-Tier Anti-Bot Bypass: Native Chromiumoxide (CDP) with JS-level stealth injection and HITL (Human-In-The-Loop) fallback for solving CAPTCHAs. - Internal Meta-Search: Parallel search across Google, Bing, DuckDuckGo, and Brave without external API keys. - Smart Ad-Blocking: Built-in high-speed aho-corasick engine to strip ads and trackers before extraction. - Semantic Memory: Embedded LanceDB for 100% local, private research history recall. - AI-Optimized Markdown: Delivers ultra-clean content stripped of "Buddhist Era" dates and web noise. Tools list: search_web — federated search (No API Key needed) search_structured — search + top result scraping scrape_url — single URL extraction scrape_batch — multi-URL parallel scraping crawl_website — bounded recursive crawling extract_structured — schema-driven extraction research_history — semantic recall from prior runs proxy_manager — proxy list/status/switch/test/grab operations non_robot_search — [NEW] The "Nuclear Option" for Boss-level anti-bots (LinkedIn/Cloudflare) with HITL. **Pure Rust MCP Server** ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily. Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome

Full README

Pure Rust MCP Server

ShadowCrawl is a high-performance, Zero-Docker MCP server written in Rust. It serves as a 100% private, sovereign alternative to Firecrawl, Jina Reader, and Tavily.

Unlike other scrapers, ShadowCrawl v2.3.0 runs as a single standalone binary with native Chromium control (CDP) and a Human-In-The-Loop (HITL) fallback system, ensuring you can bypass 99.9% of bot protections (Cloudflare, DataDome) without complex infrastructure.

Why AI Agents love ShadowCrawl:

  • Zero-Docker & Zero-Config: No Redis, No Qdrant, No SearXNG. Single binary setup.
  • God-Tier Anti-Bot Bypass: Native Chromiumoxide (CDP) with JS-level stealth injection and HITL (Human-In-The-Loop) fallback for solving CAPTCHAs.
  • Internal Meta-Search: Parallel search across Google, Bing, DuckDuckGo, and Brave without external API keys.
  • Smart Ad-Blocking: Built-in high-speed aho-corasick engine to strip ads and trackers before extraction.
  • Semantic Memory: Embedded LanceDB for 100% local, private research history recall.
  • AI-Optimized Markdown: Delivers ultra-clean content stripped of "Buddhist Era" dates and web noise.

Tools list:

search_web — federated search (No API Key needed) search_structured — search + top result scraping scrape_url — single URL extraction scrape_batch — multi-URL parallel scraping crawl_website — bounded recursive crawling extract_structured — schema-driven extraction research_history — semantic recall from prior runs proxy_manager — proxy list/status/switch/test/grab operations non_robot_search — [NEW] The "Nuclear Option" for Boss-level anti-bots (LinkedIn/Cloudflare) with HITL.

Contract & API

Machine endpoints, protocol fit, contract coverage, invocation examples, and guardrails for agent-to-agent use.

MissingSmithery

Endpoints

Dossier APISnapshot APIContract APITrust API

Contract coverage

Status

missing

Auth

None

Streaming

No

Data region

Unspecified

Protocol support

MCP: self-declared

Requires: none

Forbidden: none

Guardrails

Operational confidence: low

No positive guardrails captured.
Invocation examples
curl -s "https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/snapshot"
curl -s "https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/contract"
curl -s "https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/trust"

Reliability & Benchmarks

Trust and runtime signals, benchmark suites, failure patterns, and practical risk constraints.

Missingruntime-metrics

Trust signals

Handshake

UNKNOWN

Confidence

unknown

Attempts 30d

unknown

Fallback rate

unknown

Runtime metrics

Observed P50

unknown

Observed P95

unknown

Rate limit

unknown

Estimated cost

unknown

Do not use if

Contract metadata is missing or unavailable for deterministic execution.
No benchmark suites or observed failure patterns are available.

Media & Demo

Every public screenshot, visual asset, demo link, and owner-provided destination tied to this agent.

Missingno-media
No screenshots, media assets, or demo links are available.

Related Agents

Neighboring agents from the same protocol and source ecosystem for comparison and shortlist building.

Self-declaredprotocol-neighbors
GITLAB_AI_CATALOGgitlab-mcp

Rank

83

A Model Context Protocol (MCP) server for GitLab

Traction

No public download signal

Freshness

Updated 2d ago

MCP
GITLAB_PUBLIC_PROJECTSgitlab-mcp

Rank

80

A Model Context Protocol (MCP) server for GitLab

Traction

No public download signal

Freshness

Updated 2d ago

MCP
GITLAB_AI_CATALOGrmcp-openapi

Rank

74

Expose OpenAPI definition endpoints as MCP tools using the official Rust SDK for the Model Context Protocol (https://github.com/modelcontextprotocol/rust-sdk)

Traction

No public download signal

Freshness

Updated 2d ago

MCP
GITLAB_AI_CATALOGrmcp-actix-web

Rank

72

An actix_web backend for the official Rust SDK for the Model Context Protocol (https://github.com/modelcontextprotocol/rust-sdk)

Traction

No public download signal

Freshness

Updated 2d ago

MCP
Agent hubMore from this sourceMCP agents
Machine Appendix

Contract JSON

{
  "contractStatus": "missing",
  "authModes": [],
  "requires": [],
  "forbidden": [],
  "supportsMcp": false,
  "supportsA2a": false,
  "supportsStreaming": false,
  "inputSchemaRef": null,
  "outputSchemaRef": null,
  "dataRegion": null,
  "contractUpdatedAt": null,
  "sourceUpdatedAt": null,
  "freshnessSeconds": null
}

Invocation Guide

{
  "preferredApi": {
    "snapshotUrl": "https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/snapshot",
    "contractUrl": "https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/contract",
    "trustUrl": "https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/trust"
  },
  "curlExamples": [
    "curl -s \"https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/snapshot\"",
    "curl -s \"https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/contract\"",
    "curl -s \"https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/trust\""
  ],
  "jsonRequestTemplate": {
    "query": "summarize this repo",
    "constraints": {
      "maxLatencyMs": 2000,
      "protocolPreference": [
        "MCP"
      ]
    }
  },
  "jsonResponseTemplate": {
    "ok": true,
    "result": {
      "summary": "...",
      "confidence": 0.9
    },
    "meta": {
      "source": "SMITHERY",
      "generatedAt": "2026-04-17T04:17:29.683Z"
    }
  },
  "retryPolicy": {
    "maxAttempts": 3,
    "backoffMs": [
      500,
      1500,
      3500
    ],
    "retryableConditions": [
      "HTTP_429",
      "HTTP_503",
      "NETWORK_TIMEOUT"
    ]
  }
}

Trust JSON

{
  "status": "unavailable",
  "handshakeStatus": "UNKNOWN",
  "verificationFreshnessHours": null,
  "reputationScore": null,
  "p95LatencyMs": null,
  "successRate30d": null,
  "fallbackRate": null,
  "attempts30d": null,
  "trustUpdatedAt": null,
  "trustConfidence": "unknown",
  "sourceUpdatedAt": null,
  "freshnessSeconds": null
}

Capability Matrix

{
  "rows": [
    {
      "key": "MCP",
      "type": "protocol",
      "support": "unknown",
      "confidenceSource": "profile",
      "notes": "Listed on profile"
    }
  ],
  "flattenedTokens": "protocol:MCP|unknown|profile"
}

Facts JSON

[
  {
    "factKey": "docs_crawl",
    "category": "integration",
    "label": "Crawlable docs",
    "value": "6 indexed pages on the official domain",
    "href": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceUrl": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceType": "search_document",
    "confidence": "medium",
    "observedAt": "2026-04-15T05:03:46.393Z",
    "isPublic": true
  },
  {
    "factKey": "vendor",
    "category": "vendor",
    "label": "Vendor",
    "value": "Devshero",
    "href": "https://github.com/DevsHero/ShadowCrawl",
    "sourceUrl": "https://github.com/DevsHero/ShadowCrawl",
    "sourceType": "profile",
    "confidence": "medium",
    "observedAt": "2026-04-15T00:48:45.152Z",
    "isPublic": true
  },
  {
    "factKey": "protocols",
    "category": "compatibility",
    "label": "Protocol compatibility",
    "value": "MCP",
    "href": "https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/contract",
    "sourceUrl": "https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/contract",
    "sourceType": "contract",
    "confidence": "medium",
    "observedAt": "2026-04-15T00:48:45.152Z",
    "isPublic": true
  },
  {
    "factKey": "handshake_status",
    "category": "security",
    "label": "Handshake status",
    "value": "UNKNOWN",
    "href": "https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/trust",
    "sourceUrl": "https://xpersona.co/api/v1/agents/smithery-devshero-shadowcrawl/trust",
    "sourceType": "trust",
    "confidence": "medium",
    "observedAt": null,
    "isPublic": true
  }
]

Change Events JSON

[
  {
    "eventType": "docs_update",
    "title": "Docs refreshed: Sign in to GitHub · GitHub",
    "description": "Fresh crawlable documentation was indexed for the official domain.",
    "href": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceUrl": "https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fopenclaw%2Fskills%2Ftree%2Fmain%2Fskills%2Fasleep123%2Fcaldav-calendar",
    "sourceType": "search_document",
    "confidence": "medium",
    "observedAt": "2026-04-15T05:03:46.393Z",
    "isPublic": true
  }
]

Sponsored

Ads related to 🥷 ShadowCrawl: The Zero-Docker "Unstoppable" Stealth Scraper & Search and adjacent AI workflows.