anansi

A self-healing scraper for hostile sites: broken selectors repair themselves, browser rendering kicks in when needed, and a coherent identity layer (Chrome TLS fingerprints, matched personas, vendor-aware Cloudflare/Akamai/DataDome handling) works to slip past bot detection. Ships with an MCP server so any LLM can drive a full crawl by conversation.

Type: Tool
Imported from GitHub
Popularity: 116 GitHub stars
License: Apache-2.0
Source: https://github.com/mdowis/anansi
Tags: adaptive-scraping, ai-agent, anti-bot, concurrent-processing, crawler, data-extraction, llm-tools, mcp, mcp-server, pydantic, python, self-healing
Updated: 2026-10-01

More tools

cc-switch — A cross-platform desktop All-in-One assistant for Claude Code, Codex, OpenCode, OpenClaw, Grok Build & Hermes Agent. Only official website:…
private-gpt — Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compa…
medusa — The world's most flexible commerce platform for agents and developers
prompt-optimizer — An AI prompt optimizer for writing better prompts and getting better AI results.
opencodex — Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, a…
ai-goofish-monitor — 基于 Playwright 和AI实现的闲鱼多任务实时/定时监控与智能分析系统，配备了功能完善的后台管理UI。帮助用户从闲鱼海量商品中，找到心仪产品。
ccstatusline — 🚀 Beautiful highly customizable statusline for Claude Code CLI with powerline support, themes, and more.
ChatGPT-Shortcut — Stop writing prompts from scratch — a searchable prompt library for ChatGPT, Claude, Gemini and Cursor · Русский 한국어 العربية हिन्दी ไทย ｜别…