Advanced web crawling and content extraction tool with multiple extraction modes
Web Crawl Skill
Advanced web content extraction with multiple modes and intelligent content detection.
When to Use
Use this skill when:
- User asks to "研究" / "深度研究" a topic
- User wants to "抓取" / "提取" content from websites
- Need to analyze multiple web pages systematically
- Current
web_fetchoutput is insufficient
Extraction Modes
| Mode | Use Case |
|---|---|
text | Clean plain text |
markdown | Formatted Markdown (recommended) |
links | Extract all links |
structured | JSON metadata + content |
full | Markdown + links combined |
Tools Available
web_crawl- Extract content from a single URLparallel_crawl- Extract from multiple URLs in parallelresearch_topic- Multi-step research with search + crawl
Example Usage
User: "研究一下 OpenManus-Max 项目"
→ Use research_topic tool with query="OpenManus-Max GitHub features"
Related skills
- Downloads
- 1.1kAll time
- Security audit
- Review
- Last updated
- 6mo ago
- Current version
- v1.0.0
- License
- MIT-0
