Skip to content

docs: discoverability - #9

Merged
DibbayajyotiRoy merged 1 commit into
mainfrom
docs/discoverability
Oct 15, 2026
Merged

DibbayajyotiRoy merged 1 commit into
mainfrom
docs/discoverability

Conversation

@DibbayajyotiRoy

Copy link
Copy Markdown
Collaborator

Makes the repository easier to find and to quote from, in GitHub search, Google and AI assistants.

README.md and plugins/spicrawl/README.md

  • Open with a direct answer to "How do I give Claude Code, Cursor, Codex or Gemini CLI web scraping?".
  • Supported-tools table with one-line install commands, all taken from the existing install sections.
  • FAQ (setup per tool, what MCP is, JavaScript pages, crawling, logins, cost, where the key goes).
  • Links to the live listings: Dify Marketplace, Smithery, Cursor Directory, npm (plus the MCP Registry and Glama).
  • The root Dify section installs from the Dify Marketplace first and keeps the .difypkg release as the fallback. dify/ is not touched.

Manifests (description and keywords only)

  • .claude-plugin, .cursor-plugin and .factory-plugin marketplace files, the three plugin manifests, the Copilot CLI manifest keywords, and gemini-extension.json.
  • opencode/package.json: keywords only. The version is unchanged, so release-opencode runs its checks and does not publish; the new keywords reach npm with the next version bump.
  • Not changed: dify/, the Devin manifest, and plugins/spicrawl-openai (its text follows OpenAI's listing guidelines).

Checks run locally

  • claude plugin validate --strict plugins/spicrawl and claude plugin validate --strict . pass.
  • All JSON files parse; node --test in opencode/ passes (6/6); no key-like strings; no internal engine names in any file.

Claims were checked against docs.spicrawl.com. Spicrawl fetches only the URLs it is given and has no crawl endpoint, so the FAQ says so and "crawler" is not used as a keyword.

Lead the root and plugin READMEs with a direct answer to how an agent
gets web scraping, add a supported-tools table with install commands,
an FAQ and links to the live listings (Dify Marketplace, Smithery,
Cursor Directory, npm). The Dify section now installs from the
Marketplace first.

Plain-language descriptions and fuller keywords in the Claude Code,
Cursor, Factory and Gemini CLI manifests, and opencode package
keywords (no version bump, so nothing is published).
@DibbayajyotiRoy DibbayajyotiRoy self-assigned this Oct 15, 2026
@DibbayajyotiRoy
DibbayajyotiRoy merged commit 438dc5a into main Oct 15, 2026
5 checks passed
@DibbayajyotiRoy DibbayajyotiRoy added the documentation Improvements or additions to documentation label Oct 15, 2026
@DibbayajyotiRoy
DibbayajyotiRoy deleted the docs/discoverability branch October 16, 2026 10:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant