Repository navigation
feat(dify): search-friendly listing copy, tags and README (0.1.3) - #10
Merged
Merged
Conversation
Rewrite what the Dify Marketplace shows so people searching for a web scraper, URL to Markdown, JavaScript scraping or data extraction find it. Claims are limited to what the plugin does; nothing about link-following crawls or anti-bot. - label: "Spicrawl Web Scraper" (+ zh_Hans, ja_JP), shown as the page title - description (the Marketplace brief and meta description): leads with "Web scraper for Dify", 160 chars (+ zh_Hans, ja_JP) - tags: search, utilities, rag, business (all allowed by the plugin schema) - tool labels and descriptions: Scrape Web Page, Extract Page Data, Batch Scrape URLs, with clearer human and llm descriptions (+ zh_Hans, ja_JP) - README: answer-first opening, what you can do, 3-step quick start, tools table, 5-question FAQ (JavaScript, RAG, cost, field extraction, crawling), links - API key help text mentions the free plan Bump the plugin to 0.1.3 and the User-Agent to match. The 0.1.2 icon stays.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
People find Dify plugins by searching the Marketplace and the web for what they want to do ("web scraper", "URL to Markdown", "scrape JavaScript sites", "extract data"). The listing led with the brand name and described the tools in our own terms. This reworks the copy the Marketplace renders so it matches those searches, without claiming anything the plugin does not do.
Where each field renders (checked against the live listing at marketplace.dify.ai/plugins/spicrawl/spicrawl)
label<h1>,<title>("... - Dify Marketplace"), card name, tool picker in Difydescription<meta name="description">,og:descriptiontagsREADME.mdlabel/humandescriptionllmdescriptionBefore / after
Label
SpicrawlSpicrawl Web Scraper(also zh_Hans, ja_JP)Description (160 characters, lead keywords first)
Tags (all from the daemon's
PluginTaglist; the provider tags use the SDK's narrowerToolLabelEnum, and all four are in both)search,utilitiessearch,utilities,rag,businessagentandtrigger(those are agent-strategy and trigger plugins),other, and the content categories (image, videos, weather, ...).productivityis left out because nothing in the docs backs it.Tools
Each has a keyword-led human description and a fuller
llmdescription (with zh_Hans and ja_JP for label and human description). Parameters are unchanged.README
An answer-first opening ("To scrape a website in Dify, install the Spicrawl plugin, add a free API key and use Scrape Web Page ..."), then What you can do, a 3-step quick start, a compact tools table, a 5-question FAQ (JavaScript sites, RAG, cost, field extraction, crawling), errors and security, and links. The setup, credentials, connection requirement, source and privacy content the review guidelines ask for is all still there.
Accuracy notes
Version
0.1.2 -> 0.1.3 (manifest and User-Agent). The 0.1.2 icon is unchanged. No functional change: tool parameters and code paths are the same.
Checks
pytestindify/: 16 passed.dify-marketplace-toolkitvalidate-difypkg.py: 0 blocking failures, 0 environment failures, the same 3 warning categories as 0.1.2 (all pre-existing).After merge: tag
dify-v0.1.3, then one marketplace update PR withspicrawl-0.1.3.difypkg.