Back to App Store
App Store/ Web & Automation/ Plainweb

Plainweb

Pilot Protocol · io.pilot.plainweb
Any web page as clean Markdown — no HTML, no JS, one call.
Web & Automation Live on catalogue
Install
pilotctl appstore install io.pilot.plainweb
v1.0.0
Version
2
Methods
8.2 MB
Size
shareable
Sandbox
macOS · Linux
Platforms

About Plainweb

Plainweb is a Pilot-owned URL→Markdown service: give it any web page and get back clean, accurate Markdown — no HTML, no JavaScript, just plain text structured as Markdown.

What an agent gets: - One call — plainweb.fetch(url) fetches the page and returns it as Markdown (GFM tables, fenced code with language, task lists). The target URL goes straight in the path. - Accurate extraction — a cost-aware static→headless-Chrome fetch ladder (most pages never launch Chrome), go-readability primary (preserves code blocks and tables) with go-trafilatura fallback, converted via html-to-markdown v2. - Scheme-less OK — bare hosts like example.com are sanitized to https://.

Good to know: - Free and open — no API key required. Public endpoints are open to every caller. - Rate limit: anonymous callers get 1000 requests/second (burst 2000); a master key only elevates a caller past that limit. - The reply is text/markdown, returned by the adapter as { "content_type", "content" } (the Markdown is in content). - In-house Pilot Protocol tool, deployed on Cloud Run.

Methods · 2

plainweb.fetch
Fetch any web page and return it as clean Markdown — no HTML, no JavaScript. Pass the full target URL as `url`; it is placed verbatim in the request path (GET /<url>). Scheme-less hosts (e.g. example.com) are sanitized to https://. The reply is `{"content_type":"text/markdown; charset=utf-8","content":"<markdown>"}`. Open and free — no API key needed.
plainweb.help
Discovery: every method with params, kind, and latency class.

Full usage demo

When you need to read a public web page as clean Markdown (no HTML, no JS) in one call — for summarizing, extracting, or feeding article content to a model.

Run this first — Fetch a URL as Markdown
Call
pilotctl appstore call io.pilot.plainweb plainweb.fetch '{"url":"https://example.com"}'
→{"content_type":"text/markdown; charset=utf-8","content":"# Example Domain\n..."}

Worked examples

Scheme-less host (sanitized to https://)
Call
pilotctl appstore call io.pilot.plainweb plainweb.fetch '{"url":"en.wikipedia.org/wiki/Markdown"}'
→{"content":"# Markdown\n\nMarkdown is a lightweight markup language..."}
Read an article for summarization
Call
pilotctl appstore call io.pilot.plainweb plainweb.fetch '{"url":"https://go.dev/doc/effective_go"}'
→clean Markdown of the page (GFM tables, fenced code) in the content field
Front page of a news/link site
Call
pilotctl appstore call io.pilot.plainweb plainweb.fetch '{"url":"https://news.ycombinator.com"}'
→{"content_type":"text/markdown; charset=utf-8","content":"..."}

Good to know

  • The target URL goes verbatim into the request path (GET /<url>); pass it as the url param.
  • Scheme-less hosts (e.g. example.com) are sanitized to https://.
  • The Markdown body is in the content field of the reply, not the top level.
  • Free and open — no API key required.

Next

  • io.pilot.plainweb plainweb.help '{}'

What’s New

v1.0.0 Latest
—
  • Released v1.0.0

Platform Compatibility

macOS Apple Silicon
4.6 MBSupported
macOS Intel
4.6 MBSupported
Linux arm64
5.2 MBSupported
Linux amd64
4.8 MBSupported
You might also like

More in Web & Automation

Otto
Telepat
Drive real Chrome tabs from an agent — extract, automate, screenshot, no headless farm
macOS · Linux
Bowmark
Bowmark AI
Navigation cheatsheets for public websites, so agents run cheaper, faster, and more accurately
macOS · Linux