Guides
Guides
Read a whole page
Turn any public web page into clean markdown with its title and published date.
1 min read · Updated 20 Nov 2026
On this page
Fetch returns one web page as markdown: the readable text, without navigation, adverts or scripts, plus its title and the date the page gives itself. JavaScript-heavy pages are rendered before they are read.
Use it when you need the whole page. When you only need the parts that answer a question, Lineage returns less to read and to send to a model.
Fetch a page
curl https://fluxsearch.io/api/v1/fetch \ -H "Authorization: Bearer $FLUX_API_KEY" \ -H "Content-Type: application/json" \ -d '{"url":"https://www.catl.com/en/news/6812.html"}'import osimport requestsresponse = requests.post( "https://fluxsearch.io/api/v1/fetch", headers={"Authorization": f"Bearer {os.environ['FLUX_API_KEY']}"}, json={ "url": "https://www.catl.com/en/news/6812.html", }, timeout=120,)response.raise_for_status()data = response.json()print(data['title'], data['published_at'])print(data['markdown'][:500])const response = await fetch("https://fluxsearch.io/api/v1/fetch", { method: "POST", headers: { Authorization: `Bearer ${process.env.FLUX_API_KEY}`, "Content-Type": "application/json", }, body: JSON.stringify({ url: "https://www.catl.com/en/news/6812.html", }),});if (!response.ok) throw new Error(`Flux ${response.status}: ${await response.text()}`);const data = await response.json();console.log(data.title, data.published_at);console.log(data.markdown.slice(0, 500));Response, trimmed
{ "request_id": "req_84df9ec834c84110b6d6596d", "url": "https://www.catl.com/en/news/6812.html", "title": "CATL and HyperStrong Sign the World’s Largest Sodium-Ion Energy Storage Cooperation Agreement", "published_at": null, "markdown": "On April 27, CATL and HyperStrong signed a strategic cooperation agreement on sodium-ion batteries for energy storage in Ningde, Fujian. The two parties announced a three-year partnership covering 60GWh of sodium-ion battery supply, marking a significant milestone for the industrialization of sodium-ion batteries technology.\n\nAs CATL's first strategic partner for sodium-ion energy storage, HyperStrong will work closely with CATL in areas including technology R&D, product applications, and project deployment.\n\n![Image 1: iwEdAqNqcGcDAQTRBQAF0QNZBrCQ_6TmfNVBRgnQWtPeIpMAB9MAAAABGoTEKQgACaJpbQoAC9…", "usage": { "fetches": 1, "cost_usd": "0.0010000000", "cost_usd_ticks": 10000000 }}What comes back
url: where the page was read from, after redirects.title: the page title, or an empty string if it has none.published_at: the date the page gives itself, as ISO, or null.markdown: the readable page.usage: one fetch and its cost.
Response
- request_id (required)string | null
- url (required)string
- Where the page was read from, after redirects.
- title (required)string
- The page title. Empty if it has none.
- published_at (required)string | null
- The date the page gives itself, as ISO. Null when it gives none.
- markdown (required)string
- The readable page as markdown.
- usage (required)object
Next steps
LineageKeep only the passages of a page or document that answer a question, with names and dates filled in.Web searchSearch the live web and get ranked results, with or without the passages that answer your query.Costs and usageWhat each endpoint charges for, how to read the cost of a request, and how to check your balance.