Name: Article to JSON API: Extract Article Text from URLs
Brand: betelgues
SKU: api-betelgues-article-to-json
Availability: InStock
Author: API Market

# Article to JSON API

## Overview

The Article to JSON API extracts the readable content of any public article or web page and returns it as structured JSON. For a URL you get the title, author, publish date, clean body text, a short excerpt, word count, description, site name, top image and keywords. Use a simple GET for one URL or POST to send a URL in a JSON body.

It is for developers building read-later apps, content aggregators, research tools, SEO tools and AI pipelines that need clean article text instead of raw HTML. The extractor removes navigation, ads and boilerplate so you can index, summarise or analyse the content directly.

## Features

*   **3 endpoints**: health check, GET extraction and POST extraction.
*   **Article fields**: title, author, published date, text, excerpt, word count, description, site name, top image and keywords.
*   **Clean text**: boilerplate, navigation and ads are removed.
*   **Two ways to call**: pass the URL as a query parameter or in a JSON body.
*   **Rate limit**: up to 10 requests per second on every plan.

## Use Cases

*   **AI and LLM pipelines**: feed clean article text into summarisation, embeddings or RAG.
*   **Read-later and reader apps**: show articles without clutter.
*   **Content aggregation**: store title, author and date for every link you collect.
*   **SEO and research**: analyse word count, keywords and descriptions across pages.

## API Documentation

### Base URL

All requests go through the API.market proxy at this base URL:

```
https://prod.api.market/api/v1/betelgues/article-to-json
```

### Authentication

Every request must include your API.market key in the `x-api-market-key` header:

```
x-api-market-key: YOUR_API_KEY
```

Replace `YOUR_API_KEY` with your actual API key.

### Endpoints

#### 1. Health check

Returns the service status and version. Use it to confirm the Article to JSON API is up before making data calls.

**Method:** `GET`

**Endpoint:** `/health`

**Parameters:** None.

**Example Request:**

```bash
curl -X GET 'https://prod.api.market/api/v1/betelgues/article-to-json/health' \
  -H 'x-api-market-key: YOUR_API_KEY'
```

**Example Response (200 OK):**

```json
{
  "status": "ok",
  "service": "article-to-json",
  "version": "0.2.0"
}
```

#### 2. Extract article (GET)

Fetches the page at `url` and returns the extracted article fields. The response has the same shape as the POST endpoint below.

**Method:** `GET`

**Endpoint:** `/extract`

**Parameters:**

| Name | In | Description | Type | Required | Default | Max Value |
|---|---|---|---|---|---|---|
| url | query | Public article or page URL | string | Yes | - | - |

**Example Request:**

```bash
curl -X GET 'https://prod.api.market/api/v1/betelgues/article-to-json/extract?url=https%3A%2F%2Fen.wikipedia.org%2Fwiki%2FApplication_programming_interface' \
  -H 'x-api-market-key: YOUR_API_KEY'
```

#### 3. Extract article (POST)

Same extraction with the URL sent in a JSON body. The response also includes the page `html`, left out of the example below for length.

**Method:** `POST`

**Endpoint:** `/extract`

**Parameters:**

| Name | In | Description | Type | Required | Default | Max Value |
|---|---|---|---|---|---|---|
| url | body | Public article or page URL | string | Yes | - | - |

**Example Request:**

```bash
curl -X POST 'https://prod.api.market/api/v1/betelgues/article-to-json/extract' \
  -H 'x-api-market-key: YOUR_API_KEY' \
  -H 'Content-Type: application/json' \
  -d '{
  "url": "https://www.bbc.com/news"
}'
```

**Example Response (200 OK):**

```json
{
  "title": "BBC News - Breaking news, video and the latest top stories from the U.S. and around the world",
  "author": null,
  "published": "2026-01-28",
  "text": "Seven flights across Europe targeted by suspected bomb threats\nPlanes in Poland, Spain, Bulgaria and Italy have been checked for explosives following separate threats.",
  "html_excerpt": "Seven flights across Europe targeted by suspected bomb threats Planes in Poland, Spain, Bulgaria and Italy have been checked for explosives following separate threats.",
  "url": "https://www.bbc.com/news",
  "word_count": 24,
  "description": "Visit BBC News for the latest news, breaking news, video, audio and analysis. BBC News provides trusted World, U.S. and U.K. news as well as local and regional perspectives. Also entertainment, climate, business, science, technology and hea...",
  "site_name": "BBC News",
  "top_image": null,
  "keywords": [],
  "length": 167,
  "summary": [
    "Seven flights across Europe targeted by suspected bomb threats\nPlanes in Poland, Spain, Bulgaria and Italy have been checked for explosives following separate threats."
  ]
}
```

## Status Codes

| Code | Status | Description |
|---|---|---|
| 200 | OK | The request succeeded and the response body holds the result. |
| 400 | Bad Request | A required parameter is missing or a value is invalid. Check the parameter table for the endpoint. |
| 401 | Unauthorized | The `x-api-market-key` header is missing or the key is not valid. |
| 403 | Forbidden | Your key is valid but your subscription does not allow this request, for example an endpoint outside your plan. |
| 404 | Not Found | The path does not exist, or the resource you asked for was not found. |
| 429 | Too Many Requests | You sent more than 10 requests per second. Slow down and retry, honouring the `Retry-After` header. |
| 500 | Internal Server Error | Something went wrong while processing the request. Retry after a short wait. |
| 503 | Service Unavailable | The service or its upstream data source is temporarily unavailable. Retry with backoff. |

## Rate Limits

Every plan allows up to 10 requests per second. Subscription plans also have a monthly call quota shown on the pricing page. Sending more than 10 requests per second returns `429 Too Many Requests`. Throttle your client to stay under 10 requests per second, back off and retry when you get a 429, and honour the `Retry-After` header when it is present.

## FAQ

*   **Does it work on paywalled pages?**

    No. It reads what the page returns to a public request, so paywalled or login-only content is not extracted.

*   **What happens on a home page instead of an article?**

    You get the page title, description and whatever main text the extractor finds, which is usually short. It works best on single article pages.

*   **Can author or published be null?**

    Yes. They are filled only when the page provides them.

*   **What is the /health endpoint for?**

    It returns the service name and version so you can confirm the API is reachable before sending real requests. It does not fetch any data.

## Contact Us

If you have any questions or need assistance, you can reach out to us through the embedded chat on the bottom right corner of the page or send an email to hello@magicapi.com.


Extract title, author, date, clean text, word count and keywords from any public article URL as structured JSON.

Article to JSON API: Extract Article Text from URLs

Free

Betelgues