Name: Lipsync-2-Pro API: Video Lipsync by Sync Labs
Brand: magicapi
SKU: api-magicapi-lipsync-video-api-sync-lipsync-2-pro
Availability: InStock
Author: API Market

Shashank Agarwal

# 🗣️ Lipsync Video API (Lipsync-2-Pro)

## Overview
Lipsync-2-Pro is a lipsync model from Sync Labs. You send a video of a person and an audio track, and the model returns a video in which the person's lip movements match the new audio. Sync Labs describes it as studio-grade lipsync in minutes, not weeks.

## Features
- **Lipsync to new audio:** the lips in your video are re-animated to follow the audio you send.
- **Video and audio by URL:** `video` is an input video file (.mp4) and `audio` is an input audio file (.wav in the schema).
- **Out-of-sync lengths:** `sync_mode` sets what happens when the audio and video durations differ: `loop` (the default), `bounce`, `cut_off`, `silence` or `remap`.
- **Expressiveness:** `temperature` from 0 to 1 (default 0.5) sets how expressive the lipsync can be.
- **Active speaker detection:** with `active_speaker` set to true, whoever is speaking in the clip is used for lipsync (default false).

## Use Cases
- **Dubbing and localization:** match a speaker's lips to a translated voice track.
- **Dialogue fixes:** replace a line of dialogue after the shoot without reshooting.
- **AI avatars and presenters:** make a generated or recorded presenter speak a new script.
- **Personalized video messages:** reuse one recording with different audio for each recipient.

## Visual Examples
This is a real request sent through api.market and the file it returned.

Inputs used: `video` and `audio` as shown below (all other fields at their defaults: `sync_mode` "loop", `temperature` 0.5, `active_speaker` false).

**Input video (`video`):** [Watch the input video](https://blog.api.market/wp-content/uploads/2026/10/p-video-avatar-output-api-market.mp4)

**Input audio (`audio`):** [Listen to the input audio](https://blog.api.market/wp-content/uploads/2026/10/realtime-tts-1.5-max-output-api-market.mp3)

**Output video:** [Watch the example video](https://blog.api.market/wp-content/uploads/2026/10/lipsync-2-pro-output-api-market.mp4)

## Pricing
- **Pay As You Go (PAYG) pricing:** you only pay for what you use.
- **Price:** $0.105 per API unit.
- **1 API unit** = 1 second of output video, rounded up to the next whole second. There are no variants or tiers: every second costs the same.
- **Worked example:** a 5 second output video is 5 units = $0.525. A 12.4 second output video rounds up to 13 units = $1.365.
- **Failed or cancelled predictions** are not billed.
- **GET requests** to check prediction status (GET /api/v1/magicapi/lipsync-video-api-sync-lipsync-2-pro/predictions/{id}) are free and don't count toward API unit usage.
- **No monthly subscription fee.**

## API Documentation

### Base URL
`https://prod.api.market/api/v1/magicapi/lipsync-video-api-sync-lipsync-2-pro`

### Authentication
Send your api.market API key in the `x-api-market-key` header on every request:
```
x-api-market-key: YOUR_API_MARKET_KEY
```

### Asynchronous Processing
**IMPORTANT:** This API is asynchronous.
1. POST `/predictions` with the model `version` and your `input`.
2. The API returns **201 Created** with a prediction `id` and a `status` of `starting` or `processing`. 201 means the request was accepted; it is not an error.
3. Poll GET `/predictions/{id}` until `status` is `succeeded`, `failed` or `canceled`.
4. When `status` is `succeeded`, `output` holds the URL of the generated video.
5. When `status` is `failed`, the `error` field explains why.

### Endpoints

#### Create a Prediction
`POST /predictions`

```bash
curl -X POST "https://prod.api.market/api/v1/magicapi/lipsync-video-api-sync-lipsync-2-pro/predictions" \
  -H "Content-Type: application/json" \
  -H "x-api-market-key: YOUR_API_MARKET_KEY" \
  -d '{
    "version": "e00dd8e1b1ef26d1f350786bf329006baeb5022abf936e6c0cb36086866c385f",
    "input": {
      "video": "https://blog.api.market/wp-content/uploads/2026/10/p-video-avatar-output-api-market.mp4",
      "audio": "https://blog.api.market/wp-content/uploads/2026/10/realtime-tts-1.5-max-output-api-market.mp3"
    }
  }'
```

Response (201 Created):
```json
{
  "id": "s2l5vp8kq0dr1cw6n3jzhx7mbe",
  "version": "e00dd8e1b1ef26d1f350786bf329006baeb5022abf936e6c0cb36086866c385f",
  "status": "starting",
  "created_at": "2026-10-13T11:20:03.552Z"
}
```

#### Check Prediction Status
`GET /predictions/{id}`

```bash
curl -X GET "https://prod.api.market/api/v1/magicapi/lipsync-video-api-sync-lipsync-2-pro/predictions/s2l5vp8kq0dr1cw6n3jzhx7mbe" \
  -H "x-api-market-key: YOUR_API_MARKET_KEY"
```

Response (200 OK) once the prediction has finished:
```json
{
  "id": "s2l5vp8kq0dr1cw6n3jzhx7mbe",
  "status": "succeeded",
  "input": {
    "video": "https://blog.api.market/wp-content/uploads/2026/10/p-video-avatar-output-api-market.mp4",
    "audio": "https://blog.api.market/wp-content/uploads/2026/10/realtime-tts-1.5-max-output-api-market.mp3"
  },
  "output": "https://blog.api.market/wp-content/uploads/2026/10/lipsync-2-pro-output-api-market.mp4",
  "error": null,
  "created_at": "2026-10-13T11:20:03.552Z",
  "started_at": "2026-10-13T11:20:04.017Z",
  "completed_at": "2026-10-13T11:21:37.846Z"
}
```

### Input Parameters
| Parameter | Type | Required | Default | Allowed values | Description |
|---|---|---|---|---|---|
| `video` | string (URL) | Yes | none |  | Input video file (.mp4) |
| `audio` | string (URL) | Yes | none |  | Input audio file (.wav) |
| `sync_mode` | string | No | "loop" | `loop`, `bounce`, `cut_off`, `silence`, `remap` | Lipsync mode when audio and video durations are out of sync |
| `temperature` | number | No | 0.5 | 0 to 1 | How expressive lipsync can be (0-1) |
| `active_speaker` | boolean | No | false |  | Whether to detect active speaker (i.e. whoever is speaking in the clip will be used for lipsync) |

### Output
`output` is a single URL (string) pointing to the generated MP4 video.

## Status Codes
- **200 OK:** prediction status returned.
- **201 Created:** prediction accepted. Poll GET `/predictions/{id}` for the result.
- **400 Bad Request:** invalid or missing input fields.
- **401 Unauthorized:** missing or invalid API key.
- **404 Not Found:** unknown prediction ID.
- **429 Too Many Requests:** too many requests in a short time. Wait and retry.
- **500 Internal Server Error:** server-side error. Retry after a short wait.

## Rate Limits

All plans allow 10 requests per second. Requests above that return `429 Too Many Requests`; back off before retrying and honour any `Retry-After` header. Polling a prediction with GET is free but still counts toward the per-second limit, so poll every 1 to 5 seconds rather than in a tight loop.

## Error Handling
- **Request errors (4xx):** check the response body, fix the input fields and send the request again.
- **Failed predictions:** when GET returns `status: "failed"`, read the `error` field. Failed predictions are not billed.
- **Rate limits (429) and server errors (5xx):** retry with exponential backoff.

## Implementation Guide

### JavaScript
```javascript
const apiKey = "YOUR_API_MARKET_KEY";
const baseUrl = "https://prod.api.market/api/v1/magicapi/lipsync-video-api-sync-lipsync-2-pro";

async function createPrediction(input) {
  const response = await fetch(`${baseUrl}/predictions`, {
    method: "POST",
    headers: {
      "Content-Type": "application/json",
      "x-api-market-key": apiKey
    },
    body: JSON.stringify({ version: "e00dd8e1b1ef26d1f350786bf329006baeb5022abf936e6c0cb36086866c385f", input })
  });
  if (response.status !== 201 && response.status !== 200) {
    throw new Error(`API error: ${response.status} ${await response.text()}`);
  }
  return response.json();
}

async function waitForPrediction(id, timeoutMs = 1200000, intervalMs = 5000) {
  const start = Date.now();
  while (Date.now() - start < timeoutMs) {
    const response = await fetch(`${baseUrl}/predictions/${id}`, {
      headers: { "x-api-market-key": apiKey }
    });
    if (!response.ok) {
      throw new Error(`API error: ${response.status} ${await response.text()}`);
    }
    const prediction = await response.json();
    if (prediction.status === "succeeded") return prediction.output;
    if (prediction.status === "failed" || prediction.status === "canceled") {
      throw new Error(`Prediction ${prediction.status}: ${prediction.error || "unknown error"}`);
    }
    await new Promise((resolve) => setTimeout(resolve, intervalMs));
  }
  throw new Error("Timed out waiting for the prediction");
}

const prediction = await createPrediction({
  "video": "https://blog.api.market/wp-content/uploads/2026/10/p-video-avatar-output-api-market.mp4",
  "audio": "https://blog.api.market/wp-content/uploads/2026/10/realtime-tts-1.5-max-output-api-market.mp3"
});
const output = await waitForPrediction(prediction.id);
console.log(output);
```

### Python
```python
import time
import requests

API_KEY = "YOUR_API_MARKET_KEY"
BASE_URL = "https://prod.api.market/api/v1/magicapi/lipsync-video-api-sync-lipsync-2-pro"

def create_prediction(input_data):
    response = requests.post(
        f"{BASE_URL}/predictions",
        headers={"Content-Type": "application/json", "x-api-market-key": API_KEY},
        json={"version": "e00dd8e1b1ef26d1f350786bf329006baeb5022abf936e6c0cb36086866c385f", "input": input_data},
    )
    if response.status_code not in (200, 201):
        raise Exception(f"API error: {response.status_code} {response.text}")
    return response.json()

def wait_for_prediction(prediction_id, timeout=1200, interval=5):
    start = time.time()
    while time.time() - start < timeout:
        response = requests.get(
            f"{BASE_URL}/predictions/{prediction_id}",
            headers={"x-api-market-key": API_KEY},
        )
        if response.status_code != 200:
            raise Exception(f"API error: {response.status_code} {response.text}")
        prediction = response.json()
        if prediction["status"] == "succeeded":
            return prediction["output"]
        if prediction["status"] in ("failed", "canceled"):
            raise Exception(f"Prediction {prediction['status']}: {prediction.get('error') or 'unknown error'}")
        time.sleep(interval)
    raise Exception("Timed out waiting for the prediction")

prediction = create_prediction({
  "video": "https://blog.api.market/wp-content/uploads/2026/10/p-video-avatar-output-api-market.mp4",
  "audio": "https://blog.api.market/wp-content/uploads/2026/10/realtime-tts-1.5-max-output-api-market.mp3"
})
print(wait_for_prediction(prediction["id"]))
```

### cURL
```bash
# Step 1: create the prediction (returns 201 Created with an id)
curl -X POST "https://prod.api.market/api/v1/magicapi/lipsync-video-api-sync-lipsync-2-pro/predictions" \
  -H "Content-Type: application/json" \
  -H "x-api-market-key: YOUR_API_MARKET_KEY" \
  -d '{
    "version": "e00dd8e1b1ef26d1f350786bf329006baeb5022abf936e6c0cb36086866c385f",
    "input": {
      "video": "https://blog.api.market/wp-content/uploads/2026/10/p-video-avatar-output-api-market.mp4",
      "audio": "https://blog.api.market/wp-content/uploads/2026/10/realtime-tts-1.5-max-output-api-market.mp3"
    }
  }'

# Step 2: poll with the returned id until status is succeeded, failed or canceled
curl -X GET "https://prod.api.market/api/v1/magicapi/lipsync-video-api-sync-lipsync-2-pro/predictions/s2l5vp8kq0dr1cw6n3jzhx7mbe" \
  -H "x-api-market-key: YOUR_API_MARKET_KEY"
```

## FAQ
**Q: What happens if my audio and video are different lengths?**  
A: `sync_mode` decides it. The options are `loop` (the default), `bounce`, `cut_off`, `silence` and `remap`. You are billed for the seconds of video the model returns.

**Q: What does temperature do?**  
A: It sets how expressive the lipsync can be, from 0 to 1. The default is 0.5.

**Q: The clip has more than one person. Who gets lipsynced?**  
A: Set `active_speaker` to true to detect the active speaker, so whoever is speaking in the clip is used for lipsync.

**Q: Which file formats should I send?**  
A: The schema describes `video` as an .mp4 file and `audio` as a .wav file. Both are passed as URLs.

**Q: Is POST returning 201 an error?**  
A: No. 201 Created means the prediction was accepted. Use the returned `id` to poll GET `/predictions/{id}` until `status` is `succeeded`, `failed` or `canceled`.

## Contact Us

If you have any questions or need assistance, you can reach out to us through the embedded chat on the bottom right corner of the page or send an email to hello@magicapi.com.


Lipsync a video to new audio with Sync Labs Lipsync-2-Pro. Send a video and an audio file, get back a lipsynced video. Billed at $0.105 per second of output.