Name: MultiTalk API: Audio-Driven Conversation Video Generator
Brand: magicapi
SKU: api-magicapi-audio-driven-conversational-video-generation-zsxkib-multitalk
Availability: InStock
Author: API Market

Shashank Agarwal

# 🗣️ Audio-Driven Conversation Video Generator API (zsxkib MultiTalk)

## Overview
MultiTalk by zsxkib generates conversation videos driven by audio. Send a reference `image` with one or two people and one or two audio files: the model animates the people so they speak along with the audio, and returns an MP4 video.

Use `first_audio` alone for a single speaker, or add `second_audio` for a two-person conversation. A text `prompt` describes the scene and interaction. Each request returns the URL of one video.

## Features
- **Audio-driven talking video**: the people in your image speak in sync with the audio you send.
- **One or two speakers**: `first_audio` is required; `second_audio` adds a second voice for a conversation.
- **Scene prompt**: describe the setting and interaction in `prompt`.
- **Length control**: `num_frames` from 25 to 201 (default 81), adjusted to the nearest value of the form 4n+1 (for example 81 or 181).
- **Speed and quality**: `sampling_steps` from 2 to 100 (default 40) and `turbo` mode (on by default) trade quality for speed.
- **Seed**: set a seed to reproduce a result.

## Use Cases
1. **Podcast and interview clips**: turn a still photo of two hosts and their audio tracks into a talking video.
2. **Dialogue scenes**: animate two characters having a conversation for stories, ads or explainers.
3. **Single-speaker talking heads**: animate one person reading a script with one audio file.
4. **Training and explainer clips**: animate a presenter photo with a recorded voice-over.

## Visual Examples
### Example Input
Reference image (`image`):

![MultiTalk example input: a man and a woman sitting in a car](https://blog.api.market/wp-content/uploads/2026/10/multitalk-input-api-market.jpg)

Audio: [first speaker (`first_audio`)](https://blog.api.market/wp-content/uploads/2026/10/multitalk-input-2-api-market-1.wav) and [second speaker (`second_audio`)](https://blog.api.market/wp-content/uploads/2026/10/multitalk-input-3-api-market.wav).

Prompt: "In a casual, intimate setting, a man and a woman are engaged in a heartfelt conversation inside a car. The man, sporting a denim jacket over a blue shirt, sits attentively with a seatbelt fastened, his gaze fixed on the woman beside him. ..." (the full prompt is in the request below).

Settings: `num_frames` `81`, `sampling_steps` `10`, `turbo` `true`.

### Example Output
[Watch the example output](https://blog.api.market/wp-content/uploads/2026/10/multitalk-output-v0ztszsz-api-market.mp4)

## Input Parameters
| Field | Type | Required | Default | Allowed values | Description |
| --- | --- | --- | --- | --- | --- |
| `image` | string (URL) | Yes |  |  | Reference image containing the person or people for video generation |
| `first_audio` | string (URL) | Yes |  |  | First audio file for driving the conversation |
| `prompt` | string | No | `A smiling man and woman wearing headphones sit in front of microphones, appearing to host a podcast.` |  | Text prompt describing the desired interaction or conversation scenario |
| `second_audio` | string (URL) | No | none |  | Second audio file for a two-person conversation |
| `num_frames` | integer | No | `81` | 25 to 201 | Number of frames to generate. Adjusted automatically to the nearest valid value of the form 4n+1, for example 81 or 181 |
| `sampling_steps` | integer | No | `40` | 2 to 100 | Number of sampling steps. Higher gives better quality, lower is faster |
| `seed` | integer | No | none |  | Random seed for reproducible results |
| `turbo` | boolean | No | `true` |  | Turbo mode optimizations (adjusts thresholds and guidance scales for speed) |

## Pricing
- **Pay As You Go (PAYG) pricing**: you only pay for what you use.
- **Price**: $0.79 per API unit.
- **1 API unit = 1 request with up to 466 seconds of processing.** A request that takes longer is billed one more unit for each started 466-second block of processing time.
- **Example cost**: the example request above (81 frames, 10 sampling steps, turbo on) took 148.2 seconds of processing, so it used 1 unit = $0.79.
- More frames, more `sampling_steps` or turning `turbo` off take longer; a job that passes 466 seconds of processing costs 2 units ($1.58).
- **Failed or cancelled predictions are not billed.**
- **GET requests to check prediction status** are free and don't count toward API unit usage.
- **No monthly subscription fee.**

## API Documentation

### Base URL
All API requests go to: `https://prod.api.market/api/v1/magicapi/audio-driven-conversational-video-generation-zsxkib-multitalk`

### Authentication
Send your api.market API key in the `x-api-market-key` header:
```
x-api-market-key: YOUR_API_MARKET_KEY
```

### Asynchronous Processing
**IMPORTANT**: This API is asynchronous. The flow is:
1. Send a POST request to `/predictions`. A successful request returns **201 Created** with a prediction `id` and a `status` of `starting` or `processing`.
2. Poll GET `/predictions/{id}` with that ID.
3. Keep polling while `status` is `starting` or `processing`.
4. Stop when `status` is `succeeded` (read `output`), `failed` or `canceled` (read `error`).

Video generation takes minutes: the example finished about 7.5 minutes after it was sent. Poll every 5 seconds and allow an overall timeout of 1800 seconds (30 minutes).

### Endpoints

#### Create a Prediction
```bash
curl -X POST "https://prod.api.market/api/v1/magicapi/audio-driven-conversational-video-generation-zsxkib-multitalk/predictions" \
  -H "Content-Type: application/json" \
  -H "x-api-market-key: YOUR_API_MARKET_KEY" \
  -d '{
    "version": "0bd2390c40618c910ffc345b36c8fd218fd8fa59c9124aa641fea443fa203b44",
    "input": {
      "image": "https://blog.api.market/wp-content/uploads/2026/10/multitalk-input-api-market.jpg",
      "turbo": true,
      "prompt": "In a casual, intimate setting, a man and a woman are engaged in a heartfelt conversation inside a car. The man, sporting a denim jacket over a blue shirt, sits attentively with a seatbelt fastened, his gaze fixed on the woman beside him. The woman, wearing a black tank top and a denim jacket draped over her shoulders, smiles warmly, her eyes reflecting genuine interest and connection. The car'\''s interior, with its beige seats and simple design, provides a backdrop that emphasizes their interaction. The scene captures a moment of shared understanding and connection, set against the soft, diffused light of an overcast day. A medium shot from a slightly angled perspective, focusing on their expressions and body language",
      "num_frames": 81,
      "first_audio": "https://blog.api.market/wp-content/uploads/2026/10/multitalk-input-2-api-market-1.wav",
      "second_audio": "https://blog.api.market/wp-content/uploads/2026/10/multitalk-input-3-api-market.wav",
      "sampling_steps": 10
    }
  }'
```

Response (201 Created):
```json
{
  "id": "v0ztszsz05rnw0d1cd0v8p5200",
  "version": "0bd2390c40618c910ffc345b36c8fd218fd8fa59c9124aa641fea443fa203b44",
  "status": "starting",
  "created_at": "2026-10-22T10:56:22.965Z"
}
```

#### Check Prediction Status
```bash
curl -X GET "https://prod.api.market/api/v1/magicapi/audio-driven-conversational-video-generation-zsxkib-multitalk/predictions/{id}" \
  -H "x-api-market-key: YOUR_API_MARKET_KEY"
```

Response when the prediction has finished (200 OK):
```json
{
  "id": "v0ztszsz05rnw0d1cd0v8p5200",
  "status": "succeeded",
  "output": "https://blog.api.market/wp-content/uploads/2026/10/multitalk-output-v0ztszsz-api-market.mp4",
  "error": null,
  "created_at": "2026-10-22T10:56:22.965Z",
  "started_at": "2026-10-22T11:01:30.458Z",
  "completed_at": "2026-10-22T11:03:58.630Z"
}
```

`output` is a single URL string pointing to the generated MP4 video.

### Status Codes
- **201 Created**: prediction created (POST `/predictions`). This is the normal success response.
- **200 OK**: prediction details returned (GET `/predictions/{id}`).
- **400 Bad Request**: invalid input, for example a missing `image` or `first_audio`, or `num_frames` outside 25 to 201.
- **401 Unauthorized**: missing or invalid API key.
- **404 Not Found**: no prediction with that ID.
- **429 Too Many Requests**: rate limit exceeded.
- **500 Internal Server Error** or **503 Service Unavailable**: temporary server problem; retry later.

## Rate Limits
All plans allow 10 requests per second. Requests above that return `429 Too Many Requests`; back off before retrying and honour any `Retry-After` header. Polling a prediction with GET is free but still counts toward the per-second limit, so poll every 1 to 5 seconds rather than in a tight loop.

## Error Handling
- Check the HTTP status code of every request and read the response body for the error message.
- A prediction can also end with `status` set to `failed`; the `error` field then explains why. Failed predictions are not billed.
- Retry 429, 500 and 503 responses with exponential backoff. Fix the input before retrying a 400.

## Implementation Guide
### Example Code

#### JavaScript
```javascript
const apiKey = "YOUR_API_MARKET_KEY";
const baseUrl = "https://prod.api.market/api/v1/magicapi/audio-driven-conversational-video-generation-zsxkib-multitalk";

async function createAndWaitForPrediction(input) {
  const response = await fetch(`${baseUrl}/predictions`, {
    method: "POST",
    headers: {
      "Content-Type": "application/json",
      "x-api-market-key": apiKey
    },
    body: JSON.stringify({ version: "0bd2390c40618c910ffc345b36c8fd218fd8fa59c9124aa641fea443fa203b44", input })
  });

  if (response.status !== 201) {
    throw new Error(`API error: ${response.status} ${await response.text()}`);
  }

  const prediction = await response.json();
  return pollForResults(prediction.id);
}

const delay = (ms) => new Promise((resolve) => setTimeout(resolve, ms));

async function pollForResults(predictionId) {
  const maxTimeout = 1800000;
  const pollInterval = 5000;
  const startTime = Date.now();

  while (Date.now() - startTime < maxTimeout) {
    const response = await fetch(`${baseUrl}/predictions/${predictionId}`, {
      headers: { "x-api-market-key": apiKey }
    });

    if (!response.ok) {
      throw new Error(`API error: ${response.status} ${await response.text()}`);
    }

    const prediction = await response.json();

    if (prediction.status === "succeeded") {
      return prediction.output;
    }

    if (prediction.status === "failed" || prediction.status === "canceled") {
      throw new Error(`Prediction ${prediction.status}: ${prediction.error || "Unknown error"}`);
    }

    await delay(pollInterval);
  }

  throw new Error("Prediction timed out after 30 minutes");
}

createAndWaitForPrediction({
  image: "https://blog.api.market/wp-content/uploads/2026/10/multitalk-input-api-market.jpg",
  turbo: true,
  prompt: "In a casual, intimate setting, a man and a woman are engaged in a heartfelt conversation inside a car. The man, sporting a denim jacket over a blue shirt, sits attentively with a seatbelt fastened, his gaze fixed on the woman beside him. The woman, wearing a black tank top and a denim jacket draped over her shoulders, smiles warmly, her eyes reflecting genuine interest and connection. The car's interior, with its beige seats and simple design, provides a backdrop that emphasizes their interaction. The scene captures a moment of shared understanding and connection, set against the soft, diffused light of an overcast day. A medium shot from a slightly angled perspective, focusing on their expressions and body language",
  num_frames: 81,
  first_audio: "https://blog.api.market/wp-content/uploads/2026/10/multitalk-input-2-api-market-1.wav",
  second_audio: "https://blog.api.market/wp-content/uploads/2026/10/multitalk-input-3-api-market.wav",
  sampling_steps: 10
}).then((output) => console.log(output));
```

#### Python
```python
import time
import requests

API_KEY = "YOUR_API_MARKET_KEY"
BASE_URL = "https://prod.api.market/api/v1/magicapi/audio-driven-conversational-video-generation-zsxkib-multitalk"


def create_and_wait_for_prediction(input_data):
    headers = {"Content-Type": "application/json", "x-api-market-key": API_KEY}
    response = requests.post(
        f"{BASE_URL}/predictions",
        headers=headers,
        json={"version": "0bd2390c40618c910ffc345b36c8fd218fd8fa59c9124aa641fea443fa203b44", "input": input_data},
    )

    if response.status_code != 201:
        raise Exception(f"API error: {response.status_code} {response.text}")

    return poll_for_results(response.json()["id"])


def poll_for_results(prediction_id):
    max_timeout = 1800
    poll_interval = 5
    headers = {"x-api-market-key": API_KEY}
    start_time = time.time()

    while time.time() - start_time < max_timeout:
        response = requests.get(f"{BASE_URL}/predictions/{prediction_id}", headers=headers)

        if response.status_code != 200:
            raise Exception(f"API error: {response.status_code} {response.text}")

        prediction = response.json()

        if prediction["status"] == "succeeded":
            return prediction["output"]

        if prediction["status"] in ("failed", "canceled"):
            raise Exception(f"Prediction {prediction['status']}: {prediction.get('error') or 'Unknown error'}")

        time.sleep(poll_interval)

    raise Exception("Prediction timed out after 30 minutes")


print(create_and_wait_for_prediction({
    "image": "https://blog.api.market/wp-content/uploads/2026/10/multitalk-input-api-market.jpg",
    "turbo": True,
    "prompt": "In a casual, intimate setting, a man and a woman are engaged in a heartfelt conversation inside a car. The man, sporting a denim jacket over a blue shirt, sits attentively with a seatbelt fastened, his gaze fixed on the woman beside him. The woman, wearing a black tank top and a denim jacket draped over her shoulders, smiles warmly, her eyes reflecting genuine interest and connection. The car's interior, with its beige seats and simple design, provides a backdrop that emphasizes their interaction. The scene captures a moment of shared understanding and connection, set against the soft, diffused light of an overcast day. A medium shot from a slightly angled perspective, focusing on their expressions and body language",
    "num_frames": 81,
    "first_audio": "https://blog.api.market/wp-content/uploads/2026/10/multitalk-input-2-api-market-1.wav",
    "second_audio": "https://blog.api.market/wp-content/uploads/2026/10/multitalk-input-3-api-market.wav",
    "sampling_steps": 10
}))
```

## FAQ
- **Can I animate just one person?**
  - Yes. Send only `first_audio`. Add `second_audio` when the image has two people who should talk to each other.
- **How do I make the video longer?**
  - Raise `num_frames` (25 to 201, default 81). The value is adjusted to the nearest number of the form 4n+1, such as 181. Longer videos take longer to generate.
- **How do I trade speed for quality?**
  - Keep `turbo` on and use fewer `sampling_steps` (the example used 10) for faster results; raise `sampling_steps` (up to 100) for better quality.
- **How long does a request take?**
  - Several minutes. The example spent 148 seconds generating and finished about 7.5 minutes after it was sent, including startup time.
- **How is a request billed?**
  - $0.79 for each started 466-second block of processing. The example took 148.2 seconds and cost $0.79.
- **What if my prediction fails?**
  - Failed predictions are not billed. Read the `error` field, adjust the input and try again.

## Contact Us
If you have any questions, reach out to us through the chat on the bottom right of the page. You can also email our support team at hello@magicapi.com.


Animate one or two people in a photo so they speak along with your audio files using zsxkib MultiTalk; returns an MP4 video. Pay as you go, no monthly fee.