Name: Realistic Voice Cloning API: AI Song Cover Generator
Brand: magicapi
SKU: api-magicapi-realistic-voice-cloning-zsxkib-realistic-voice-cloning
Availability: InStock
Author: API Market

Shashank Agarwal

# 🎤 AI Song Cover Generator API (zsxkib Realistic Voice Cloning)

## Overview
Realistic Voice Cloning, packaged by zsxkib, creates song covers with RVC v2 (Retrieval-based Voice Conversion) voice models. You send a song; the model replaces the lead vocals with the chosen RVC voice and mixes them back with the backing vocals and instrumental.

Send a `song_input` audio URL and pick a voice with `rvc_model`, or load your own trained RVC v2 model with `custom_rvc_model_download_url`. Each request returns the URL of one audio file (`mp3` by default, or `wav`).

## Features
- **Built-in voices**: `rvc_model` offers `Squidward` (default), `MrKrabs`, `Plankton`, `Drake`, `Vader`, `Trump`, `Biden`, `Obama`, `Guitar`, `Voilin` and `CUSTOM`.
- **Custom RVC models**: pass a download URL in `custom_rvc_model_download_url` to use any RVC v2 trained voice.
- **Pitch control**: `pitch_change` (`no-change`, `male-to-female`, `female-to-male`) for the AI vocals, and `pitch_change_all` to shift the key of the whole song in semitones.
- **Voice conversion tuning**: `index_rate`, `filter_radius`, `rms_mix_rate`, `protect`, and the pitch detection algorithm (`rmvpe` or `mangio-crepe`, with `crepe_hop_length`).
- **Mixing**: separate volume changes for the main AI vocals, backup vocals and instrumental, in decibels.
- **Reverb**: room size, wetness, dryness and damping for the AI vocals.
- **Output format**: `mp3` (default, smaller) or `wav` (best quality, larger).

## Use Cases
1. **Song covers**: hear a song sung in a different voice.
2. **Custom voice models**: apply your own RVC v2 voice, trained with the speaker's consent, to songs.
3. **Music prototyping**: try a melody with different vocal timbres or a male-to-female pitch shift.
4. **Instrument timbres**: convert a vocal line with the `Guitar` or `Voilin` models.

## Visual Examples
### Example Input
Input song: [Listen to the example input](https://blog.api.market/wp-content/uploads/2026/10/realistic-voice-cloning-input-api-market.mp3)

```json
{
  "protect": 0.33,
  "rvc_model": "Squidward",
  "index_rate": 0.5,
  "song_input": "https://blog.api.market/wp-content/uploads/2026/10/realistic-voice-cloning-input-api-market.mp3",
  "reverb_size": 0.15,
  "pitch_change": "no-change",
  "rms_mix_rate": 0.25,
  "filter_radius": 3,
  "output_format": "mp3",
  "reverb_damping": 0.7,
  "reverb_dryness": 0.8,
  "reverb_wetness": 0.2,
  "crepe_hop_length": 128,
  "pitch_change_all": 0,
  "main_vocals_volume_change": 10,
  "pitch_detection_algorithm": "rmvpe",
  "instrumental_volume_change": 0,
  "backup_vocals_volume_change": 0
}
```

### Example Output
The song with its lead vocals converted to the `Squidward` voice, main vocals raised by 10 dB: [Listen to the example output](https://blog.api.market/wp-content/uploads/2026/10/realistic-voice-cloning-output-cxdxhx87-api-market.mp3)

## Input Parameters
| Field | Type | Required | Default | Allowed values | Description |
| --- | --- | --- | --- | --- | --- |
| `song_input` | string (URL) | No | none |  | Audio file URL of the song to convert |
| `rvc_model` | string | No | `Squidward` | `Squidward`, `MrKrabs`, `Plankton`, `Drake`, `Vader`, `Trump`, `Biden`, `Obama`, `Guitar`, `Voilin`, `CUSTOM` | RVC model for a specific voice. If using a custom model, this should match the name of the downloaded model. If `custom_rvc_model_download_url` is provided, this is set automatically to the name of the downloaded model. |
| `custom_rvc_model_download_url` | string | No | none |  | URL to download a custom RVC model. If provided, the model is downloaded (if it doesn't already exist) and used, regardless of the `rvc_model` value. |
| `pitch_change` | string | No | `no-change` | `no-change`, `male-to-female`, `female-to-male` | Adjust pitch of AI vocals |
| `index_rate` | number | No | `0.5` | 0 to 1 | Control how much of the AI's accent to leave in the vocals |
| `filter_radius` | integer | No | `3` | 0 to 7 | If 3 or more, apply median filtering to the harvested pitch results |
| `rms_mix_rate` | number | No | `0.25` | 0 to 1 | Control how much to use the original vocal's loudness (0) or a fixed loudness (1) |
| `pitch_detection_algorithm` | string | No | `rmvpe` | `rmvpe`, `mangio-crepe` | Best option is rmvpe (clarity in vocals), then mangio-crepe (smoother vocals) |
| `crepe_hop_length` | integer | No | `128` |  | When `pitch_detection_algorithm` is `mangio-crepe`, how often it checks for pitch changes in milliseconds. Lower values lead to longer conversions and higher risk of voice cracks, but better pitch accuracy. |
| `protect` | number | No | `0.33` | 0 to 0.5 | Control how much of the original vocals' breath and voiceless consonants to leave in the AI vocals. Set 0.5 to disable. |
| `main_vocals_volume_change` | number | No | `0` |  | Volume change of main AI vocals in decibels. Use -3 to decrease the volume by 3 dB, or 3 to increase it by 3 dB. |
| `backup_vocals_volume_change` | number | No | `0` |  | Volume change of backup vocals |
| `instrumental_volume_change` | number | No | `0` |  | Volume change of the background music and instrumentals |
| `pitch_change_all` | number | No | `0` |  | Change pitch/key of background music, backup vocals and AI vocals in semitones. Reduces sound quality slightly. |
| `reverb_size` | number | No | `0.15` | 0 to 1 | The larger the room, the longer the reverb time |
| `reverb_wetness` | number | No | `0.2` | 0 to 1 | Level of AI vocals with reverb |
| `reverb_dryness` | number | No | `0.8` | 0 to 1 | Level of AI vocals without reverb |
| `reverb_damping` | number | No | `0.7` | 0 to 1 | Absorption of high frequencies in the reverb |
| `output_format` | string | No | `mp3` | `mp3`, `wav` | wav for best quality and large file size, mp3 for decent quality and small file size |

## Pricing
- **Pay As You Go (PAYG) pricing**: you only pay for what you use.
- **Price**: $0.055 per API unit.
- **1 API unit = 1 request covering up to 220 seconds of processing.** A request that processes for longer uses one unit per started 220-second block (for example 221 seconds = 2 units, $0.11). Longer songs take longer to process.
- **Example cost**: the example request processed for 71.20 seconds = 1 API unit = **$0.055**.
- **Failed or cancelled predictions are not billed.**
- **GET requests to check prediction status** are free and don't count toward API unit usage.
- **No monthly subscription fee.**

## API Documentation

### Base URL
All API requests go to: `https://prod.api.market/api/v1/magicapi/realistic-voice-cloning-zsxkib-realistic-voice-cloning`

### Authentication
Send your api.market API key in the `x-api-market-key` header:
```
x-api-market-key: YOUR_API_MARKET_KEY
```

### Asynchronous Processing
**IMPORTANT**: This API is asynchronous. The flow is:
1. Send a POST request to `/predictions`. A successful request returns **201 Created** with a prediction `id` and a `status` of `starting` or `processing`.
2. Poll GET `/predictions/{id}` with that ID.
3. Keep polling while `status` is `starting` or `processing`.
4. Stop when `status` is `succeeded` (read `output`), `failed` or `canceled` (read `error`).

A polling interval of 2 seconds and an overall timeout of 900 seconds (15 minutes) work well; song covers take a minute or more.

### Endpoints

#### Create a Prediction
```bash
curl -X POST "https://prod.api.market/api/v1/magicapi/realistic-voice-cloning-zsxkib-realistic-voice-cloning/predictions" \
  -H "Content-Type: application/json" \
  -H "x-api-market-key: YOUR_API_MARKET_KEY" \
  -d '{
    "version": "0a9c7c558af4c0f20667c1bd1260ce32a2879944a0b9e44e1398660c077b1550",
    "input": {
      "protect": 0.33,
      "rvc_model": "Squidward",
      "index_rate": 0.5,
      "song_input": "https://blog.api.market/wp-content/uploads/2026/10/realistic-voice-cloning-input-api-market.mp3",
      "reverb_size": 0.15,
      "pitch_change": "no-change",
      "rms_mix_rate": 0.25,
      "filter_radius": 3,
      "output_format": "mp3",
      "reverb_damping": 0.7,
      "reverb_dryness": 0.8,
      "reverb_wetness": 0.2,
      "crepe_hop_length": 128,
      "pitch_change_all": 0,
      "main_vocals_volume_change": 10,
      "pitch_detection_algorithm": "rmvpe",
      "instrumental_volume_change": 0,
      "backup_vocals_volume_change": 0
    }
  }'
```

Response (201 Created):
```json
{
  "id": "cxdxhx8739rg80d1cd0vwgdm88",
  "version": "0a9c7c558af4c0f20667c1bd1260ce32a2879944a0b9e44e1398660c077b1550",
  "status": "starting",
  "created_at": "2026-10-22T10:56:08.655Z"
}
```

#### Check Prediction Status
```bash
curl -X GET "https://prod.api.market/api/v1/magicapi/realistic-voice-cloning-zsxkib-realistic-voice-cloning/predictions/{id}" \
  -H "x-api-market-key: YOUR_API_MARKET_KEY"
```

Response when the prediction has finished (200 OK):
```json
{
  "id": "cxdxhx8739rg80d1cd0vwgdm88",
  "status": "succeeded",
  "output": "https://blog.api.market/wp-content/uploads/2026/10/realistic-voice-cloning-output-cxdxhx87-api-market.mp3",
  "error": null,
  "created_at": "2026-10-22T10:56:08.655Z",
  "started_at": "2026-10-22T10:57:11.052Z",
  "completed_at": "2026-10-22T10:58:22.254Z"
}
```

`output` is a single URL string pointing to the finished cover in the chosen `output_format`.

### Status Codes
- **201 Created**: prediction created (POST `/predictions`). This is the normal success response.
- **200 OK**: prediction details returned (GET `/predictions/{id}`).
- **400 Bad Request**: invalid input, for example an `rvc_model` that is not in the list or a `protect` value above 0.5.
- **401 Unauthorized**: missing or invalid API key.
- **404 Not Found**: no prediction with that ID.
- **429 Too Many Requests**: rate limit exceeded.
- **500 Internal Server Error** or **503 Service Unavailable**: temporary server problem; retry later.

## Rate Limits
All plans allow 10 requests per second. Requests above that return `429 Too Many Requests`; back off before retrying and honour any `Retry-After` header. Polling a prediction with GET is free but still counts toward the per-second limit, so poll every 1 to 5 seconds rather than in a tight loop.

## Error Handling
- Check the HTTP status code of every request and read the response body for the error message.
- A prediction can also end with `status` set to `failed`; the `error` field then explains why, for example an audio URL or custom model URL that cannot be downloaded. Failed predictions are not billed.
- Retry 429, 500 and 503 responses with exponential backoff. Fix the input before retrying a 400.

## Implementation Guide
### Example Code

#### JavaScript
```javascript
const apiKey = "YOUR_API_MARKET_KEY";
const baseUrl = "https://prod.api.market/api/v1/magicapi/realistic-voice-cloning-zsxkib-realistic-voice-cloning";

async function createAndWaitForPrediction(input) {
  const response = await fetch(`${baseUrl}/predictions`, {
    method: "POST",
    headers: {
      "Content-Type": "application/json",
      "x-api-market-key": apiKey
    },
    body: JSON.stringify({ version: "0a9c7c558af4c0f20667c1bd1260ce32a2879944a0b9e44e1398660c077b1550", input })
  });

  if (response.status !== 201) {
    throw new Error(`API error: ${response.status} ${await response.text()}`);
  }

  const prediction = await response.json();
  return pollForResults(prediction.id);
}

const delay = (ms) => new Promise((resolve) => setTimeout(resolve, ms));

async function pollForResults(predictionId) {
  const maxTimeout = 900000;
  const pollInterval = 2000;
  const startTime = Date.now();

  while (Date.now() - startTime < maxTimeout) {
    const response = await fetch(`${baseUrl}/predictions/${predictionId}`, {
      headers: { "x-api-market-key": apiKey }
    });

    if (!response.ok) {
      throw new Error(`API error: ${response.status} ${await response.text()}`);
    }

    const prediction = await response.json();

    if (prediction.status === "succeeded") {
      return prediction.output;
    }

    if (prediction.status === "failed" || prediction.status === "canceled") {
      throw new Error(`Prediction ${prediction.status}: ${prediction.error || "Unknown error"}`);
    }

    await delay(pollInterval);
  }

  throw new Error("Prediction timed out after 15 minutes");
}

createAndWaitForPrediction({
  protect: 0.33,
  rvc_model: "Squidward",
  index_rate: 0.5,
  song_input: "https://blog.api.market/wp-content/uploads/2026/10/realistic-voice-cloning-input-api-market.mp3",
  reverb_size: 0.15,
  pitch_change: "no-change",
  rms_mix_rate: 0.25,
  filter_radius: 3,
  output_format: "mp3",
  reverb_damping: 0.7,
  reverb_dryness: 0.8,
  reverb_wetness: 0.2,
  crepe_hop_length: 128,
  pitch_change_all: 0,
  main_vocals_volume_change: 10,
  pitch_detection_algorithm: "rmvpe",
  instrumental_volume_change: 0,
  backup_vocals_volume_change: 0
}).then((output) => console.log(output));
```

#### Python
```python
import time
import requests

API_KEY = "YOUR_API_MARKET_KEY"
BASE_URL = "https://prod.api.market/api/v1/magicapi/realistic-voice-cloning-zsxkib-realistic-voice-cloning"


def create_and_wait_for_prediction(input_data):
    headers = {"Content-Type": "application/json", "x-api-market-key": API_KEY}
    response = requests.post(
        f"{BASE_URL}/predictions",
        headers=headers,
        json={"version": "0a9c7c558af4c0f20667c1bd1260ce32a2879944a0b9e44e1398660c077b1550", "input": input_data},
    )

    if response.status_code != 201:
        raise Exception(f"API error: {response.status_code} {response.text}")

    return poll_for_results(response.json()["id"])


def poll_for_results(prediction_id):
    max_timeout = 900
    poll_interval = 2
    headers = {"x-api-market-key": API_KEY}
    start_time = time.time()

    while time.time() - start_time < max_timeout:
        response = requests.get(f"{BASE_URL}/predictions/{prediction_id}", headers=headers)

        if response.status_code != 200:
            raise Exception(f"API error: {response.status_code} {response.text}")

        prediction = response.json()

        if prediction["status"] == "succeeded":
            return prediction["output"]

        if prediction["status"] in ("failed", "canceled"):
            raise Exception(f"Prediction {prediction['status']}: {prediction.get('error') or 'Unknown error'}")

        time.sleep(poll_interval)

    raise Exception("Prediction timed out after 15 minutes")


print(create_and_wait_for_prediction({
    "protect": 0.33,
    "rvc_model": "Squidward",
    "index_rate": 0.5,
    "song_input": "https://blog.api.market/wp-content/uploads/2026/10/realistic-voice-cloning-input-api-market.mp3",
    "reverb_size": 0.15,
    "pitch_change": "no-change",
    "rms_mix_rate": 0.25,
    "filter_radius": 3,
    "output_format": "mp3",
    "reverb_damping": 0.7,
    "reverb_dryness": 0.8,
    "reverb_wetness": 0.2,
    "crepe_hop_length": 128,
    "pitch_change_all": 0,
    "main_vocals_volume_change": 10,
    "pitch_detection_algorithm": "rmvpe",
    "instrumental_volume_change": 0,
    "backup_vocals_volume_change": 0
}))
```

## FAQ
- **How do I use my own voice model?**
  - Put the download URL of your trained RVC v2 model in `custom_rvc_model_download_url`. It is used instead of `rvc_model`, which is set to the downloaded model's name automatically.
- **Can I clone any person's voice?**
  - Only use voices you have the rights and consent to use. Some built-in models are named after public figures; you are responsible for how you use and publish the results.
- **How do I change a male voice to a female one?**
  - Set `pitch_change` to `male-to-female` (or `female-to-male`). To shift the key of the whole song, use `pitch_change_all` in semitones.
- **The AI vocals are too quiet or too loud. What should I change?**
  - Adjust `main_vocals_volume_change` in decibels (the example used `10`). `backup_vocals_volume_change` and `instrumental_volume_change` change the other parts of the mix.
- **How much does one song cost?**
  - $0.055 for each request that processes in up to 220 seconds. The example took 71.20 seconds, so it cost one unit.
- **Is the 201 response from POST an error?**
  - No. 201 Created means the prediction was accepted. Use the returned `id` to poll GET `/predictions/{id}` until `status` is `succeeded`, `failed` or `canceled`.

## Contact Us
If you have any questions, reach out to us through the chat on the bottom right of the page. You can also email our support team at hello@magicapi.com.


Create AI song covers by converting a song's lead vocals to a built-in or custom RVC v2 voice, then mixing them back. Pay as you go, no monthly fee.