LipSync

POSThttps://api.newportai.com/api/async/lipsync

The "Talking Face" API has been renamed to the "LipSync" API to more accurately reflect its core functionality. All features and endpoints remain unchanged, and existing integrations will continue to function as expected.

The LipSync API generates a talking avatar from audio and video inputs. The resulting avatar mirrors the facial expressions and vocal tone of a real person while providing support for multiple languages.

  • Submit a POST request to the LipSync API to obtain a taskId.
  • Submit a POST request to the Polling API to retrieve the LipSync results.
  • Configure a Callback URL to receive results automatically on completion.

Request Headers

Content-Type string Required

Enum: application/json

Authorization string Required

Bearer authentication token. Example: Bearer {{APIKey}}.

Request Body

vocalAudioUrl string

The URL of the vocal audio file.

srcVideoUrl string Required

The URL of the source video.

audioUrl string Required

The URL of the original audio. If the billing duration cannot be determined from this file, the task will fail.

videoParams object
video_width integer Required

Specifies the width of the output video. If set to 0, the output will maintain the source video's width.

video_height integer Required

Specifies the height of the output video. If set to 0, the output will maintain the source video's height.

video_enhance integer Required

Enables facial clarity and sharpness enhancement: 0 for disabled, 1 for enabled.

fps stringOptional

Specifies the frame rate (Default: 25 fps). Use "original" to match the input video(capped at 60 fps).
Billing: If set to "original", the cost scales from the base 1 credits/s to: (input FPS / 25) * 1 credits/s.

Response

code integer

Returns 0 for success, or a specific error code.

message string

Returns "success" or a descriptive error message.

data object
taskId string

The unique identifier for the task. Use this ID with the Polling API to retrieve the generated output.

Errors

10192Illegal param

Polling

Use the Polling API to retrieve the processing results.

Callback

Alternatively, you can enable Callback to receive task results automatically upon completion.

0Task Completed
{
  "code": 0,
  "message": "success",
  "data": {
    "task": {
      "taskId": "b08337dc08d7428daa64b3d5e61b8350",
      "status": 3,
    },
    "videos" : [{
        "videoUrl": "https://dreamface-resource-aigc.oss-us-east-1.aliyuncs.com/apiDocsAdmin/2025-4-1744793368637-talkface_result.mp4",
         "videoType":"mp4"
    }]
  }
}
Request
cURL
curl -X POST 'https://api.newportai.com/api/async/lipsync' \
  -H 'Content-Type: application/json' \
  -H "Authorization: Bearer {{key}}" \
  -d '{
  "srcVideoUrl": "https://d2t5pyzt5qvy2d.cloudfront.net/api/static_resource/prod/default/mq0MSmKgPGQQsxS9UovqH.mp4",
  "audioUrl": "https://d2t5pyzt5qvy2d.cloudfront.net/api/static_resource/prod/default/AoOVLxqINsl1dTAAhnmAW.wav",
  "videoParams": {
    "video_width": 1920,
    "video_height": 1080,
    "video_enhance": 1
  }
}'
0Successful
{
    "code":0,
    "message":"success",
    "data":{
        "taskId":"b08337dc08d7428daa64b3d5e61b8350"
    }
}