Dynamic Ingest API: Best Practices

Introduction

The Dynamic Ingest API is powerful and flexible, but to use it most effectively, you need to follow some best practices, which are detailed below.

Best practices

Below are rules and guidelines for Dynamic Ingest.

• The profile field for ingest requests is optional. Avoid hard-coding the profile in apps and integrations - instead, set the most commonly used profile as the default for the account, and omit the field, or fetch the available profiles for the account and force the user to choose one.
• No more than 10 requests per minute on the same video are allowed.
• You should not have duplicate jobs processing for the same video, though ingesting other assets such as images and text tracks along with the video in the same job is fine.

  if you are using an automated process for creating ingestion jobs that could potentially create multiple jobs on the same video ID, you need to check notifications to ensure that there are no other jobs processing on the same video before creating a new one.

• A 20 request-per-second limit on each account for total requests across Dynamic Ingest and the CMS API.
• Normal priority supports up to 200 concurrent jobs per account, after this quota is reached the system will queue the request up to 10,000. After that a new request will be rejected. The system constantly is validating concurrent jobs and is moving jobs from the queue to concurrent.
• Low priority supports up to 1,000 concurrent jobs per account, after this quota is reached the system will queue the request up to 20,000. After that a new request will be rejected. One thing to keep on mind is low priority could take longer to be completed.
• If you are ingesting large batches of files, consider using the Low Priority queue which will allow you to queue up to 20,000 jobs.
• Ingest content is normally limited to 100GBs per file (if you need to ingest larger files please contact your Customer Success Manager).
• If you are ingesting files in batches, limit concurrent normal priority jobs to 100 and wait for one job to complete processing before adding another - see Fallback / Retry Strategy for more information. Alternatively, you can set the "priority": "low" - using low priority, you do not have to worry about the size of your ingest queue, though processing may take a little longer.
• Validate ingest profile changes to ensure you are getting the results you want before ingesting full batches.

Mass ingestion/migration

If you are migrating videos to Video Cloud from another platform, or just have a large number of videos you need to ingest, let us help you make the process smooth by following these guidelines:

• Open a Support ticket at least 3 days in advance indicating that you are planning to start ingesting a large amount of assets.
• Provide a timeline of when you expect to start and finish.
• Indicate which ingestion method are you planning to use: API, MRSS, Aspera (with our without XML manifest).
• Indicate the total number of videos you will ingest.
• Indicate the average video file size.
• Indicate the average video duration (minutes).
• Indicate the region where you content is located.