Add-ons

Last updated: Apr-18-2024

Enhance your Digital Asset Management (DAM) capabilities with a range of add-ons, offering advanced features for managing, processing, and delivering your digital assets effectively. Some leverage advanced Cloudinary AI functionality, while others provide unique features from various vision and media processing partners. Seamlessly integrated into your DAM system, these add-ons offer tailored functionalities, simplifying your workflow.

Only administrators can register for and upgrade add-on plans, as well as configure them for application on upload via upload presets. For subscription and setup instructions, see Add-ons in the Admin Guides. After registration and setup, integrate them into your DAM workflow for improved digital asset management.

The following sections describe add-ons commonly used for DAM purposes.

Guidelines for all add-ons

  • To utilize any add-on, please contact your administrator, as only administrators can register for add-ons. For more information on add-on registration, see Registering to add-ons in the Admin Guide.

  • Most add-ons can be applied to assets on upload using an upload preset, which administrators can configure. An upload preset is a set of predefined options that streamline the upload process by automatically applying specified actions or configurations when uploading assets. For instructions on setting up add-ons as upload presets, see Applying add-ons using upload presets in the Admin Guide. Once configured, apply the upload preset as follows:

    • If the upload preset is set as one of the Media Library upload preset defaults, any asset uploaded from the Console (via the Upload button or by dragging and dropping files) will automatically undergo the add-on's specified action.
    • If not set as default, upload your assets by clicking the Upload button. In the Upload widget that opens, select the relevant preset within the Advanced options, then select the files to upload. (If the Upload Preset option in the Advanced options of the Media Library Upload Widget is hidden, contact support to enable it.)

      Upload widget with upload preset selection
  • When you apply upload presets, only assets you upload are affected, not existing assets. To apply an add-on to existing assets, do so within the Media Library, following the instructions below. In some cases, application within the Media Library can only be done one asset at a time. For large-scale application, consider applying the add-on programmatically using the explicit method of the Upload API or contact your Customer Success Manager for assistance.

Cloudinary AI Background Removal add-on

The Cloudinary AI Background Removal add-on combines a variety of deep-learning algorithms to recognize the primary foreground object(s) in an image and accurately remove the background in a matter of seconds.

Contact your administrator to register for the Cloudinary AI Background Removal add-on and optionally set up an upload preset. For instructions, see Registering for add-ons.

To apply the add-on during upload:

  1. Apply the upload preset configured by your administrator using the Upload widget. If the upload preset is a Media Library default, the add-on will be applied on upload automatically. For more information, see Guidelines for all add-ons.

  2. View the new asset in the Media Library to verify that it was uploaded with its background removed.

To apply Cloudinary AI Background Removal to existing assets within the Media Library:

Remove image backgrounds using the Background option within Studio, one or more assets at a time.

Background removal in Studio

Learn more
For more information on the Cloudinary AI Background Removal add-on including how to apply it programmatically, see Cloudinary AI Background Removal.

Pixelz - Remove the Background

Pixelz is a leading vendor of image editing solution components, including powerful background removal of photos, done by a team of human experts. Cloudinary provides a Remove-The-Background add-on for using Pixelz's image editing capabilities, fully integrated into Cloudinary's image management and transformation pipeline.

With the Pixelz - Remove the Background add-on, you can extend Cloudinary's image transformation capabilities with automatic background removal from your photos, resulting in a transparent-background image focusing on the main object of your photo.

Contact your administrator to register for the Pixelz - Remove the Background add-on and optionally set up an upload preset. For instructions, see Add-ons in the Admin Guides.

To apply the add-on during upload:

  1. Apply the upload preset configured by your administrator using the Upload widget. If the upload preset is a Media Library default, the add-on will be applied on upload automatically. For instructions, see Guidelines for all add-ons.
  2. View the new asset in the Media Library to verify that it was uploaded with its background removed.

Note
Currently, there isn't a method to apply this add-on to existing assets within the Media Library.

Learn more
For more information on the Pixelz - Remove the Background add-on including how to apply it programmatically, see Pixelz - Remove the Background.

Cloudinary AI Content Analysis

The Cloudinary AI Content Analysis add-on utilizes AI-based object detection and content-aware algorithms to offer image captioning suggestions based on to the image's contents.

Contact your administrator to register for the Cloudinary AI Content Analysis add-on and optionally set up an upload preset. For instructions, see Registering for add-ons.

To apply the add-on during upload:

  1. Apply the upload preset configured by your administrator using the Upload widget. If the upload preset is a Media Library default, the add-on will be applied on upload automatically. For more information, see Guidelines for all add-ons.
  2. In the Metadata tab of the asset management drill-down page, verify the auto-generated caption under the Title (caption) key in the Contextual metadata section and the autocaption value in the Tags section.

    Verify the caption in the Metadata tab of the asset management drill-down page

Note
Currently, there isn't a method to apply this add-on on existing assets within the Media Library.

Learn more
For more information on the Cloudinary AI Content Analysis add-on including how to apply it programmatically, see Cloudinary AI Content Analysis.

Google Auto Tagging

The Google Auto Tagging add-on automates the process of categorizing and tagging images by analyzing image data. This saves significant time and resources compared to manual tagging efforts. The analysis continuously improves over time, enhancing accuracy with the introduction of new concepts.

Contact your administrator to register for the Google Auto Tagging add-on and optionally set up an upload preset. For instructions, see Add-ons in the Admin Guides.

To apply the add-on during upload:

  1. Apply the upload preset configured by your administrator using the Upload widget. If the upload preset is a Media Library default, the add-on will be applied on upload automatically. For more information, see Guidelines for all add-ons.

  2. In the Metadata tab of the asset management drill-down page, verify the auto-generated tags under the Tags section.

    Check auto-tagging in the Metadata tab of the asset management drill-down page

To apply Google Auto Tagging to existing assets within the Media Library one at a time:

  1. Select the asset in the Media Library and then navigate to the Analysis tab in the asset management drill-down page.
  2. In the Auto-tagging section, select the Minimum confidence score of a detected category that should be suggested as a tag.
  3. Select Google Vision from the drop-down.
  4. Click Run now. A list of suggested tags is displayed.
  5. Take a look at the suggested tags. If they seem good, select the Add all tags... option from the (3-dots) options menu next to the Minimum confidence slider.

    Apply auto-tagging in the Analysis tab of the asset management drill-down page
  6. View the auto-generated tags under the Tags section in the Metadata tab of the asset management drill-down page.

Learn more
For more information on the Google Auto Tagging add-on including how to apply it programmatically, see Google Auto Tagging.

Amazon Rekognition Auto Tagging

The Amazon Rekognition Auto Tagging add-on automates the process of categorizing and tagging images by analyzing image data. This saves significant time and resources compared to manual tagging efforts. The analysis continuously improves over time, enhancing accuracy with the introduction of new concepts.

Contact your administrator to register for the Amazon Rekognition Auto Tagging add-on and optionally set up an upload preset. For instructions, see Add-ons in the Admin Guides.

To apply the add-on during upload:

  1. Apply the upload preset configured by your administrator using the Upload widget. If the upload preset is a Media Library default, the add-on will be applied on upload automatically. For instructions, see Guidelines for all add-ons.

  2. View the auto-generated tags under the Tags section in the Metadata tab of the asset management drill-down page.

    Check auto-tagging in the Metadata tab of the asset management drill-down page

To apply Amazon Rekognition Auto Tagging to existing assets within the Media Library one at a time:

  1. Select the asset in the Media Library and then navigate to the Analysis tab in the asset management drill-down page.

    Apply auto-tagging in the Analysis tab of the asset management drill-down page
  2. In the Auto-tagging section, select the Minimum confidence score of a detected category that should be suggested as a tag.
  3. Select Amazon Rekognition from the drop-down.
  4. Click Run now. A list of suggested tags is displayed.
  5. Take a look at the suggested tags. If they seem good, select the Add all tags... option from the (3-dots) options menu next to the Minimum confidence slider.
  6. View the auto-generated tags under the Tags section in the Metadata tab of the asset management drill-down page.

    Check auto-tagging in the Metadata tab of the asset management drill-down page

Learn more
For more information on the Amazon Rekognition Auto Tagging add-on including how to apply it programmatically, see Amazon Rekognition Auto Tagging.

OCR Text Detection and Extraction

The OCR Text Detection and Extraction add-on extracts all identified texts from images, including multi-page documents like TIFFs and PDFs. Upon activation through an upload preset or within the Analysis tab of asset management drill-down page, you can access and review all of the detected texts in the Analysis tab.

Contact your administrator to register for the OCR Text Detection and Extraction add-on and optionally set up an upload preset. For instructions, see Add-ons in the Admin Guides.

To apply the add-on during upload:

  1. Apply the upload preset configured by your administrator using the Upload widget. If the upload preset is a Media Library default, the add-on will be applied on upload automatically. For instructions, see Guidelines for all add-ons.

  2. View the extracted texts in the OCR Optical Character Recognition section in the Analysis tab of the asset management drill-down page. Hover over each text to see it highlighted in the image.

    Check extracted texts in the Analysis tab of the asset management drill-down page

To apply OCR Text Detection and Extraction to existing assets within the Media Library one at a time:

  1. Select the asset in the Media Library and then navigate to the Analysis tab in the asset management drill-down page.

    Apply text extraction in the Analysis tab of the asset management drill-down page
  2. In the OCR Optical Character Recognition section, click Run now. The extracted texts are displayed.
  3. Hover over each extracted text to see it highlighted in the image.

Learn more
For more information on the OCR Text Detection and Extraction add-on including how to apply it programmatically, see OCR Text Detection and Extraction.

✔️ Feedback sent!

Rate this page: