IIEP - Configure Asset Importer Processing Engine

When using an Asset Importer endpoint, it is necessary to specify an asset importer configuration and define how the imported content will be received.

Prerequisites

The following settings are important when using this processing engine:

On the Choose Receiver step, the 'Hotfolder Receiver' option must be selected as defined in the IIEP - Choose Receiver topic here.
If desired, folder overrides can also be configured, allowing users to replace certain aspects of the asset import configuration for sub folders within the top-level hotfolder. For required configuration, refer to the Asset Importer Configuration section of the Asset Importer documentation here.

Note: Note that if you attempt to change the asset importer configuration after configuring overrides, a prompt will appear warning you that the overrides will be removed.

Configuration

In the Asset Importer Configuration parameter, click the ellipsis button () and select an asset importer configuration from the node list. Click Select.
In the Handle content as parameter, define how files will be delivered to the asset importer by selecting the appropriate receiver option from the dropdown. The options include:

Files - This option should be used when importing single asset files into STEP. No additional parameters are required.

Metafile - This option should be used when a metadata file is necessary to supply information related to the assets, which may be the case if the assets and meta file reside in different locations. By configuring this parameter, users can point imported metadata files to related assets that are about to be imported or updated (via a path accessible by the STEP application server process). Refer to the Metadata File Format section below.

While importing the assets using the metafile, note the following required locations for the files:

Assets are placed in the default hotfolder root (not the configured asset hotfolder). For example, while adding assets on the application server, the path will be \[hotfolder for Windows system] or /upload/[hotfolder for Linux system].
Metafile (the .txt file) is placed in the [configured asset folder]/IN directory.

The Metafile Error Handling parameter determines how the errors are handled. Options include: 'Don't report inconsistencies,' 'Report missing files,' and 'Report all inconsistencies.' The default selection, 'Report missing files', should be selected if errors should be reported when the metafile references assets which cannot be found. 'Don't report inconsistencies' should be selected if inconsistencies between the metafile references and the assets found should not be reported as errors. This means that 'Report all inconsistencies' should be selected if any and all inconsistencies between the metafile references and the assets should be reported as errors.

In the Asset File Column Header parameter, specify the column heading of the metafile that contains the asset information. This includes an asset name; an external URL; or a relative path if the corresponding asset is in a subfolder below the root hotfolder directory. For example, 'Supplier1/Asset.jpg' corresponds to the asset name 'Asset.jpg' found within the 'Supplier1' subfolder.

Note: Importing assets from URLs may increase the import time. Only freely accessible assets can be imported from URLs, entering a password is not allowed.

In the Column Delimiter parameter, specify which character is used to separate the columns in the metadata file. The default value is a comma (,) due to backward compatibility, but it is recommended to use either a semicolon or a pipe character, which is less likely to be included in any metadata fields.

Check the Allow Create Asset Without Content parameter to create an asset placeholder when no content is available to the importer. This can happen when STEP cannot access the asset (i.e., due to an incorrect file name or blocked access to the URL). The asset is created and referenced as configured, the thumbnail shows 'No Content' instead of an image. Update the image via subsequent imports of the same asset using the 'Asset Content Replace' checkbox in the Content Importer here.

Zip File - This option should be used when importing zip files that only contain assets. The file is unpacked during the import process and all containing asset files are imported according to the remaining configuration options. No additional parameters are required.

ZIP Metafile - This option should be used when importing a .ZIP file that contains both the metadata file and the corresponding asset files. When importing with this configuration, asset placeholders are created from the metafile, and assets are subsequently loaded into STEP to update the placeholder content. Refer to the Metadata File Format section below.

In the Name of the metafile within ZIP file parameter, indicate the file name of the metafile so the system can distinguish between it and the asset files. Valid file formats are .CSV and .txt.

The Metafile Error Handling parameter determines how the errors are handled. Options include: 'Don't report inconsistencies', 'Report missing files', and 'Report all inconsistencies.' The default selection, 'Report missing files', should be selected if errors should be reported when the metafile references assets which cannot be found. 'Don't report inconsistencies' should be selected if inconsistencies between the metafile references and the assets found should not be reported as errors. Naturally this means that 'Report all inconsistencies' should be selected if any and all inconsistencies between the metafile references and the assets should be reported as errors.

Note: Importing assets from URLs may increase the import time. Only freely accessible assets can be imported from URLs, entering a password is not allowed.

In the Column Delimiter parameter, specify which character should be used to separate each of the columns in the metadata file. The default value is a comma (,) due to backward compatibility, but it is recommended to use either a semicolon or a pipe character, which is less likely to be included in any metadata fields.

In the Override configuration options for subfolders area of the wizard, click the Add Folder Override link to add an override to the existing configuration. This will add a row to the override screen, in which an individual configuration aspect can be specified.

Note: This option is not available when using the FAB-DIS Importer processing engine.

In the Folder field, specify a subfolder to override. If only one configuration difference is required between the parent and child folder, only a single configuration (row) is needed for each subfolder. However, if more than one configuration difference exists between the parent and child, each difference requires an individual row to be added (with the Folder name shared between multiple rows).
In the Configuration Step dropdown, choose which aspect of the configuration you want to override. Almost every step in the Asset Importer configuration wizard is available for override, including: Content Importer, Import Validator, Hierarchy Builder, Asset Matcher, Product Linker, Approver, Business Rules, Metadata Importer, and Workflow Handler. The Configuration Step selection determines the dialog displayed by the Override parameters button (below).
In the Configuration field, click the Override parameters button and make any of the necessary changes in the screen that appears and click OK. The parameters presented are based on the Configuration Step selection.
Additional options are available by clicking the arrow in the first column of the override configuration options table. This displays a menu with options including Add Folder Override and Remove Folder Override.

By properly utilizing override subfolders, a single asset importer configuration can be used to control an entire hierarchy of hotfolders. All subfolders will inherit the asset importer configuration as normal, but those configured in this way can override specific aspects of the base configuration, allowing for flexibility within a single asset importer configuration.

For example, different subfolders may be associated with different MIME Types (such as JPEG, TIFF, etc.). As part of the override configuration pictured above, this use case is addressed by overriding the 'Import Validator' step of the importer configuration and changing the 'MIME Type' parameter to '/jpeg.'

Click the Next button to display IIEP - Schedule Endpoint here.

Metadata File Format

By configuring an IIEP with the Metafile or ZIP Metafile receiver options, the asset importer is able to process user-defined metadata files. To import such a file, a header row must be included in the imported file or the metadata file to be imported, and values must be provided for each column that references each asset.

The standard metafile configuration options described in the above section allow for a maximum of three data fields to be read from the file. However, if the 'Metadata Importer' is configured, the asset importer configuration can support additional columns, each representing an asset metadata attribute value to be imported. Information included in the file but that is not mapped in the metadata importer is ignored.

For more information on the Metadata Importer, refer to the Metadata Importer section of the Asset Importer documentation here.

Each of the standard fields is described below:

File Name Field: Used in the Metafile and ZIP Metafile receiver selections to identify the file name of the asset. This field is required in each metafile as it correlates the actual asset files to the content in the metafile.

Match Metadata Field: Used in the Metadata Product Linker configuration to specify the value for the product match criteria.
Reference Type Metadata Field: Used in the Metadata Product Linker configuration to specify the STEP ID of the reference that will be used to link the asset and the product.

For more information on the Product Linker, refer to the Product Linker section of the Asset Importer documentation here

Examples

Including metadata info to import (Metadata Importer):

Filename;Product;Reference;Title;Photographer;PhotoCategory
1234.jpg;Item-12345;PrimaryImage;Glacier Bay Alaska;Peter Parker;Landscapes

Using a relative path (Metafile Receiver)

Filename;Product;Reference
Supplier1/1234.jpg;Item-12345;PrimaryImage

Multiple lines of the same asset to create multiple product references

Filename;Product;Reference
1234.jpg;Item-12345;PrimaryImage
1234.jpg;Item-67890;PrimaryImage