Automatic Data Loader

About the Automatic Data Loader Job

The Automatic Data Loader can load .xlsx files created with Microsoft Excel version 2007 and above or .zip files into the system from an on-premises installation of APM Connect.

Note: To be able to load data successfully using Automatic Data Loader, make sure that:
  • The file name length is not more than 100 characters.
  • The file path of the scan directory is not more than 150 characters from root.
  • The file name does not contain any special characters.
  • Data loader templates are followed for loading the data in excel files.

APM Connect must be installed on premises.

Predix Essentials provides a method to automatically load data into the system from correctly formatted .xlsx or a .zip file containing correctly formatted .csv files. You must place your data loader workbook in the correct directory for a successful data load.

The job monitors a configured load directory for the presence of a file in a subdirectory and stages the contents of the file into the system. Multiple files moved into the directory are processed in descending order according to the last modified time stamp on each file.

The system logs the staging progress and archives the files in an archive directory. If data fails to stage or upload, a message is written to the log indicating the reason for failure, and the source files are moved to the FAILED FILES directory.

A service then retrieves the staged workbooks, and, using an administrative account, the service invokes the appropriate data loader to load the data contained in the workbooks.