Overview of the Historian Extract, Transform, and Load (ETL) Tools
Transferring data from one Historian server to another is typically performed by Proficy Historian collectors. These collectors provide a connected streaming data transfer mechanism (except the calculation and file transfer collectors). In a system where a steady network connection is not possible or not cost-effective, a periodic file-oriented data transfer is preferred. The Historian ETL tools consist of a comprehensive set of file-oriented data extraction, transfer, and loading tools.
Potential ways of using ETL tools:
- Data transfer via radio or low bandwidth cellular connection
- Data transfer where there is no connectivity (read and write using portable media)
- Data transfer for periodic connectivity applications (for example, ships can transfer data when they arrive at a port)
- Data migration from OSI PI Server to Proficy Historian
- Data extraction to import into other applications
- Data import from other applications
Components of Historian ETL:
- Extract: Using this tool, you can extract time series data from Proficy Historian or PI Server. For Proficy Historian, you can also extract alarms and events data, perform scaling and absolute deadband compression.
- Transform: Using this tool, you can transfer data from an onsite Historian server to the destination Historian server using a file-sharing application such as FTP, BITS, and so on.
- Load: Using this tool, you can load data into Proficy Historian. This tool monitors a file directory, unzips the files, and processes them.