Skip to main content

Extractor DPUs

Abstract

Extractor DPUs

Extractors establish the integration with external data sources.

A data processing pipeline usually starts with extractors, because the first step is to retrieve the input data to be processed afterwards. Such type of DPUs produce at least one data outputs to other DPUs. They usually do not accept data inputs from other DPUs though, because they should retrieve data from external systems based on the configuration. However, they can accept configuration input to consume dynamic configurations generated by other DPUs at runtime.

PoolParty UnifiedViews provides DPUs to fetch data from file systems, HTTP API endpoints, SQL and SPARQL endpoints, and more.

Please refer to the respective topics for detailed descriptions: