Abstrakt
The data chunking extension to LinkedPipes ETL comprises a set of reusable components and a new technique of passing data among them. It allows the users to process large datasets split into smaller parts, which are then processed individually by the data processing pipelines.
The extension therefore saves time to process large datasets as well as the memory requirements.