CloverETL is a Java based ETL framework which can be used to transform structured data, and to some degree free-form data. Its complete platform independence is achieved by the exclusive use of Java technology. It can be used standalone as an application launched from a command line or can be embedded into your own application. CloverETL is released under the LGPL license.
CloverETL is accompanied by CloverGUI - visual transformations designer which is integrated with Eclipse platform.
CloverETL overview
Features highlight
internal 16-bit (Unicode) representation of all character data - any character from any codepage can be represented
converts data from & to common character sets (
ASCII, UTF-8,
ISO-8859-1,
ISO-8859-2, etc)
works with delimited or fix-length data files, each field can have different delimiter composed from several characters, supports reading/writing XLS (
MS Excel) files
data records are internally handled as a variable-length data structures - can handle very large records ( much larger than common databases)
fields can have default values, handles/checks exist for NULL values
cooperates with any database for which a JDBC driver exists, natively supports Oracle, MySQL; Also supported are file-based databases like dBase & FoxPro & FlashFiler.
contains connectors to other systems through standard protocols like JMS, LDAP,
SOAP
data transformations are performed by independent components, each running as an independent thread - can utilize more than one CPU (is very scalable)
framework implements so called pipeline-parallelism - when a data record is processed by a component, it is immediately sent to the next component for additional processing.
-
transformations (mappings) of data can be also coded directly in Java
contains palette of more than 35 specialized components
metadata describing structure of data files (records) and transformation graphs can be read/written from/to
XML
can be easily embedded into other applications (App. servers, etc.) as a Java library
The whole framework is composed from mostly independent pieces which can be re-used in other applications. (modules for sorting, joining data, etc.)
Contact
Let us know (at info <at> cloveretl.org ) of any ideas, comments or suggestions you may have. If you are interested in participating on this project, please don't hesitate to contact us!
Back to top