http://wiki.cloveretl.org/ 2008-11-20T11:47:46+01:00 http://wiki.cloveretl.org/ http://wiki.cloveretl.org/lib/images/favicon.ico text/html 2008-11-19T14:33:32+01:00 Initiate Systems http://wiki.cloveretl.org/doku.php?id=navigation&rev=1227101612&do=diff ---------- CloverETL Tool ---------- Transformation graph Running & debugging ---------- * Components * Connections * Edges * Lookup tables * Metadata * Properties * Sequences ---------- * Readers * Writers * Transformers * Joiners * Bulk loaders * Others text/html 2008-11-14T15:49:54+01:00 Tomas Waller http://wiki.cloveretl.org/doku.php?id=components:bulkloaders:mssql_data_writer&rev=1226674194&do=diff This component loads data to MsSql database using the bcp utility. It is faster then DBOutputTable. Load formats data pages directly, while avoiding most of the overhead of individual row processing that inserts incur. There is created bcp command depending on input parameters. Data are read from given input file or from the input port and loaded to database. text/html 2008-11-14T10:30:50+01:00 Pavel Najvar http://wiki.cloveretl.org/doku.php?id=components:transformers&rev=1226655050&do=diff Transformers are components of graph that transform data from one or more input ports to output port. Most of transformers use transform function or key or some other method that defines particular data transformation. Note: For characters that are impossible to enter directly, there are several escape sequences: \\, \n, \t, \r, \”, \f, \b. So be careful when using “\” character, eg. parameter filterExpression=“$Field1~="([^\\|]*\\|){3}"” will be interpreted as “$Field1~=… text/html 2008-11-13T15:11:51+01:00 Tomas Waller http://wiki.cloveretl.org/doku.php?id=transf_lang_functions&rev=1226585511&do=diff Listed below are all Clover ETL TL language functions which are part of the standard release. Convertion functions base64byte (since 2.4) Converts string containing BASE64 encoded data into binary representation - bytearray. bytearray base64byte(string src); text/html 2008-11-12T17:22:09+01:00 Tomas Waller http://wiki.cloveretl.org/doku.php?id=examples_index&rev=1226506929&do=diff To download example package go to download page. Index of all examples graphAggregateSorted.grf This graph illustrates usage of Aggregate component. graphAggregateUnsorted.grf This graph illustrates usage of Aggregate component. graphAproximativeJoin.grf In this example data are read from from file customers0.dat and from database table employee; then for both flows there is generated matching key consisting of 4 letters of last name (flat file: lname, database: last_name) and 3 letters o… text/html 2008-11-12T17:19:29+01:00 Tomas Waller http://wiki.cloveretl.org/doku.php?id=complex_examples&rev=1226506769&do=diff To download example package go to download page. Complex examples This examples combines several components to perform useful transformation similar to one you could use in a real life. Join example This graphs combines information about orders made and information about individual items/products purchased within each order. It also adds information about which customer ordered the goods. To get all this information, it needs to join data from ORDERS.DBF (a dBase table) ODETAILS.DBF and Cu… text/html 2008-11-12T16:43:50+01:00 Tomas Waller http://wiki.cloveretl.org/doku.php?id=components:writers&rev=1226504630&do=diff Writers are terminated components of graph that writes data to output source. The source can be for example a file placed on local disk, ftp, ldap, jms or database tables, etc. Graph must contain at least one of these components or more. ---------- text/html 2008-11-12T16:41:19+01:00 Tomas Waller http://wiki.cloveretl.org/doku.php?id=components:joiners&rev=1226504479&do=diff Joiners are components of graph that join data from all connected input ports based on defined key and propagate the result to output port. Transformations In either of these components, you must define some transformation using the transform() function. In addition to this required function, you can define other two functions: init() and finished(). If you want to declare and initialize some variables, if you want to anything what should be done at the beginning of data processing … text/html 2008-11-12T16:24:39+01:00 Tomas Waller http://wiki.cloveretl.org/doku.php?id=components:readers&rev=1226503479&do=diff Readers are initial components of graph that reads data from input source. The source can be for example a file placed on local disk, ftp, ldap, jms or database tables, etc. Graph must contain at least one of these components or more. ---------- text/html 2008-11-11T14:30:09+01:00 Martin Janik http://wiki.cloveretl.org/doku.php?id=graph_elements:lookups&rev=1226410209&do=diff Lookup tables contain data records that are searched. There are five variants of lookup tables currently supported: * SimpleLookup - complete lookup table stored in memory, data is read from external text file. * DBLookup - lookup table base on parametrized SQL query. Results can be cached in memory to limit access to database. * RangeLookup - elements of lookup are “intervals”: each interval has start and end point(s). * PersistentLookup - complete lookup table stored in external… text/html 2008-11-11T12:22:42+01:00 David Pavlis http://wiki.cloveretl.org/doku.php?id=start&rev=1226402562&do=diff CloverETL is a Java based ETL framework which can be used to transform structured data, and to some degree free-form data. Its complete platform independence is achieved by the exclusive use of Java technology. It can be used standalone as an application launched from a command line or can be embedded into your own application. CloverETL is released under the LGPL license.