IBM Launches InfoSphere DataStage Balanced Optimizer – DataStage ELT

DataStage ELT is a big step forward for controlling the data integration SQL that gets executed in source and target databases. It brings what is known as ELT technology – the ability to extract data, load it and then transform it inside a database engine. That’s over simplifying it, to borrow a picture from my article the ability to run all or part of a DataStage job on a database engine opens up ETL, ELT, TELT, TLELT, TETLELTLELT. Whatever.

It runs stuff on a database and keeps the metadata mapping in the Metadata Server so you can report on it in the Metadata Workbench. Database code can be a metadata black hole. It’s hard to parse and report on source to target column mappings because different types of SQL syntaxes or complex PL/SQL code can be very hard to import into a metadata tool. And big database vendors like Oracle and Microsoft do not have metadata reporting solutions.