Microsoft has released a new ETL type service for processing big data called Azure Data Factory. Like a traditional ETL engine, this data processing factory is designed for orchestrating incoming data sources and processing them into new data models.
The Azure Data Factory though is designed for hyper scale, is cloud based, and can orchestrate multiple types of data including on premises SQL Server, Azure SQL, Azure Blob and Azure Table. You can use multiple processing languages such as Hive, Pig or C#.
Azure Data Factory also supports data lineage tracking for pinpointing issues with your transformations and data dependencies.
