Microsoft Azure: Choosing Blob Storage vs Data Lake Store
In today’s post, I will like to talk about considerations for choosing to use Azure Blob Storage or Azure Data Lake Store when processing data to be loaded into a data warehouse. Here is a Data Warehouse Architecture published by Microsoft, where it suggests loading data from your source into Azure Blob Storage. Pause for a second!!! Ok, Let's continue!!! So, here are my thoughts on why you may choose one over the other based on my experience in some projects. It really "depends".In most cases you can’t go wrong either way because they are both powerful storage systems.Let's go: Firstly, Text files. ADLS is better with text files compared to ABS.When you talk about non-text data like media files,database backup files etc, are better off with ABS.There are trade-offs with both. Secondly, Geographic redundancy. ABS gives you that out of the box. For ADLS,i