Microsoft Azure: Choosing Blob Storage vs Data Lake Store

-

In today’s post, I will like to talk about considerations for choosing to use Azure Blob Storage or Azure Data Lake Store when processing data to be loaded into a data warehouse. Here is a Data Warehouse Architecture published by Microsoft, where it suggests loading data from your source into Azure Blob Storage.
Pause for a second!!!

Ok, Let's continue!!!

So, here are my thoughts on why you may choose one over the other based on my experience in some projects. It really "depends".In most cases you can’t go wrong either way because they are both powerful storage systems.Let's go:

Firstly, Text files. ADLS is better with text files compared to ABS.When you talk about non-text data like media files,database backup files etc, are better off with ABS.There are trade-offs with both.

Secondly, Geographic redundancy. ABS gives you that out of the box. For ADLS,it requires setting a job to get it done periodically to replicate data geographically.

Thirdly, Security/Data access. ABS uses access key only for security. But ADLS supports Azure active directory and access key for security. Bottom line is, they are both secure, it’s just a matter of a different method of accessing it.

Fourthly, Analytics. ABS does not support Analytics. But ADLS does provide support for Analytics. Specifically Azure Data Lake Analytics.

Fifthly, Price. It varies really.ABS provides more options/flexibility for pricing related to data access. For ADLS, it might be more expensive sometimes depending on excess and volume options.

Either way, you can’t go wrong.It depends on what works best for you and your project. But i just wanted to give my thoughts on it. Again, just my thoughts. If you have any additional information based on your experience on using Azure Data Lake Store vs Azure Blob Storage, feel free to share.

If you still have questions or just want to chat about Tech stuff, contact me and i will be glad to help!.

Comments

  1. tradeimexinfoJuly 30, 2021 at 10:04 PM

    You've provided quite good information here about china export data. This is fantastic since it expands our knowledge and is also beneficial to us. Thank you for sharing this piece of writing.

    ReplyDelete
  2. Alia parkerSeptember 13, 2021 at 2:00 AM

    Fantastic write-up by the great author, it is really massive and insightful but still preaches the method to sounds like that it has some beautiful ideas explained so I really value this write-up. Bare metal data center

    ReplyDelete
  3. tradeimexinfoSeptember 21, 2021 at 6:31 PM

    Very well written article. It was an awesome article to read. Complete rich content and fully informative. I totally Loved it. Read more info about Import Data Philippines

    ReplyDelete
  4. Laura BushSeptember 27, 2021 at 6:01 AM

    Great Article about Buy Unboxed Mobiles Online. Thank you for providing such unique and valuable information to your readers. I really appreciate your work.

    ReplyDelete
  5. tradebordersNovember 22, 2021 at 12:22 PM

    You are providing good knowledge. It is really helpful and factual information for us and everyone to increase knowledge.about b2b Trade Marketplace. Continue sharing your data. Thank you.

    ReplyDelete
  6. Aaron jhonsonDecember 5, 2021 at 9:28 PM

    Excellent article... Thank you for providing such valuable information; the contents are quite intriguing.
    Data Engineering Services 
    Data Analytics Solutions
    Data Modernization Solutions
    AI & ML Service Provider

    ReplyDelete

Post a Comment

Popular posts from this blog

Python - GUI - Tkinter(Bar & Pie Chart)

-
Image
Quickly, i just want to show you a simple example of creating bar and pie chart with Tkinter . Try this simple example: import tkinter as tk root = tk.Tk() root.title("Tkinter Bar and Pie Graph") #here is for bar chart............ tk.Label(root, text='Bar Chart').pack() data = [21, 20, 19, 16, 14, 13, 11, 9, 4, 3] c_width = 400 c_height = 350 c = tk.Canvas(root, width=c_width, height=c_height, bg= 'white') c.pack() #experiment with the variables below size to fit your needs y_stretch = 15 y_gap = 20 x_stretch = 10 x_width = 20
Read more

Azure SQL, Cloud Migration and Modernization

-
Image
  What is Azure SQL? Azure SQL is a family of managed, secure, and intelligent products that use the SQL Server database engine in the Azure cloud. Azure SQL Database: Support modern cloud applications on an intelligent, managed database service, that includes serverless compute. Azure SQL Managed Instance : Modernize your existing SQL Server applications at scale with an intelligent fully managed instance as a service, with almost 100% feature parity with the SQL Server database engine. Best for most migrations to the cloud. SQL Server on Azure VMs: Lift-and-shift your SQL Server workloads with ease and maintain 100% SQL Server compatibility and operating system-level access. Azure SQL is built upon the familiar SQL Server engine, so you can migrate applications with ease and continue to use the tools, languages, and resources you're familiar with. Your skills and experience transfer to the cloud, so you can do even more with what you already have. What do you want to do? Suppor
Read more

Bringing Kubernetes to Windows Server apps(Google Cloud Platform)

-
Image
Firstly, before we begin. For those that don't already know. What is Google Kubernetes Engine ?: GKE is an enterprise-grade platform for containerized applications, including stateful and stateless, AI and ML, Linux and Windows, complex and simple web apps, API, and backend services. Leverage industry-first features like four-way auto-scaling and no-stress management. Optimize GPU and TPU provisioning, use integrated developer tools, and get multi-cluster support from SREs. Now that we know GKE, the purpose of this post is about running Windows Server apps as containers on Kubernetes, where you get many of the benefits that Linux applications have enjoyed for years. Running your Windows Server containers on GKE can also save you on licensing costs, as you can pack many Windows Server containers on each Windows node. In the beta release of Windows Server container support in GKE (version 1.16
Read more