Azure resource type - microsoft.datalakestore/accounts

Nagesh CL 686 Reputation points
2023-07-11T10:32:56.07+00:00

Hi Team,

There is a azure resource type - "microsoft.datalakestore/accounts"

What exactly are these resources?

How is it different from the storage accounts (microsoft.storage/storageaccounts)?

Thanks.

Regards,

Nagesh CL

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,491 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,512 Reputation points Microsoft Employee
    2023-07-19T20:12:47.91+00:00

    @Nagesh CL Thanks for using Microsoft Q&A forum and posting your query.

    Azure resource type - microsoft.datalakestore/accounts refers to Azure Data lake storage Gen1 accounts. Where as microsoft.storage/storageaccounts are general purpose Azure storage accounts including Azure Data Lake Storage Gen2 (nothing but Azure Storage accounts with Hierarchical Namespace enabled).

    • Gen1 is more standalone, with data access and management primarily occurring through the Azure portal or through APIs. Gen2, on the other hand, is fully integrated with Azure Blob Storage and Azure Data Lake Analytics, and also offers tight integration with Azure Synapse Analytics (formerly SQL Data Warehouse) and Azure HDInsight.
    • ADLS Gen1 can be accessed from Hadoop using the WebHDFS-compatible REST APIs. ADLS Gen2 is designed for big data analytics which means there is something called azure blob file system or ABFS which is encrypted.
    • Gen2 is a superset of Gen1 plus all of the best parts of blob storage: tiers, HDFS and object store API's .

    Here are couple of MS documents that may be helpful to give a better understanding of the difference between Azure Storage accounts and how to choose them:

    1. Comparing Azure Data Lake Storage Gen1 and Azure Blob Storage
    2. Architecture guide - Select storage tools and services to support your workloads.
    3. Article by a community member - Azure Data Lake Or ADLS Gen1 vs Gen2 | 2023

    NOTE: Please note that On Feb 29, 2024 Azure Data Lake Storage Gen1 will be retired. For more information, see the official announcement. If you use Azure Data Lake Storage Gen1, make sure to migrate to Azure Data Lake Storage Gen2 prior to that date. To learn how, see Migrate Azure Data Lake Storage from Gen1 to Gen2 by using the Azure portal.

    Unless you already have an Azure Data Lake Storage Gen1 account, you cannot create new ones.

    Hope this info helps. Let me know if you have any questions.


    Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

    1 person found this answer helpful.

  2. Basil Damra 155 Reputation points
    2023-07-11T12:42:06.5+00:00

    Azure Data Lake Storage Gen2 is a set of capabilities dedicated to big data analytics, built on Azure Blob Storage.

    Data Lake Storage Gen2 converges the capabilities of Azure Data Lake Storage Gen1 with Azure Blob Storage. For example, Data Lake Storage Gen2 provides file system semantics, file-level security, and scale. Because these capabilities are built on Blob storage, you also get low-cost, tiered storage, with high availability/disaster recovery capabilities.

    Data Lake Storage Gen2 makes Azure Storage the foundation for building enterprise data lakes on Azure. Designed from the start to service multiple petabytes of information while sustaining hundreds of gigabits of throughput, Data Lake Storage Gen2 allows you to easily manage massive amounts of data.

    Read More: https://zcusa.951200.xyz/en-us/azure/storage/blobs/data-lake-storage-introduction

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.