How to fastly upload files to Blob Storage

Jona 495 Reputation points
2025-01-07T18:02:48.7133333+00:00

Hi,

In have to automatically upload files to a Blob Storage, from a Virtual Server. I've heard about mounting a device of the virtual server directly to a container in a Storage Account, so I wonder which is faster:

  1. An onprem process stores files in the Virtual Server
  2. I can use the Copy Activy from ADF to upload de file to Blob Storage, or
  3. I can configure the mounting between the virtual server and Blob.

Can you give some guidance?

Regards

Jona

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,025 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,107 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Keshavulu Dasari 2,835 Reputation points Microsoft Vendor
    2025-01-07T18:31:25.7033333+00:00

    Hi Jona ,

    Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

    I Suggest few options for uploading files to Azure Blob Storage from a virtual server:

    1. On-Prem Process Storing Files in the Virtual Server

    Pros:

    • Direct control over the file storage process.
    • Can be integrated with existing on-premises infrastructure.

    Cons:

    • May require additional steps to transfer files from on-premises to the virtual server.
    • Potentially slower due to multiple transfer steps.

    2. Using Azure Data Factory (ADF) Copy Activity

    Pros:

    • Automated and scalable solution.
    • Supports various data sources and destinations.
    • Can handle large volumes of data efficiently.

    Cons:

    • Requires setting up and configuring ADF pipelines.
    • May incur additional costs for data movement and pipeline execution.

    3. Mounting the Virtual Server to Blob Storage

    Pros:

    • Direct and seamless integration between the virtual server and Blob Storage.
    • Simplifies the file transfer process.
    • Can be faster as it eliminates intermediate steps.

    Cons:

    • Requires proper configuration and permissions.
    • May have limitations based on the operating system and network setup.

    For Speed and Simplicity: Mounting the virtual server directly to Blob Storage is likely the fastest option as it reduces the number of steps involved in the file transfer process.

    For Scalability and Automation: Using Azure Data Factory's Copy Activity is a robust solution if you need to handle large volumes of data and automate the process.

    Alternative: Using AzCopy

    Another efficient method is using AzCopy, a command-line utility designed for copying data to and from Azure Blob Storage. It can be very fast and is suitable for both small and large data transfers.

    Pros:

    • Speed: Optimized for fast data transfers.
    • Flexibility: Can be used in scripts and automated workflows.
    • Cost-Effective: No additional costs beyond storage and data transfer.

    Cons:

    • Command-Line: Requires familiarity with command-line tools.

    For more information:

    https://zcusa.951200.xyz/en-us/azure/storage/blobs/storage-quickstart-blobs-portal

    https://techcommunity.microsoft.com/discussions/azuremigration/how-to-upload-files-to-azure-virtual-machine/1238246


    Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members. 
    User's image

    If you have any other questions or are still running into more issues, let me know in the "comments" and I would be happy to help you.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.