Share via

When will Apache Spark 3.4 Azure be available for Synapse Runtime?

Amit Amola 0 Reputation points Microsoft Employee
2025-01-13T11:37:42.2666667+00:00

Our Data Science team at Identity Microsoft Dublin, Ireland, primarily uses Azure Synapse. With support for Apache Spark 3.3 ending in March, we need to migrate our jobs to version 3.4. Previously, we upgraded directly from 3.1 to 3.3 as it was available at that time. Could you provide the timeline for Spark 3.5 support in Synapse Runtime? If it becomes available before the 3.4 migration deadline, it would be beneficial for us to upgrade directly to 3.5.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,121 questions
0 comments

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Shikha Ghildiyal 1,855 Reputation points Microsoft Employee
    2025-01-13T11:56:39.5333333+00:00

    Hi Amit Amola,

    Thanks for reaching out to Microsoft Q&A.

    Latest version is 3.4 for now.

    The following table lists the runtime name, Apache Spark version, and release date for supported Azure Synapse Runtime releases.

    Runtime name Release date Release stage End of Support announcement date End of Support effective date
    Azure Synapse Runtime for Apache Spark 3.4 Nov 21, 2023 GA (as of Apr 8, 2024) Q2 2025 Q1 2026
    Azure Synapse Runtime for Apache Spark 3.4 Nov 21, 2023 GA (as of Apr 8, 2024) Q2 2025 Q1 2026
    Azure Synapse Runtime for Apache Spark 3.3 Nov 17, 2022 end of support announced July 12th, 2024 3/31/2025
    Azure Synapse Runtime for Apache Spark 3.2 July 8, 2022 deprecated and soon disabled July 8, 2023 July 8, 2024
    Azure Synapse Runtime for Apache Spark 3.1 May 26, 2021 deprecated and soon disabled January 26, 2023 January 26, 2024
    Azure Synapse Runtime for Apache Spark 2.4 December 15, 2020 deprecated and soon disabled July 29, 2022 September 29, 2023 For up-to-date information, a detailed list of changes, and specific release notes for Spark runtimes, check and subscribe Spark Runtimes Releases and Updates.

    Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

  2. Smaran Thoomu 18,965 Reputation points Microsoft Vendor
    2025-01-13T13:21:47.1666667+00:00

    Hi @Amit Amola
    Welcome to Microsoft Q&A platform.

    In addition to the @Shikha Ghildiyal , thank you for reaching out and sharing your use case! We understand the importance of having the latest Apache Spark versions available in Azure Synapse, especially with the upcoming end of support for Apache Spark 3.3.

    Currently, Apache Spark 3.4 for Synapse Runtime is under active development, and we are targeting its availability before the March 2025 deadline. We recommend monitoring the Azure Updates page and the Synapse Analytics documentation for the latest announcements regarding its release.

    Meanwhile, we suggest planning your migration to Apache Spark 3.4 once it becomes available to ensure your jobs remain supported and leverage the latest enhancements.

    Hope this helps. Do let us know if you any further queries.

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.