Amazon EMR Serverless now supports interactive sessions with Spark Connect, enabling you to develop and run Apache Spark applications from managed notebooks in Amazon SageMaker Unified Studio, as well as your favorite notebook environments and IDEs such as Jupyter and Visual Studio Code. You can also monitor and debug active and completed sessions in the EMR console, and get granular cost and usage visibility for individual sessions. An interactive session provides a persistent Spark context that seamlessly spans across cells and scripts, enabling you to blend local Python code execution with
The continuous evolution of cloud computing and data analytics platforms necessitates improved developer experience and efficiency for large-scale data processing.
This development enhances the productivity of data scientists and developers working with Apache Spark, making AWS EMR Serverless more competitive and accelerating data-driven insights.
Developers can now seamlessly integrate interactive Spark workloads within familiar notebook environments, leading to faster iteration and simplified application development on EMR Serverless.
- · AWS
- · Data scientists
- · Machine learning engineers
- · Cloud data platform users
- · On-premise Spark cluster providers
- · Less integrated cloud data platforms
Increased adoption of Amazon EMR Serverless due to enhanced developer experience and cost efficiency for interactive workloads.
Faster development and deployment of big data and AI applications, potentially leading to quicker innovation cycles in various industries.
Further consolidation of data analytics workloads onto cloud platforms as barriers to entry and operational complexities diminish.
This signal links to a primary source. Continuum Brief monitors and indexes it as part of the live intelligence stream — we do not republish source content.
Read at AWS What's New