Core libraries for Apache Spark, a unified analytics engine for large-scale data processing.

LicenseApache 2.0
CategoriesDistributed Computing
Tagscomputingclusterdistributedsparkapacheparallel
HomePage https://spark.apache.org/
DateMay 23, 2025
Filespom (43 KB)  jar (14.1 MB)  View All
RepositoriesCentral
Ranking#212 in MvnRepository (See Top Artifacts)
#1 in Distributed Computing
Used By2,694 artifacts
Scala TargetScala 2.13 (View all targets)
VulnerabilitiesVulnerabilities from dependencies:
CVE-2025-48924
CVE-2022-46337

Scope:
Scope:
Format:
Scope:
Scope:
Scope:
Scope:
Scope:
Scope:

Compile Dependencies (63)

Category/License Group / ArtifactVersionUpdates
Streaming
Apache 2.0
com.clearspring.analytics » stream 2.9.8
Serializer
BSD 3-clause
com.esotericsoftware » kryo-shaded 4.0.35.6.2
JSON Lib
Apache 2.0
com.fasterxml.jackson.core » jackson-databind 2.18.22.19.2
JSON Lib
Apache 2.0
com.fasterxml.jackson.module » jackson-module-scala_2.13 2.18.22.19.2
Compression
BSD 2-clause
com.github.luben » zstd-jni 1.5.6-91.5.7-4
Defect Detection
LGPL 2.1
com.google.code.findbugs » jsr305 3.0.04.9.3
Compression
Apache 2.0
com.ning » compress-lzf 1.1.2
Serializer
Apache 2.0
com.twitter » chill_2.13 0.10.0
Serializer
Apache 2.0
com.twitter » chill-java 0.10.0
Base64
Apache 2.0
commons-codec » commons-codec 1.17.21.18.0
Collections
Apache 2.0
commons-collections » commons-collections 3.2.24.5.0
I/O
Apache 2.0
commons-io » commons-io 2.18.02.20.0
Application Metrics
Apache 2.0
io.dropwizard.metrics » metrics-core 4.2.304.2.33

Apache 2.0
io.dropwizard.metrics » metrics-jvm 4.2.304.2.33

Apache 2.0
io.dropwizard.metrics » metrics-json 4.2.304.2.33

Apache 2.0
io.dropwizard.metrics » metrics-graphite 4.2.304.2.33

Apache 2.0
io.dropwizard.metrics » metrics-jmx 4.2.304.2.33
JWT Lib
Apache 2.0
io.jsonwebtoken » jjwt-api 0.12.6
JWT Lib
Apache 2.0
io.jsonwebtoken » jjwt-impl 0.12.6

Apache 2.0
io.jsonwebtoken » jjwt-jackson 0.12.6
Network Framework
Apache 2.0
io.netty » netty-all 4.1.118.Final4.2.2.Final

Apache 2.0
io.netty » netty-transport-native-epoll 4.1.118.Final4.2.2.Final

Apache 2.0
io.netty » netty-transport-native-epoll 4.1.118.Final4.2.2.Final

Apache 2.0
io.netty » netty-transport-native-kqueue 4.1.118.Final4.2.2.Final

Apache 2.0
io.netty » netty-transport-native-kqueue 4.1.118.Final4.2.2.Final
Java Spec
EPL 2.0GPL
jakarta.servlet » jakarta.servlet-api 5.0.06.1.0
Java Spec
EPL 2.0GPL
javax.servlet » javax.servlet-api 4.0.16.1.0
Serializer
MIT
net.razorvine » pickle 1.5
Python Integration
BSD
net.sf.py4j » py4j 0.10.9.9
Serializer
Apache 2.0
org.apache.avro » avro 1.12.0

Apache 2.0
org.apache.avro » avro-mapred 1.12.0
Compression
Apache 2.0
org.apache.commons » commons-compress 1.27.1
Core Utils
Apache 2.0
org.apache.commons » commons-lang31 vulnerability 3.17.03.18.0
Math Lib
Apache 2.0
org.apache.commons » commons-math3 3.6.14.0-beta1
String Utils
Apache 2.0
org.apache.commons » commons-text 1.13.01.13.1
Collections
Apache 2.0
org.apache.commons » commons-collections4 4.44.5.0
Encryption Lib
Apache 2.0
org.apache.commons » commons-crypto 1.1.01.2.0
Dist Coordination
Apache 2.0
org.apache.curator » curator-recipes 5.7.15.8.0

Apache 2.0
org.apache.hadoop » hadoop-client-api 3.4.1

Apache 2.0
org.apache.hadoop » hadoop-client-runtime 3.4.1

Apache 2.0
org.apache.spark » spark-launcher_2.13 4.0.0

Apache 2.0
org.apache.spark » spark-kvstore_2.13 4.0.0

Apache 2.0
org.apache.spark » spark-network-common_2.13 4.0.0

Apache 2.0
org.apache.spark » spark-network-shuffle_2.13 4.0.0

Apache 2.0
org.apache.spark » spark-unsafe_2.13 4.0.0

Apache 2.0
org.apache.spark » spark-common-utils_2.13 4.0.0

Apache 2.0
org.apache.spark » spark-tags_2.13 4.0.0
Dist Coordination
Apache 2.0
org.apache.zookeeper » zookeeper 3.9.3

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.containers » jersey-container-servlet 3.0.163.1.10

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.containers » jersey-container-servlet-core 3.0.163.1.10

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.core » jersey-client 3.0.163.1.10

Apache 2.0CC0 1.0EPL 2.0GPL 2.0Public
org.glassfish.jersey.core » jersey-common 3.0.163.1.10

Apache 2.0BSDEPL 2.0GPL 2.0
org.glassfish.jersey.core » jersey-server 3.0.163.1.10

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.inject » jersey-hk2 3.0.163.1.10
JSON Lib
Apache 2.0
org.json4s » json4s-jackson_2.13 4.0.7
Compression
Apache 2.0
org.lz4 » lz4-java 1.8.0
Reflection
Apache 2.0
org.objenesis » objenesis 3.33.4
Collections
Apache 2.0
org.roaringbitmap » RoaringBitmap 1.3.0
JVM Languages
Apache 2.0
org.scala-lang » scala-library 2.13.163.7.1
Scala Compiler
Apache 2.0
org.scala-lang » scala-reflect 2.13.16
Collections
Apache 2.0
org.scala-lang.modules » scala-parallel-collections_2.13 1.2.0
XML Processing
Apache 2.0
org.scala-lang.modules » scala-xml_2.13 2.3.02.4.0
Compression
Apache 2.0
org.xerial.snappy » snappy-java 1.1.10.7

Provided Dependencies (1)

Category/License Group / ArtifactVersionUpdates
Core Utils
Apache 2.0
com.google.guava » guava 33.4.0-jre33.4.8-jre

Test Dependencies (27)

Category/License Group / ArtifactVersionUpdates
Native Access
EPL 2.0GPL 2.0LGPL 2.1
com.github.jnr » jnr-posix 3.1.153.1.20

Apache 2.0
com.github.sbt.junit » jupiter-interface 0.13.30.15.0
Bytecode
Apache 2.0
net.bytebuddy » byte-buddy 1.14.171.17.6
Bytecode
Apache 2.0
net.bytebuddy » byte-buddy-agent 1.14.171.17.6
Testing
Apache 2.0
org.apache.curator » curator-test 5.7.15.8.0
JDBC Driver
Apache 2.0
org.apache.derby » derby1 vulnerability 10.16.1.110.17.1.0

Apache 2.0
org.apache.derby » derbytools 10.16.1.110.17.1.0

Apache 2.0
org.apache.hadoop » hadoop-minikdc 3.4.1

Apache 2.0
org.apache.hadoop » hadoop-aws 3.4.1
HTTP Clients
Apache 2.0
org.apache.httpcomponents » httpclient 4.5.145.5
MIME Types Lib
Apache 2.0
org.apache.httpcomponents » httpmime 4.5.145.5
HTTP Clients
Apache 2.0
org.apache.httpcomponents » httpcore 4.4.165.3.4

Apache 2.0
org.apache.spark » spark-launcher_2.13 4.0.0

Apache 2.0
org.apache.spark » spark-network-common_2.13 4.0.0

Apache 2.0
org.apache.spark » spark-network-shuffle_2.13 4.0.0

Apache 2.0
org.apache.spark » spark-common-utils_2.13 4.0.0

Apache 2.0
org.apache.spark » spark-tags_2.13 4.0.0

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.test-framework.providers » jersey-test-framework-provider-simple 3.0.163.1.10
Testing
EPL 2.0
org.junit.jupiter » junit-jupiter 5.11.45.13.3
Mocking
MIT
org.mockito » mockito-core 5.12.05.18.0
Testing
BSD 3-clause
org.scalacheck » scalacheck_2.13 1.18.01.18.1
Testing
Apache 2.0
org.scalatest » scalatest_2.13 3.2.19

Apache 2.0
org.scalatestplus » scalacheck-1-18_2.13 3.2.19.0

Apache 2.0
org.scalatestplus » mockito-5-12_2.13 3.2.19.0

Apache 2.0
org.scalatestplus » selenium-4-21_2.13 3.2.19.0
Web Testing
Apache 2.0
org.seleniumhq.selenium » selenium-java 4.21.04.34.0

Apache 2.0
org.seleniumhq.selenium » htmlunit3-driver 4.21.04.33.0

Related Books

Time Series Analysis with Spark: A practical guide to processing, modeling, and forecasting time series with Apache SparkTime Series Analysis with Spark: A practical guide to processing, modeling, and forecasting time series with Apache Spark (2025)
by Ramaswami, Yoni, Williamson, Dael, Govaere, Jan
Data Engineering with Databricks Cookbook: Build effective data and AI solutions using Apache Spark, Databricks, and Delta LakeData Engineering with Databricks Cookbook: Build effective data and AI solutions using Apache Spark, Databricks, and Delta Lake (2024)
by Chadha, Pulkit
Data Algorithms with Spark: Recipes and Design Patterns for Scaling Up using PySparkData Algorithms with Spark: Recipes and Design Patterns for Scaling Up using PySpark (2022)
by Parsian, Mahmoud
Learning Spark: Lightning-Fast Data AnalyticsLearning Spark: Lightning-Fast Data Analytics (2020)
by Damji, Jules S., Wenig, Brooke, Das, Tathagata, Lee, Denny
Stream Processing with Apache Spark: Mastering Structured Streaming and Spark StreamingStream Processing with Apache Spark: Mastering Structured Streaming and Spark Streaming (2019)
by Maas, Gerard, Garillot, Francois
Spark: The Definitive Guide: Big Data Processing Made SimpleSpark: The Definitive Guide: Big Data Processing Made Simple (2018)
by Chambers, Bill, Zaharia, Matei
Apache Spark 2.x Machine Learning Cookbook: Over 100 recipes to simplify machine learning model implementations with SparkApache Spark 2.x Machine Learning Cookbook: Over 100 recipes to simplify machine learning model implementations with Spark (2017)
by Amirghodsi, Siamak, Rajendran, Meenakshi, Hall, Broderick, Mei, Shuen
Advanced Analytics with Spark: Patterns for Learning from Data at ScaleAdvanced Analytics with Spark: Patterns for Learning from Data at Scale (2017)
by Ryza, Sandy, Laserson, Uri, Owen, Sean, Wills, Josh
Mastering Apache Spark 2.x - Second Edition: Scale your machine learning and deep learning systems with SparkML, DeepLearning4j and H2OMastering Apache Spark 2.x - Second Edition: Scale your machine learning and deep learning systems with SparkML, DeepLearning4j and H2O (2017)
by Kienzler, Romeo
Apache Spark 2.x for Java Developers: Explore big data at scale using Apache Spark 2.x Java APIsApache Spark 2.x for Java Developers: Explore big data at scale using Apache Spark 2.x Java APIs (2017)
by Gulati, Sourav, Kumar, Sumit
High Performance Spark: Best Practices for Scaling and Optimizing Apache SparkHigh Performance Spark: Best Practices for Scaling and Optimizing Apache Spark (2017)
by Karau, Holden, Warren, Rachel
Learning Apache Spark 2Learning Apache Spark 2 (2017)
by Abbasi, Muhammad Asif
Top 50 Apache Spark Interview Questions & AnswersTop 50 Apache Spark Interview Questions & Answers (2017)
by Powerhouse, Knowledge
99 Apache Spark Interview Questions for Professionals: A GUIDE TO PREPARE FOR APACHE SPARK INTERVIEW QUESTIONS99 Apache Spark Interview Questions for Professionals: A GUIDE TO PREPARE FOR APACHE SPARK INTERVIEW QUESTIONS (2017)
by Kumar, Yogesh, Kumar, Hitesh
Apache Spark for Data Science CookbookApache Spark for Data Science Cookbook (2016)
by Chitturi, Padma Priya
Practical Data Science with Hadoop and Spark: Designing and Building Effective Analytics at Scale (Addison-wesley Data & Analytics)Practical Data Science with Hadoop and Spark: Designing and Building Effective Analytics at Scale (Addison-wesley Data & Analytics) (2016)
by Mendelevitch, Ofer, Stella, Casey, Eadline, Douglas
Expert Hadoop Administration: Managing, Tuning, and Securing Spark, YARN, and HDFS (Addison-Wesley Data & Analytics Series)Expert Hadoop Administration: Managing, Tuning, and Securing Spark, YARN, and HDFS (Addison-Wesley Data & Analytics Series) (2016)
by Alapati, Sam
Spark in ActionSpark in Action (2016)
by Zecevic, Petar, Bonaci, Marko
Apache Spark 2 for BeginnersApache Spark 2 for Beginners (2016)
by Thottuvaikkatumana, Rajanarayanan
Big Data SMACK: A Guide to Apache Spark, Mesos, Akka, Cassandra, and KafkaBig Data SMACK: A Guide to Apache Spark, Mesos, Akka, Cassandra, and Kafka (2016)
by Estrada, Raul, Ruiz, Isaac
Apache Spark in 24 Hours, Sams Teach YourselfApache Spark in 24 Hours, Sams Teach Yourself (2016)
by Aven, Jeffrey
Apache Spark Interview Question & AnswersApache Spark Interview Question & Answers (2016)
by Goel, Naman
Spark GraphX in ActionSpark GraphX in Action (2016)
by Malak, Michael, East, Robin
Spark Tutorials with Scala: The Beginner's GuideSpark Tutorials with Scala: The Beginner's Guide (2016)
by McGrath, Todd
Pro Spark Streaming: The Zen of Real-Time Analytics Using Apache SparkPro Spark Streaming: The Zen of Real-Time Analytics Using Apache Spark (2016)
by Nabi, Zubair
Apache Spark Machine Learning BlueprintsApache Spark Machine Learning Blueprints (2016)
by Liu, Alex
Spark: Big Data Cluster Computing in ProductionSpark: Big Data Cluster Computing in Production (2016)
by Ganelin, Ilya, Orhian, Ema, Sasaki, Kai, York, Brennon
Learning Spark: Analytics With Spark FrameworkLearning Spark: Analytics With Spark Framework (2016)
by Moore, Joseph
Apache Spark Scala Interview Questions: Shyam MalleshApache Spark Scala Interview Questions: Shyam Mallesh (2016)
by Mallesh, Shyam
Big Data Analytics with Spark: A Practitioner's Guide to Using Spark for Large Scale Data AnalysisBig Data Analytics with Spark: A Practitioner's Guide to Using Spark for Large Scale Data Analysis (2015)
by Guller, Mohammed
Mastering Apache Spark: Gain expertise in processing and storing data by using advanced techniques with Apache SparkMastering Apache Spark: Gain expertise in processing and storing data by using advanced techniques with Apache Spark (2015)
by Frampton, Mike
Apache Spark Graph ProcessingApache Spark Graph Processing (2015)
by Ramamonjison, Rindra
Spark Cookbook: Over 60 recipes on Spark, covering Spark Core, Spark SQL, Spark Streaming, MLlib, and GraphX librariesSpark Cookbook: Over 60 recipes on Spark, covering Spark Core, Spark SQL, Spark Streaming, MLlib, and GraphX libraries (2015)
by Yadav, Rishi
Advanced Analytics with Spark: Patterns for Learning from Data at ScaleAdvanced Analytics with Spark: Patterns for Learning from Data at Scale (2015)
by Ryza, Sandy, Laserson, Uri, Owen, Sean, Wills, Josh
Learning Spark: Lightning-Fast Big Data AnalysisLearning Spark: Lightning-Fast Big Data Analysis (2015)
by Karau, Holden, Konwinski, Andy, Wendell, Patrick, Zaharia, Matei
Machine Learning with SparkMachine Learning with Spark (2015)
by Pentreath, Nick