Core libraries for Apache Spark, a unified analytics engine for large-scale data processing.

LicenseApache 2.0
CategoriesDistributed Computing
Tagscomputingclusterdistributedsparkapacheparallel
HomePage http://spark.apache.org/
DateMay 27, 2021
Filespom (33 KB)  jar (10.0 MB)  View All
RepositoriesCentral
Ranking#205 in MvnRepository (See Top Artifacts)
#1 in Distributed Computing
Used By2,485 artifacts
Scala TargetScala 2.12 (View all targets)
VulnerabilitiesDirect vulnerabilities:
CVE-2022-31777
CVE-2021-38296

Vulnerabilities from dependencies:
CVE-2023-44981
CVE-2023-43642
CVE-2023-39410
View 26 more ...

Note: There is a new version for this artifact

New Version4.0.0-preview1


Compile Dependencies (55)

Category/License Group / ArtifactVersionUpdates
Streaming
Apache 2.0
com.clearspring.analytics » stream 2.9.62.9.8
JSON Lib
Apache 2.0
com.fasterxml.jackson.core » jackson-databind5 vulnerabilities 2.10.02.17.1
JSON Lib
Apache 2.0
com.fasterxml.jackson.module » jackson-module-scala_2.12 2.10.02.17.1
Compression
BSD 2-clause
com.github.luben » zstd-jni 1.4.8-11.5.6-3
Defect Detection
LGPL 2.1
com.google.code.findbugs » jsr305 3.0.04.8.5
Compression
Apache 2.0
com.ning » compress-lzf 1.0.31.1.2
Serializer
Apache 2.0
com.twitter » chill_2.12 0.9.50.10.0
Serializer
Apache 2.0
com.twitter » chill-java 0.9.50.10.0
FTP
Apache 2.0
commons-net » commons-net1 vulnerability 3.13.11.1
Application Metrics
Apache 2.0
io.dropwizard.metrics » metrics-core 4.1.14.2.26

Apache 2.0
io.dropwizard.metrics » metrics-jvm 4.1.14.2.26

Apache 2.0
io.dropwizard.metrics » metrics-json 4.1.14.2.26

Apache 2.0
io.dropwizard.metrics » metrics-graphite 4.1.14.2.26

Apache 2.0
io.dropwizard.metrics » metrics-jmx 4.1.14.2.26
Network Framework
Apache 2.0
io.netty » netty-all 4.1.51.Final4.1.111.Final
Java Spec
EPL 2.0GPL
jakarta.servlet » jakarta.servlet-api 4.0.36.1.0
Java Spec
EDL 1.0
javax.activation » activation 1.1.12.1.3
Logging
Apache 2.0
log4j » log4j5 vulnerabilities 1.2.172.23.1
Python Integration
MIT
net.razorvine » pyrolite 4.305.1
Python Integration
BSD
net.sf.py4j » py4j 0.10.90.10.9.7
Data Format
Apache 2.0
org.apache.avro » avro1 vulnerability 1.8.21.11.3

Apache 2.0
org.apache.avro » avro-mapred 1.8.21.11.3
Core Utils
Apache 2.0
org.apache.commons » commons-lang3 3.103.14.0
Math Lib
Apache 2.0
org.apache.commons » commons-math3 3.4.14.0-beta1
String Utils
Apache 2.0
org.apache.commons » commons-text1 vulnerability 1.61.12.0
Encryption Lib
Apache 2.0
org.apache.commons » commons-crypto 1.1.01.2.0
Dist Coordination
Apache 2.0
org.apache.curator » curator-recipes 2.13.05.7.0

Apache 2.0
org.apache.hadoop » hadoop-client 3.2.03.4.0

Apache 2.0
org.apache.ivy » ivy3 vulnerabilities 2.4.02.5.2

Apache 2.0
org.apache.spark » spark-launcher_2.12 3.1.23.5.1

Apache 2.0
org.apache.spark » spark-kvstore_2.12 3.1.23.5.1

Apache 2.0
org.apache.spark » spark-network-common_2.12 3.1.23.5.1

Apache 2.0
org.apache.spark » spark-network-shuffle_2.12 3.1.23.5.1

Apache 2.0
org.apache.spark » spark-unsafe_2.12 3.1.23.5.1

Apache 2.0
org.apache.spark » spark-tags_2.12 3.1.23.5.1

Apache 2.0
org.apache.xbean » xbean-asm7-shaded 4.154.17
Dist Coordination
Apache 2.0
org.apache.zookeeper » zookeeper1 vulnerability 3.4.143.9.2

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.containers » jersey-container-servlet 2.303.1.7

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.containers » jersey-container-servlet-core 2.303.1.7

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.core » jersey-client 2.303.1.7

Apache 2.0CC0 1.0EPL 2.0GPL 2.0Public
org.glassfish.jersey.core » jersey-common1 vulnerability 2.303.1.7

Apache 2.0BSDEPL 2.0GPL 2.0
org.glassfish.jersey.core » jersey-server 2.303.1.7

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.inject » jersey-hk2 2.303.1.7
JSON Lib
Apache 2.0
org.json4s » json4s-jackson_2.12 3.7.0-M54.0.7
Compression
Apache 2.0
org.lz4 » lz4-java 1.7.11.8.0
Collections
Apache 2.0
org.roaringbitmap » RoaringBitmap 0.9.01.0.6
JVM Languages
Apache 2.0
org.scala-lang » scala-library 2.12.103.4.2
Scala Compiler
Apache 2.0
org.scala-lang » scala-reflect 2.12.102.13.14
XML Processing
Apache 2.0
org.scala-lang.modules » scala-xml_2.12 1.2.02.3.0
Logging
MIT
org.slf4j » slf4j-api 1.7.302.0.13
Logging Bridge
MIT
org.slf4j » jul-to-slf4j 1.7.302.0.13
Logging Bridge
Apache 2.0
org.slf4j » jcl-over-slf4j 1.7.302.0.13
Logging Bridge
MIT
org.slf4j » slf4j-log4j12 1.7.302.0.13
Compression
Apache 2.0
org.xerial.snappy » snappy-java4 vulnerabilities 1.1.8.21.1.10.5
Regexp
Apache
oro » oro 2.0.8

Provided Dependencies (1)

Category/License Group / ArtifactVersionUpdates
Core Utils
Apache 2.0
com.google.guava » guava3 vulnerabilities 14.0.133.2.1-jre

Runtime Dependencies (1)

Category/License Group / ArtifactVersionUpdates
Reflection
BSD
com.thoughtworks.paranamer » paranamer 2.8

Test Dependencies (26)

Category/License Group / ArtifactVersionUpdates
Testing
BSD 3-clause
com.novocode » junit-interface 0.110.13.3
Testing
EPL 2.0
junit » junit 4.13.15.10.2
Web Testing
Apache 2.0
net.sourceforge.htmlunit » htmlunit1 vulnerability 2.40.04.2.0

Apache 2.0
net.sourceforge.htmlunit » htmlunit-core-js 2.40.04.2.0

Apache 2.0
org.apache.curator » curator-test 2.13.05.7.0
JDBC Driver
Apache 2.0
org.apache.derby » derby2 vulnerabilities 10.12.1.110.17.1.0

Apache 2.0
org.apache.hadoop » hadoop-minikdc 3.2.03.4.0

Apache 2.0
org.apache.hadoop » hadoop-aws 3.2.03.4.0
HTTP Clients
Apache 2.0
org.apache.httpcomponents » httpclient1 vulnerability 4.5.65.3.1
MIME Types Lib
Apache 2.0
org.apache.httpcomponents » httpmime 4.5.65.3.1
HTTP Clients
Apache 2.0
org.apache.httpcomponents » httpcore 4.4.125.2.4

Apache 2.0
org.apache.spark » spark-launcher_2.12 3.1.23.5.1

Apache 2.0
org.apache.spark » spark-network-shuffle_2.12 3.1.23.5.1

Apache 2.0
org.apache.spark » spark-tags_2.12 3.1.23.5.1

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.test-framework.providers » jersey-test-framework-provider-simple 2.303.1.7
Testing
BSD 3-clause
org.hamcrest » hamcrest-core 1.32.2
Testing
BSD 3-clause
org.hamcrest » hamcrest-library 1.32.2
Mocking
MIT
org.mockito » mockito-core 3.4.65.12.0
Testing
BSD 3-clause
org.scalacheck » scalacheck_2.12 1.14.21.18.0
Testing
Apache 2.0
org.scalatest » scalatest_2.12 3.2.33.2.18

Apache 2.0
org.scalatestplus » scalatestplus-scalacheck_2.12 3.1.0.0-RC23.2.2.0

Apache 2.0
org.scalatestplus » scalatestplus-mockito_2.12 1.0.0-SNAP53.2.10.0

Apache 2.0
org.scalatestplus » scalatestplus-selenium_2.12 1.0.0-SNAP53.2.10.0
Web Testing
Apache 2.0
org.seleniumhq.selenium » selenium-java 3.141.594.21.0
Browser Automation
Apache 2.0
org.seleniumhq.selenium » htmlunit-driver 2.40.04.13.0
XML Processing
ApacheW3C
xml-apis » xml-apis 1.4.012.0.2

Licenses

LicenseURL
Apache 2.0 License http://www.apache.org/licenses/LICENSE-2.0.html

Developers

NameEmailDev IdRolesOrganization
Matei Zahariamatei.zaharia<at>gmail.commateiApache Software Foundation