Home » org.apache.spark » spark-sql_2.13 » 4.0.0-preview2 » Changes

Spark SQL » 4.0.0-preview2

Spark SQL is Apache Spark's module for working with structured data based on DataFrames.
Version4.0.0-preview2compared with

Version Details

4.0.0-preview1 4.0.0-preview2
Release dateJun 03, 2024Sep 20, 2024
LicensesApache 2.0Apache 2.0
VulnerabilitiesNoneNone

Compile Changes (145)

4.0.0-preview1 4.0.0-preview2
ChangeGroup / ArtifactPreviousCurrent
+ Added com.clearspring.analytics » stream-2.9.8
+ Added com.esotericsoftware » kryo-shaded-4.0.2
+ Added com.esotericsoftware » minlog-1.3.0
+ Added com.fasterxml.jackson.core » jackson-annotations-2.17.2
+ Added com.fasterxml.jackson.core » jackson-core-2.17.2
+ Added com.fasterxml.jackson.datatype » jackson-datatype-jdk8-2.17.0
+ Added com.fasterxml.jackson.datatype » jackson-datatype-jsr310-2.17.2
+ Added com.fasterxml.jackson.module » jackson-module-scala_2.13-2.17.2
+ Added com.github.luben » zstd-jni-1.5.6-5
+ Added com.google.code.findbugs » jsr305-3.0.0
+ Added com.google.code.gson » gson-2.11.0
+ Added com.google.crypto.tink » tink-1.15.0
+ Added com.google.flatbuffers » flatbuffers-java-24.3.25
+ Added com.ning » compress-lzf-1.1.2
+ Added com.thoughtworks.paranamer » paranamer-2.8
+ Added com.twitter » chill-java-0.10.0
+ Added com.twitter » chill_2.13-0.10.0
+ Added commons-codec » commons-codec-1.17.1
+ Added commons-collections » commons-collections-3.2.2
+ Added commons-io » commons-io-2.16.1
+ Added io.airlift » aircompressor-2.0.2
+ Added io.dropwizard.metrics » metrics-core-4.2.27
+ Added io.dropwizard.metrics » metrics-graphite-4.2.27
+ Added io.dropwizard.metrics » metrics-jmx-4.2.27
+ Added io.dropwizard.metrics » metrics-json-4.2.27
+ Added io.dropwizard.metrics » metrics-jvm-4.2.27
+ Added io.jsonwebtoken » jjwt-api-0.12.6
+ Added io.netty » netty-all-4.1.110.Final
+ Added io.netty » netty-buffer-4.1.110.Final
+ Added io.netty » netty-codec-4.1.110.Final
+ Added io.netty » netty-codec-http-4.1.110.Final
+ Added io.netty » netty-codec-http2-4.1.110.Final
+ Added io.netty » netty-codec-socks-4.1.110.Final
+ Added io.netty » netty-common-4.1.110.Final
+ Added io.netty » netty-handler-4.1.110.Final
+ Added io.netty » netty-handler-proxy-4.1.110.Final
+ Added io.netty » netty-resolver-4.1.110.Final
+ Added io.netty » netty-tcnative-boringssl-static-2.0.66.Final
+ Added io.netty » netty-tcnative-classes-2.0.66.Final
+ Added io.netty » netty-transport-4.1.110.Final
+ Added io.netty » netty-transport-classes-epoll-4.1.110.Final
+ Added io.netty » netty-transport-classes-kqueue-4.1.110.Final
+ Added io.netty » netty-transport-native-epoll-4.1.110.Final
+ Added io.netty » netty-transport-native-kqueue-4.1.110.Final
+ Added io.netty » netty-transport-native-unix-common-4.1.110.Final
+ Added jakarta.annotation » jakarta.annotation-api-2.0.0
+ Added jakarta.inject » jakarta.inject-api-2.0.1
+ Added jakarta.servlet » jakarta.servlet-api-5.0.0
+ Added jakarta.validation » jakarta.validation-api-3.0.2
+ Added jakarta.ws.rs » jakarta.ws.rs-api-3.0.0
+ Added javax.activation » activation-1.1.1
+ Added javax.annotation » javax.annotation-api-1.3.2
+ Added javax.servlet » javax.servlet-api-4.0.1
+ Added net.razorvine » pickle-1.5
+ Added net.sf.py4j » py4j-0.10.9.7
+ Added org.antlr » antlr4-runtime-4.13.1
+ Added org.apache.arrow » arrow-format-17.0.0
+ Added org.apache.arrow » arrow-memory-core-17.0.0
+ Added org.apache.arrow » arrow-memory-netty-17.0.0
+ Added org.apache.arrow » arrow-memory-netty-buffer-patch-17.0.0
+ Added org.apache.arrow » arrow-vector-17.0.0
+ Added org.apache.avro » avro-1.12.0
+ Added org.apache.avro » avro-ipc-1.12.0
+ Added org.apache.avro » avro-mapred-1.12.0
+ Added org.apache.commons » commons-collections4-4.4
+ Added org.apache.commons » commons-compress-1.27.1
+ Added org.apache.commons » commons-crypto-1.1.0
+ Added org.apache.commons » commons-lang3-3.17.0
+ Added org.apache.commons » commons-math3-3.6.1
+ Added org.apache.commons » commons-text-1.12.0
+ Added org.apache.curator » curator-client-5.7.0
+ Added org.apache.curator » curator-framework-5.7.0
+ Added org.apache.curator » curator-recipes-5.7.0
+ Added org.apache.datasketches » datasketches-java-6.0.0
+ Added org.apache.datasketches » datasketches-memory-2.2.0
+ Added org.apache.hadoop » hadoop-client-api-3.4.0
+ Added org.apache.hadoop » hadoop-client-runtime-3.4.0
+ Added org.apache.ivy » ivy-2.5.2
+ Added org.apache.logging.log4j » log4j-1.2-api-2.22.1
+ Added org.apache.logging.log4j » log4j-api-2.22.1
+ Added org.apache.logging.log4j » log4j-core-2.22.1
+ Added org.apache.logging.log4j » log4j-layout-template-json-2.22.1
+ Added org.apache.logging.log4j » log4j-slf4j2-impl-2.22.1
+ Added org.apache.orc » orc-shims-2.0.2
+ Added org.apache.parquet » parquet-common-1.14.2
+ Added org.apache.parquet » parquet-encoding-1.14.2
+ Added org.apache.parquet » parquet-format-structures-1.14.2
+ Added org.apache.spark » spark-common-utils_2.13-4.0.0-preview2
+ Added org.apache.spark » spark-kvstore_2.13-4.0.0-preview2
+ Added org.apache.spark » spark-launcher_2.13-4.0.0-preview2
+ Added org.apache.spark » spark-network-common_2.13-4.0.0-preview2
+ Added org.apache.spark » spark-network-shuffle_2.13-4.0.0-preview2
+ Added org.apache.spark » spark-sql-api_2.13-4.0.0-preview2
+ Added org.apache.spark » spark-unsafe_2.13-4.0.0-preview2
+ Added org.apache.spark » spark-variant_2.13-4.0.0-preview2
+ Added org.apache.yetus » audience-annotations-0.12.0
+ Added org.apache.zookeeper » zookeeper-3.9.2
+ Added org.apache.zookeeper » zookeeper-jute-3.9.2
+ Added org.codehaus.janino » commons-compiler-3.1.9
+ Added org.codehaus.janino » janino-3.1.9
+ Added org.fusesource.leveldbjni » leveldbjni-all-1.8
+ Added org.glassfish.hk2 » hk2-api-3.0.3
+ Added org.glassfish.hk2 » hk2-locator-3.0.3
+ Added org.glassfish.hk2 » hk2-utils-3.0.3
+ Added org.glassfish.hk2 » osgi-resource-locator-1.0.3
+ Added org.glassfish.hk2.external » aopalliance-repackaged-3.0.3
+ Added org.glassfish.jersey.containers » jersey-container-servlet-3.0.12
+ Added org.glassfish.jersey.containers » jersey-container-servlet-core-3.0.12
+ Added org.glassfish.jersey.core » jersey-client-3.0.12
+ Added org.glassfish.jersey.core » jersey-common-3.0.12
+ Added org.glassfish.jersey.core » jersey-server-3.0.12
+ Added org.glassfish.jersey.inject » jersey-hk2-3.0.12
+ Added org.javassist » javassist-3.29.2-GA
+ Added org.jetbrains » annotations-17.0.0
+ Added org.json4s » json4s-ast_2.13-4.0.7
+ Added org.json4s » json4s-core_2.13-4.0.7
+ Added org.json4s » json4s-jackson-core_2.13-4.0.7
+ Added org.json4s » json4s-jackson_2.13-4.0.7
+ Added org.json4s » json4s-scalap_2.13-4.0.7
+ Added org.lz4 » lz4-java-1.8.0
+ Added org.objenesis » objenesis-3.3
+ Added org.roaringbitmap » RoaringBitmap-1.2.1
+ Added org.scala-lang » scala-library-2.13.14
+ Added org.scala-lang » scala-reflect-2.13.14
+ Added org.scala-lang.modules » scala-parser-combinators_2.13-2.4.0
+ Added org.scala-lang.modules » scala-xml_2.13-2.3.0
+ Added org.slf4j » jcl-over-slf4j-2.0.16
+ Added org.slf4j » jul-to-slf4j-2.0.16
+ Added org.slf4j » slf4j-api-2.0.16
+ Added org.spark-project.spark » unused-1.0.0
+ Added org.threeten » threeten-extra-1.7.1
+ Added org.tukaani » xz-1.10
+ Added org.xerial.snappy » snappy-java-1.1.10.7
+ Added oro » oro-2.0.8
~ Updated com.fasterxml.jackson.core » jackson-databind2.17.12.17.2
~ Updated com.ibm.icu » icu4j72.175.1
~ Updated org.apache.orc » orc-core2.0.12.0.2
~ Updated org.apache.orc » orc-mapreduce2.0.12.0.2
~ Updated org.apache.parquet » parquet-column1.13.11.14.2
~ Updated org.apache.parquet » parquet-hadoop1.13.11.14.2
~ Updated org.apache.spark » spark-catalyst_2.134.0.0-preview14.0.0-preview2
~ Updated org.apache.spark » spark-core_2.134.0.0-preview14.0.0-preview2
~ Updated org.apache.spark » spark-sketch_2.134.0.0-preview14.0.0-preview2
~ Updated org.apache.spark » spark-tags_2.134.0.0-preview14.0.0-preview2
~ Updated org.rocksdb » rocksdbjni8.11.49.5.2

Provided Changes (2)

4.0.0-preview1 4.0.0-preview2
ChangeGroup / ArtifactPreviousCurrent
- Removed com.google.protobuf » protobuf-java3.25.1-
- Removed org.eclipse.jetty » jetty-servlet11.0.20-

Runtime Changes (2)

4.0.0-preview1 4.0.0-preview2
ChangeGroup / ArtifactPreviousCurrent
+ Added io.netty » netty-transport-native-epoll-4.1.110.Final
+ Added org.apache.parquet » parquet-jackson-1.14.2

Test Changes (27)

4.0.0-preview1 4.0.0-preview2
ChangeGroup / ArtifactPreviousCurrent
- Removed com.h2database » h22.2.220-
- Removed com.ibm.db2 » jcc11.5.9.0-
- Removed com.microsoft.sqlserver » mssql-jdbc12.6.1.jre11-
- Removed com.oracle.database.jdbc » ojdbc1123.4.0.24.05-
- Removed net.aichler » jupiter-interface0.11.1-
- Removed org.apache.derby » derby10.16.1.1-
- Removed org.apache.derby » derbytools10.16.1.1-
- Removed org.apache.parquet » parquet-avro1.13.1-
- Removed org.apache.parquet » parquet-column1.13.1-
- Removed org.apache.parquet » parquet-common1.13.1-
- Removed org.apache.parquet » parquet-encoding1.13.1-
- Removed org.apache.spark » spark-catalyst_2.134.0.0-preview1-
- Removed org.apache.spark » spark-core_2.134.0.0-preview1-
- Removed org.apache.spark » spark-tags_2.134.0.0-preview1-
- Removed org.bouncycastle » bcpkix-jdk18on1.78-
- Removed org.bouncycastle » bcprov-jdk18on1.78-
- Removed org.junit.jupiter » junit-jupiter5.9.3-
- Removed org.mariadb.jdbc » mariadb-java-client2.7.12-
- Removed org.mockito » mockito-core5.10.0-
- Removed org.postgresql » postgresql42.7.3-
- Removed org.scalacheck » scalacheck_2.131.17.0-
- Removed org.scalatest » scalatest_2.133.2.18-
- Removed org.scalatestplus » mockito-5-10_2.133.2.18.0-
- Removed org.scalatestplus » scalacheck-1-17_2.133.2.18.0-
- Removed org.scalatestplus » selenium-4-17_2.133.2.18.0-
- Removed org.seleniumhq.selenium » htmlunit3-driver4.17.0-
- Removed org.seleniumhq.selenium » selenium-java4.17.0-