The Spark Universal Migrator is a data migration Spark application that fetches data from an Oracle database and stores it in a Hive database. It utilizes JDBC to connect to Oracle, processes and converts the data into a Hive-compatible schema, and then transfers it to Hive. The migration process employs iterators to generate queries for data retrieval and utilizes a BlockingQueue in conjunction with a ThreadPoolExecutor for parallel processing of data. Additionally, the application incorporates an Oracle ...

LicenseApache 2.0
Tagsgithub
Organization queukat
HomePage https://github.com/queukat/spark_oracle_hive_streaming 🔍 Inspect URL
DateMay 13, 2023
Filespom (2 KB)  jar (26 KB)  View All
RepositoriesCentral
Ranking#580496 in MvnRepository (See Top Artifacts)
Scala TargetScala 2.12 (View all targets)
VulnerabilitiesVulnerabilities from dependencies:
CVE-2023-22946

Note: There is a new version for this artifact

New Version2.0

Scope:
Scope:
Format:
Scope:
Scope:
Scope:
Scope:
Scope:
Scope:

Developers

NameEmailDev IdRolesOrganization
yaroslavqueukat<at>gmail.comqueukat