Spark SQL is Apache Spark's module for working with structured data based on DataFrames.

The machine learning library for Apache Spark, providing scalable algorithms and tools for ML pipelines.

Spark Project Hive

Spark Avro

Kafka 0.10+ Source For Structured Streaming

spark-testing-base

Spark Project REPL

Spark Project Hive Thrift Server

A Spark plugin for reading and writing Excel files

This package contains all Spark dependencies required by Flowman. You should add this dependency to your projects when you want to link against Flowman.

Spark Common Utilities for ABSA