Apache Spark

Apache Spark Streaming API

Scalable, high-throughput, fault-tolerant stream processing of live data streams. Supports Structured Streaming (the newer DStream-based API) with exactly-once semantics, continuous processing mode, and integration with Kafka, Kinesis, HDFS, and other sources.

GitHub

Documentation

📖
Documentation
https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html

SDKs

📦
SDK
Scala Streaming API
📦
SDK
Python Streaming API

API entry from apis.yml

apis.yml Raw ↑ 
aid: apache-spark:apache-spark-streaming-api
name: Apache Spark Streaming API
description: Scalable, high-throughput, fault-tolerant stream processing of live data streams. Supports
  Structured Streaming (the newer DStream-based API) with exactly-once semantics, continuous processing
  mode, and integration with Kafka, Kinesis, HDFS, and other sources.
humanURL: https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html
tags:
- Data Processing
- Real-Time
- Streaming
properties:
- type: Documentation
  url: https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html
- type: SDK
  url: https://spark.apache.org/docs/latest/api/scala/org/apache/spark/streaming/index.html
  title: Scala Streaming API
- type: SDK
  url: https://spark.apache.org/docs/latest/api/python/reference/pyspark.streaming/index.html
  title: Python Streaming API