Apache Spark 4.3.0 Adds Stateful Queries to Real-Time Mode and SCD Type 2 to Auto CDC, and Starts a Quarterly Feature-Release Cadence
Apache Spark 4.3.0 supports stateful queries in Real-Time Mode and SCD Type 2 in Auto CDC; Databricks reports P99 latencies of 136 to 141 ms on three workloads.