Skip to content

Framework

Apache Flink

Open-source distributed engine for stateful stream and batch processing, used to build real-time data pipelines and event-driven applications.

Known aliases

  • Flink

Current stories

buildOne report1 publisher

Iceberg 1.11.0 puts Spark, Flink and Hive file access behind one format registry

Iceberg 1.11.0 ships a File Format API that sends Spark, Flink, Hive and plain-Java reads and writes through one registry of format models. A dev.to walkthrough says the file format list stays fixed, so Vortex and Lance still need a change inside Iceberg.

Publishers:dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap−10
Incentives
Not scored
Confidence50
productConfirmed5 publishers

Restate raises $20 million to take its durable execution runtime to San Francisco

Restate, the Berlin startup built by Apache Flink's creators, raised a $20 million Series A led by Singular, lifting its total funding to $27 million. The money pays for engineers and a San Francisco commercial hub to sell software that lets AI agents resume work after a crash.

Perspective Coverage

5 publishers
Builder
Builder 32%
Operator
Operator 20%
Investor
Investor 48%

Reality

Evidence64
Adoption42
Hype gap+22
Incentives58
Confidence68
productOne report1 publisher

Four-times-faster incident pipeline caught just 64% of in-scope incidents in a bad month

One SaaS team's rebuild of incident detection on Kafka and Flink cut telemetry lag from over 40 seconds to under 10, according to its CNCF post. Over eighteen months its recall ran from about 60% to 86% and back to 64%, so speed alone says little about which outages get caught.

Publishers:cncf.io

Reality

Evidence45
Adoption20
Hype gap+10
Incentives40
Confidence40
buildOne report1 publisher

Migrating from Dataflow to Flink includes installing cert-manager for the Kubernetes Operator

Apache Flink covers most of what Google's managed Dataflow does. A dev.to deployment guide prices the swap in prerequisites: cert-manager goes in before the operator, and the exactly-once path ends in a bucket whose keys you hold.

Publishers:dev.to

Reality

Evidence42
Adoption
Not scored
Hype gap+30
Incentives70
Confidence50
buildOne report1 publisher

Collapsing three copies into one Iceberg table moves the conflict into an HTTP 409

A GCP walkthrough put Spark, Trino and BigQuery on the same orders table through Google's Iceberg REST catalog. The 409 ConflictException it logged is the part of the demo a production pipeline has to plan for.

Publishers:dev.to

Reality

Evidence38
Adoption18
Hype gap+20
Incentives35
Confidence45
buildOne report1 publisher

Confluent triples its Kafka console ceiling to 400K partitions and leaves the brokers alone

Control Center 2.0 works against unchanged Confluent Platform 7.5 through 7.9 clusters. That compatibility line says the old limit was in the monitoring tier, not the data plane.

Publishers:confluent.io

Reality

Evidence30
Adoption22
Hype gap+34
Incentives88
Confidence52
buildOne report1 publisher

Iceberg won the table format war, then left the maintenance layer to you

The format ships compaction and expiry primitives without a scheduler. Netflix needed four internal services to cover that gap, and the arithmetic explains why.

Publishers:dev.to

Reality

Evidence28
Adoption24
Hype gap+32
Incentives52
Confidence34
buildOne report1 publisher

Iceberg votes to forbid new equality deletes in V4, and Parquet 1.18.0 lands with two corruption bugs

Two decisions made on public mailing lists this week change what a safe lakehouse upgrade plan looks like. Streaming writers and anyone queued behind Parquet 1.18.0 need to re-read their notes.

Publishers:dev.to

Reality

Evidence44
Adoption22
Hype gap+14
Incentives
Not scored
Confidence38
buildOne report1 publisher

Jumio's sub-100ms feature store is mostly a consistency build, not a speed build

AWS published the architecture behind Jumio's real-time feature store. Three of the four problems it starts from are about duplicated definitions and hand-copied code, not milliseconds.

Publishers:aws.amazon.com

Reality

Evidence44
Adoption38
Hype gap+22
Incentives82
Confidence52