Skip to content

Project

Apache Iceberg

Apache Iceberg is an open-source table format for large analytic datasets, letting multiple engines query and manage huge tables on object storage.

Known aliases

  • Apache Iceberg™
  • Iceberg
  • Iceberg 1.11.0
  • Iceberg v3

Current stories

buildOne report1 publisher

Iceberg 1.11.0 puts Spark, Flink and Hive file access behind one format registry

Iceberg 1.11.0 ships a File Format API that sends Spark, Flink, Hive and plain-Java reads and writes through one registry of format models. A dev.to walkthrough says the file format list stays fixed, so Vortex and Lance still need a change inside Iceberg.

Publishers:dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap−10
Incentives
Not scored
Confidence50
buildOne report1 publisher

RustFS puts an Iceberg REST catalog on the same port as its S3 API

RustFS embeds an Apache-2.0 Iceberg REST catalog in its object store and serves it on the S3 port, according to a dev.to walkthrough. Teams can drop a separate metastore, but catalog metadata then shares a failure domain with the data.

Publishers:dev.to

Reality

Evidence50
Adoption
Not scored
Hype gap−10
Incentives
Not scored
Confidence55
buildOne report1 publisher

Databricks' now-generally-available connector queries Workday HR and finance data in Workday's own storage

Databricks opened a public Beta of a Unity Catalog connector that queries Workday HR and finance data in place, without copying it. The company's own guidance keeps history-tracked reporting on its separate Lakeflow Connect ingestion path.

Publishers:databricks.com

Reality

Evidence35
Adoption12
Hype gap+15
Incentives85
Confidence40
buildConfirmed2 publishers

Spark and Athena can now read Redshift materialized views kept in Iceberg format

Amazon Web Services added Iceberg materialized views to Redshift, so a result Redshift computes once can be read by Spark and Athena, a dev.to write-up says. Teams that copy shared metrics between engines with ETL jobs can retire those jobs only if the views stay fresh enough for their readers.

Publishers:aws.amazon.com dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap+35
Incentives60
Confidence60
buildOne report1 publisher

Salesforce Data 360 injects a Spark listener plugin at its job gateway to find idle executors

Salesforce Data 360 instruments about eight million Spark runs a day at one submission gateway, without changing application code. The plugin fails open, so a broken collector leaves the platform team a data gap to chase while customer jobs keep running.

Reality

Evidence38
Adoption30
Hype gap+5
Incentives40
Confidence45
buildOne report1 publisher

Aurora's aurora_analytics extension prints DuckDB operators in its EXPLAIN output

A dev.to walkthrough found DuckDB's operator names in the EXPLAIN output of AWS's aurora_analytics extension, on a Parquet query that executed in 81 ms. That run hit a warm cache on one 500,000-row file, so it tells you which engine ran far more than how fast it will be on lake-scale data.

Publishers:dev.to

Reality

Evidence60
Adoption
Not scored
Hype gap+5
Incentives
Not scored
Confidence55
buildOne report1 publisher

Databricks adds UNREGISTER to Iceberg's REST catalog spec so a table can leave its catalog intact

Databricks says it added UNREGISTER to the Apache Iceberg REST catalog spec, so a table can change catalogs with zero files copied. A team can only use it if the catalog it is leaving implements the call, and the post demonstrates it on Unity Catalog.

Publishers:databricks.com

Reality

Evidence45
Adoption8
Hype gap+25
Incentives70
Confidence55
buildConfirmed3 publishers

Cloudflare folds Iceberg ingest, catalog and SQL on R2 into one GA product called Basin

Cloudflare made its Data Platform generally available as Basin, three serverless services that ingest, catalog and query Apache Iceberg tables on R2. Outside Iceberg engines read the same tables, so Workers teams can price Basin SQL against a warehouse on identical data.

Perspective Coverage

3 publishers
Builder
Builder 39%
Operator
Operator 38%
Investor
Investor 23%

Reality

Evidence55
Adoption25
Hype gap+25
Incentives75
Confidence60
buildOne report1 publisher

Iceberg's REST catalog gains a nine-action vocabulary for handing enforcement to trusted engines

Apache Iceberg's REST Catalog spec now lets a catalog return per-user row filters and nine column actions for a trusted engine to enforce, Databricks says. Policies that need subqueries or lookup tables do not fit that vocabulary, so the portability covers simple rules running on engines a deployment already trusts.

Publishers:databricks.com

Reality

Evidence40
Adoption10
Hype gap+15
Incentives70
Confidence45
buildOne report1 publisher

S3 Tables adds geometry, geography and nanosecond timestamps to complete its Iceberg V3 support

Amazon S3 Tables now supports every Apache Iceberg V3 data type after adding four, including geometry, geography and nanosecond timestamps. Telemetry and mapping teams can stop storing event times and coordinates as integers and strings.

Publishers:aws.amazon.com

Reality

Evidence45
Adoption
Not scored
Hype gap+20
Incentives75
Confidence60
buildOne report1 publisher

Apache Iceberg moved lock-in up to the catalog layer, an AWS Community Builder argues

AWS Community Builder Aki argues Apache Iceberg made data portable while permissions, auditing, lineage and sharing stay tied to each catalog. The spec leaves the atomic commit to each catalog, so the catalog is now the choice that is hard to reverse.

Publishers:dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap+10
Incentives30
Confidence50
buildOne report1 publisher

Most of pyiceberg's latency gap with the Rust Iceberg client sits in Python's HTTP library

Rust's Iceberg REST client ran up to 4.29x faster than pyiceberg on a local catalog, with 85% to 90% of the gap in Python's HTTP library. pyiceberg covers 21 of 25 tested endpoints to Rust's 13, so coverage settles the choice before speed does.

Publishers:dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap+5
Incentives
Not scored
Confidence50
buildOne report1 publisher

Apache Iceberg's Rust REST client reaches 13 of 25 catalog operations in a seven-catalog test

Apache Iceberg's Rust REST client, iceberg-catalog-rest 0.10.1, implements 13 of 25 tested catalog operations and logs in to five of seven catalogs. The two it cannot log in to are AWS Glue and S3 Tables, and reaching them from Rust means a different crate with a different operation set.

Publishers:dev.to

Reality

Evidence62
Adoption
Not scored
Hype gap+12
Incentives
Not scored
Confidence58
buildOne report1 publisher

A Bootstrap stylesheet in the docs folder sank Iceberg's first 1.12.0 candidate

Reviewers logged 10,991 passing tests on Iceberg's first 1.12.0 candidate before rejecting it over two vendored web files. The change most likely to break a downstream build is a removed partition-statistics helper.

Publishers:dev.to

Reality

Evidence60
Adoption35
Hype gap+12
Incentives
Not scored
Confidence58
buildOne report1 publisher

Choosing Iceberg over Snowflake moves six governance components onto your build list

Keeping the Iceberg table format governance-unaware was a deliberate call. That leaves the catalog as the only thing standing on the path of every read. A dev.to guide lists six pieces an operator has to source above it.

Publishers:dev.to

Reality

Evidence42
Adoption25
Hype gap+22
Incentives74
Confidence45
buildOne report1 publisher

Enforcing agent memory isolation at the storage prefix costs one dataset per user

A runnable two-agent example moves every refusal into the catalog that vends credentials, because a key covers a storage prefix and there are no rows at the point of enforcement. The author works on that catalog.

Publishers:dev.to

Reality

Evidence44
Adoption
Not scored
Hype gap+12
Incentives82
Confidence55
buildOne report1 publisher

Deleting one Parquet file from your own bucket corrupts Snowflake's Iceberg catalog

A dev.to post argues that Snowflake-managed Iceberg tables let you keep the managed engine while owning the Parquet in your own bucket. The same post says the catalog stays Snowflake's, and that 50,000-inserts-per-second ingest should not move.

Publishers:dev.to

Reality

Evidence28
Adoption
Not scored
Hype gap+45
Incentives40
Confidence52
buildOne report1 publisher

A Lambda transform lands blocked prompt injections in the same Athena catalog as CloudTrail

AWS has published a pipeline that pulls Bedrock guardrail traces out of model invocation logs, rewrites them as OCSF Detection Findings, and lands them in the CloudWatch store where analysts already query CloudTrail and VPC Flow Logs.

Publishers:aws.amazon.com

Reality

Evidence58
Adoption22
Hype gap+12
Incentives76
Confidence60

Earlier coverage

  1. AWS buys DuckDB's engineers; the Foundation keeps the license

    Build · August 26, 2026 · Confirmed2 publishers