版本发布 8
## What's Changed * Build: Bump software.amazon.awssdk:bom from 2.30.11 to 2.30.16 by @dependabot in https://github.com/apache/iceberg/pull/12208 * Build: Bump com.google.cloud:libraries-bom from 26.53.0 to 26.54.0 by @dependabot in https://github.com/apache/iceberg/pull/12207 * Build: Bump org.xerial:sqlite-jdbc from 3.48.0.0 to 3.49.0.0 by @dependabot in https://github.com/apache/iceberg/pull/12206 * Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4.1 to 5.4.2 by @dependabot in https://github.com/apache/iceberg/pull/12209 * Docs: Fix expire_snapshots output by @manuzhang in https://github.com/apache/iceberg/pull/12213 * Update LICENSE/NOTICE files with last dependency updates by @jbonofre in https://github.com/apache/iceberg/pull/12214 * Doc: update note about notebook in spark-quickstart by @xxchan in https://github.com/apache/iceberg/pull/11996 * Spec: Support geo type by @szehon-ho in https://github.com/apache/iceberg/pull/10981 * Build: skip scheduled docker image publish workflows on forks by @dramaticlly in https://github.com/apache/iceberg/pull/12218 * Docs: Add missing types to the spec v3 summary by @wgtmac in https://github.com/apache/iceberg/pull/12219 * Spec: Typo - missing be by @RussellSpitzer in https://github.com/apache/iceberg/pull/12229 * Docs: Site update for 1.8.0 release by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/12242 * spec: Remove `source-ids` for `V{1,2}` tables by @Fokko in https://github.com/apache/iceberg/pull/12161 * Build: Update revAPI to compare against 1.8.0 by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/12244 * Update release version to 1.8.0 in doap.rdf by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/12247 * Infra: Update Iceberg bug report template for 1.8.0 by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/12248 * Docs: Fix formatting of 1.8.0 release notes by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/12249 * Core: Adjust Jackson settings to handle large metadata json by @bryanck in https://github.com/apache/iceberg/pull/12224 * Build: Bump Hive to 2.3.10 by @nastra in https://github.com/apache/iceberg/pull/12253 * Build: Clean up dependencies by @nastra in https://github.com/apache/iceberg/pull/12252 * Core: Add InternalData read and write builders by @rdblue in https://github.com/apache/iceberg/pull/12060 * API, Core: Support default values in UpdateSchema by @rdblue in https://github.com/apache/iceberg/pull/12211 * update site to include iceberg summit link by @danicafine in https://github.com/apache/iceberg/pull/12256 * Core: Fix divide by zero when adjust split size by @hantangwangd in https://github.com/apache/iceberg/pull/12201 * Spark: Remove unused PruneColumnsWithReordering class by @rdblue in https://github.com/apache/iceberg/pull/12258 * Spark: Fix assertion checks by @nastra in https://github.com/apache/iceberg/pull/12255 * API: Deprecate NestedType.of in favor of builder by @rdblue in https://github.com/apache/iceberg/pull/12227 * Docker: Pin QEMU version temporarily by @ebyhr in https://github.com/apache/iceberg/pull/12262 * OpenAPI: Add RemoveSchemas REST update type by @gaborkaszab in https://github.com/apache/iceberg/pull/12022 * Minor: update Learn More to point to spark quickstart by @danicafine in https://github.com/apache/iceberg/pull/12272 * Build: Bump datamodel-code-generator from 0.27.2 to 0.28.1 by @manuzhang in https://github.com/apache/iceberg/pull/12290 * Spark 3.5: Fix job description of RewriteTablePathSparkAction by @ebyhr in https://github.com/apache/iceberg/pull/12282 * Build: Bump io.netty:netty-buffer from 4.1.117.Final to 4.1.118.Final by @dependabot in https://github.com/apache/iceberg/pull/12287 * Build: Bump software.amazon.awssdk:bom from 2.30.16 to 2.30.21 by @dependabot in https://github.com/apache/iceberg/pull/12286 * OpenAPI: Add overwrite option when registering an iceberg table by @dramaticlly in https://github.com/apache/iceberg/pull/12239 * Build: Bump mkdocs-material from 9.6.3 to 9.6.4 by @dependabot in https://github.com/apache/iceberg/pull/12284 * Core: Fix non-setting row-lineage from table properties on initial table creation by @tomtongue in https://github.com/apache/iceberg/pull/12307 * API: Reject unknown type for required fields and validate defaults by @rdblue in https://github.com/apache/iceberg/pull/12302 * API: Fix TestInclusiveMetricsEvaluator notStartsWith tests by @rdblue in https://github.com/apache/iceberg/pull/12303 * Core: add variant type support by @aihuaxu in https://github.com/apache/iceberg/pull/11831 * Fix CI: Update tests with `UnknownType` from `Required` to `Optional` by @Fokko in https://github.com/apache/iceberg/pull/12316 * Docs: Refactor site navigation bar by @manuzhang in https://github.com/apache/iceberg/pull/12289 * Parquet: Implement Variant readers by @rdblue in https://github.com/apache/iceberg/pull/12139 * Docs: Add rewrite-table-path in spark procedure by @dramaticlly in https://github.com/apache/iceberg/pull/12115 * Parquet: Fix errorprone warning by @ebyhr in https://github.com/apache/iceberg/pull/12324 * Docs: add apache amoro(incubating) with iceberg (#11965) by @czy006 in https://github.com/apache/iceberg/pull/11966 * Parquet: Fix performance regression in reader init by @bryanck in https://github.com/apache/iceberg/pull/12305 * Core: Fallback to GET requests for namespace/table/view exists checks by @nastra in https://github.com/apache/iceberg/pull/12314 * Fix: fix apache amoro ams doc pic ref by @czy006 in https://github.com/apache/iceberg/pull/12332 * Revert "Core: Serialize `null` when there is no current snapshot" by @Fokko in https://github.com/apache/iceberg/pull/12312 * [1.8.x] Parquet: Fix performance regression in reader init (#12305) by @nastra in https://github.com/apache/iceberg/pull/12329 * Checkstyle: Apply the same generic type naming rules to interfaces and classes by @pvary in https://github.com/apache/iceberg/pull/12333 * Kafka: Pin Kafka-Connect version to fix integration tests by @nastra in https://github.com/apache/iceberg/pull/12340 * Docs: Fix link of catalog in terms.md by @wangyinsheng in https://github.com/apache/iceberg/pull/12326 * Docs: Add documentation for Rate limiting in Spark Structured Streaming by @singhpk234 in https://github.com/apache/iceberg/pull/12217 * Spark 3.5: Fix Incorrect Spec Used With AddFiles Procedure by @RussellSpitzer in https://github.com/apache/iceberg/pull/12319 * Parquet: Remove deprecated VectorizedReader.setRowGroupInfo and ParquetValueReader.setPageSource by @ebyhr in https://github.com/apache/iceberg/pull/12321 * Bump versions in `{LICENSE,NOTICE}` by @Fokko in https://github.com/apache/iceberg/pull/12337 * Spark: Remove Spark 3.3 support by @manuzhang in https://github.com/apache/iceberg/pull/12279 * Core: Remove deprecated Util.blockLocations method and StructCopy class by @ebyhr in https://github.com/apache/iceberg/pull/12320 * Core: Handle partition evolution case in PartitionStatsUtil#computeStats by @deniskuzZ in https://github.com/apache/iceberg/pull/12137 * Core, Spark: Remove deprecated code for 1.9.0 by @nastra in https://github.com/apache/iceberg/pull/12336 * API: Move variant to API and add extract expression by @rdblue in https://github.com/apache/iceberg/pull/12304 * Core: Remove namespace/table/view HEAD endpoints from defaults by @nastra in https://github.com/apache/iceberg/pull/12351 * Nit: Remove additional 'Iceberg' in Puffin footer payload by @tomtongue in https://github.com/apache/iceberg/pull/12369 * API: Move Variant interfaces and serialized implementations to API by @rdblue in https://github.com/apache/iceberg/pull/12374 * Flink: Fix the comment error in SketchDataStatistics by @Guosmilesmile in https://github.com/apache/iceberg/pull/12375 * Core: Don't remove trailing slash from absolute paths by @adutra in https://github.com/apache/iceberg/pull/12389 * Build: Bump mkdocs-material from 9.6.4 to 9.6.5 by @dependabot in https://github.com/apache/iceberg/pull/12386 * Build: Bump org.xerial:sqlite-jdbc from 3.49.0.0 to 3.49.1.0 by @dependabot in https://github.com/apache/iceberg/pull/12385 * Build: Bump org.awaitility:awaitility from 4.2.2 to 4.3.0 by @dependabot in https://github.com/apache/iceberg/pull/12384 * Build: Bump nessie from 0.102.5 to 0.103.0 by @dependabot in https://github.com/apache/iceberg/pull/12383 * Build: Bump com.google.cloud:libraries-bom from 26.54.0 to 26.55.0 by @dependabot in https://github.com/apache/iceberg/pull/12382 * Build: Bump testcontainers from 1.20.4 to 1.20.5 by @dependabot in https://github.com/apache/iceberg/pull/12380 * Build: Bump software.amazon.awssdk:bom from 2.30.21 to 2.30.26 by @dependabot in https://github.com/apache/iceberg/pull/12379 * Spec: Allow Equality Deletes with Row Lineage and Define Behavior by @RussellSpitzer in https://github.com/apache/iceberg/pull/12230 * Core: Add "volatile" to HadoopFileIO#hadoopConf by @okumin in https://github.com/apache/iceberg/pull/12388 * Arrow, Parquet, Spark 3.5, Flink 1.20: Avoid deprecated method by @ebyhr in https://github.com/apache/iceberg/pull/11874 * Docs: Add Stackable to the Vendors page by @lfrancke in https://github.com/apache/iceberg/pull/12344 * Build: Upgrade to Gradle 8.13 by @jbonofre in https://github.com/apache/iceberg/pull/12398 * Kafka Connect: Add SMTs for Debezium and AWS DMS by @ismailsimsek in https://github.com/apache/iceberg/pull/11936 * API, Core: Update inclusive metrics evaluator for extract and transforms by @rdblue in https://github.com/apache/iceberg/pull/12311 * Build: remove Hadoop 2 dependency by @Kontinuation in https://github.com/apache/iceberg/pull/12348 * View Spec: Fix typo by @ajantha-bhat in https://github.com/apache/iceberg/pull/12405 * Fix grammar issues in descriptions about Hive environment in hive-quickstart.md by @wenxin-cn in https://github.com/apache/iceberg/pull/12402 * [hive]:Fix Hive table creation syntax errors by @qining-mj in https://github.com/apache/iceberg/pull/12394 * Core: Interface changes for separating rewrite planner and runner by @pvary in https://github.com/apache/iceberg/pull/12306 * Docs: Describe how to handle versioned docs/javadoc during a release by @nastra in https://github.com/apache/iceberg/pull/12413 * Spark: Bump Spark 3.5 to 3.5.5 by @manuzhang in https://github.com/apache/iceberg/pull/12396 * Docs: Remove Hive runtime jar link from latest release by @manuzhang in https://github.com/apache/iceberg/pull/12422 * Docs: Site updates for 1.8.1 by @nastra in https://github.com/apache/iceberg/pull/12410 * Infra: Update Bug report template for 1.8.1 by @nastra in https://github.com/apache/iceberg/pull/12409 * Update release version to 1.8.1 in doap.rdf by @nastra in https://github.com/apache/iceberg/pull/12408 * Build: Ignore docker folder in CI by @manuzhang in https://github.com/apache/iceberg/pull/12417 * Fix IndexOutOfBounds exception in FileFormat#fromFileName by @rshkv in https://github.com/apache/iceberg/pull/12301 * Core: Print un-pretty metadata files without whitespace by @istreeter in https://github.com/apache/iceberg/pull/12318 * Core: Code cleanup around TestTable and TestTableOperations by @gaborkaszab in https://github.com/apache/iceberg/pull/12419 * Data: Add partition stats writer and reader by @ajantha-bhat in https://github.com/apache/iceberg/pull/11216 * Azure: Move docker-based tests to integrationTest by @anuragmantri in https://github.com/apache/iceberg/pull/12274 * spec: fix the wrong example in Geo Types by @jiayuasu in https://github.com/apache/iceberg/pull/12421 * Docs: Fix link of ndv in spark-procedures.md by @wangyinsheng in https://github.com/apache/iceberg/pull/12425 * Build: Bump mkdocs-material from 9.6.5 to 9.6.6 by @dependabot in https://github.com/apache/iceberg/pull/12432 * Build: Ignore README.md/LICENSE/NOTICE in all paths on CI by @manuzhang in https://github.com/apache/iceberg/pull/12429 * Build: Bump org.openapitools:openapi-generator-gradle-plugin from 7.11.0 to 7.12.0 by @dependabot in https://github.com/apache/iceberg/pull/12435 * Build: Bump datamodel-code-generator from 0.28.1 to 0.28.2 by @dependabot in https://github.com/apache/iceberg/pull/12433 * Build: Bump org.mongodb:bson from 4.11.0 to 4.11.5 by @dependabot in https://github.com/apache/iceberg/pull/12438 * Build: Bump slf4j from 2.0.16 to 2.0.17 by @dependabot in https://github.com/apache/iceberg/pull/12436 * Build: Bump jackson-bom from 2.18.2 to 2.18.3 by @dependabot in https://github.com/apache/iceberg/pull/12434 * Fix typo in delete statement: change database name from "dbl" to "db" in spark-writes.md by @wenxin-cn in https://github.com/apache/iceberg/pull/12426 * Build: Bump io.netty:netty-buffer from 4.1.118.Final to 4.1.119.Final by @dependabot in https://github.com/apache/iceberg/pull/12440 * Build: Bump net.snowflake:snowflake-jdbc from 3.22.0 to 3.23.0 by @dependabot in https://github.com/apache/iceberg/pull/12437 * Docs: Deprecate data_file.distinct_counts in v3 by @jacobmarble in https://github.com/apache/iceberg/pull/12182 * Core: Change RemoveSnapshots to remove unused schemas by @gaborkaszab in https://github.com/apache/iceberg/pull/12089 * Core: Add Variant logical type for Avro by @aihuaxu in https://github.com/apache/iceberg/pull/12238 * Spark: Infer partition spec in ADD_FILES procedure for FileTables than taking latest table spec by @bharos in https://github.com/apache/iceberg/pull/12327 * Avro: Support timestamp(9) and unknown types by @rdblue in https://github.com/apache/iceberg/pull/12455 * Wrap variant in PrimitiveHoder so serialization can result same instance by @aihuaxu in https://github.com/apache/iceberg/pull/12317 * Core: Ensure current and newly added view versions are retained in ViewMetadata build by @lliangyu-lin in https://github.com/apache/iceberg/pull/12401 * support create table like in flink catalog by @swapna267 in https://github.com/apache/iceberg/pull/12199 * Parquet: Implement Variant writers by @rdblue in https://github.com/apache/iceberg/pull/12323 * Core: Write `null` for `current-snapshot-id` for V3+ by @Fokko in https://github.com/apache/iceberg/pull/12335 * Spec: Add implementation note on `current-snapshot-id` by @Fokko in https://github.com/apache/iceberg/pull/12334 * Core: Don't create empty RemovePartitionSpecs MetadataUpdate by @gaborkaszab in https://github.com/apache/iceberg/pull/12465 * Data: Expose snapshot-id instead of branch for computing partition stats by @ajantha-bhat in https://github.com/apache/iceberg/pull/12464 * Parquet: Support unknown and timestamp(9) in generics and internal model by @rdblue in https://github.com/apache/iceberg/pull/12463 * Core: Provide access to format-version of metadata table by @nastra in https://github.com/apache/iceberg/pull/12462 * Site: Fix Footer Link by @RussellSpitzer in https://github.com/apache/iceberg/pull/12478 * Docs: fix typo in rest-catalog-open-api.yaml. by @slfan1989 in https://github.com/apache/iceberg/pull/12480 * Build: Bump software.amazon.awssdk:bom from 2.30.26 to 2.30.31 by @dependabot in https://github.com/apache/iceberg/pull/12439 * Build: Bump mkdocs-material from 9.6.6 to 9.6.7 by @dependabot in https://github.com/apache/iceberg/pull/12483 * Build: Bump com.gorylenko.gradle-git-properties:gradle-git-properties from 2.4.2 to 2.5.0 by @dependabot in https://github.com/apache/iceberg/pull/12486 * Build: Rename versions.spark.hive3* to versions.spark3* by @pan3793 in https://github.com/apache/iceberg/pull/12489 * Build: Bump testcontainers from 1.20.5 to 1.20.6 by @dependabot in https://github.com/apache/iceberg/pull/12484 * Core: Apply correct metric configs in GenericAppenderFactory by @XBaith in https://github.com/apache/iceberg/pull/12366 * Add unit test for AddFilesProcedure to check invalid column in partition filter by @bharos in https://github.com/apache/iceberg/pull/12456 * Adds AWS to vendors page by @rbowen in https://github.com/apache/iceberg/pull/12468 * Spark: Rewrite V2 deletes to V3 DVs by @nastra in https://github.com/apache/iceberg/pull/12250 * Docs: Update Iceberg talks with recent Iceberg meetup sessions by @sida-shen in https://github.com/apache/iceberg/pull/12481 * AWS: Integrate S3 analytics accelerator library by @SanjayMarreddi in https://github.com/apache/iceberg/pull/12299 * AWS: Don't fetch credential from endpoint if properties contain a valid credential by @nastra in https://github.com/apache/iceberg/pull/12504 * Revert "OpenAPI: Handle NamespaceNotEmptyException when dropping a namespace" by @nastra in https://github.com/apache/iceberg/pull/12517 * AWS: Update S3 async client configurations and docs for analytics-accelerator-s3 by @SanjayMarreddi in https://github.com/apache/iceberg/pull/12503 * Make reporter() method public so that it can be accessed by Trino for BaseTable creation by @puchengy in https://github.com/apache/iceberg/pull/12519 * Migrate Spark 3.4 test base to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/12501 * Core: Fix support for GenericManifestFile index projection by @danielcweeks in https://github.com/apache/iceberg/pull/12522 * Core: Set missing table-default property in RESTSessionCatalog by @ebyhr in https://github.com/apache/iceberg/pull/11646 * Core: Fix default and initial value handling on table creation by @pvary in https://github.com/apache/iceberg/pull/12520 * Core: Don't expose InMemoryViewOperations and RESTViewBuilder outside their visibility scope by @nastra in https://github.com/apache/iceberg/pull/12524 * Kafka Connect: Add config for transactional ID prefix by @thjaeckle in https://github.com/apache/iceberg/pull/11780 * Kafka Connect: Handle no coordinator and data loss in ICR mode by @kumarpritam863 in https://github.com/apache/iceberg/pull/12372 * Core: Use `buildKeepingLast` for table properties in REST table builder by @smaheshwar-pltr in https://github.com/apache/iceberg/pull/12526 * Flink 1.20: Support Avro and Parquet timestamp(9), unknown, and defaults by @rdblue in https://github.com/apache/iceberg/pull/12470 * Spark 3.4: Backport partition spec inference in spark ADD_FILES procedure by @bharos in https://github.com/apache/iceberg/pull/12508 * Flink 1.18, 1.19: Implement timestamp(9), unknown, and defaults by @rdblue in https://github.com/apache/iceberg/pull/12532 * Build: Bump mkdocs-material from 9.6.7 to 9.6.8 by @dependabot in https://github.com/apache/iceberg/pull/12542 * Build: Bump datamodel-code-generator from 0.28.2 to 0.28.4 by @dependabot in https://github.com/apache/iceberg/pull/12541 * Core: Add missing table-override property to REST catalog by @ebyhr in https://github.com/apache/iceberg/pull/12548 * Spark: Call configureTable in ScanTestBase to ensure proper table configuration by @drexler-sky in https://github.com/apache/iceberg/pull/12546 * AWS, Core, GCP: Auth Manager API enablement by @adutra in https://github.com/apache/iceberg/pull/12197 * Core: fix "Unclosed S3FileIO" warning in JdbcCatalog by @rcjverhoef in https://github.com/apache/iceberg/pull/12540 * Migrate Spark 3.4 TestBase related tests in spark and actions by @tomtongue in https://github.com/apache/iceberg/pull/12552 * API: Implement Variant#toString by @rdblue in https://github.com/apache/iceberg/pull/12531 * Avro: Add variant readers and writers by @rdblue in https://github.com/apache/iceberg/pull/12457 * Core: Add `view-override` catalog property by @ebyhr in https://github.com/apache/iceberg/pull/12534 * Kafka: Suppress warnings around java.util.Date usage / fix var names by @nastra in https://github.com/apache/iceberg/pull/12561 * REST: HTTPRequest.baseUri() should be nullable by @adutra in https://github.com/apache/iceberg/pull/12556 * Parquet, Core: Enable passing Variant tests by @rdblue in https://github.com/apache/iceberg/pull/12559 * Core: JDBCCatalog's dropView() should purge metadata files if GC is enabled by @hsiang-c in https://github.com/apache/iceberg/pull/12511 * Core, Spark 3.5: Apply Ignore Residuals to Delete Filtering by @RussellSpitzer in https://github.com/apache/iceberg/pull/12479 * Core: Make totalRecordCount optional in PartitionStats by @ajantha-bhat in https://github.com/apache/iceberg/pull/12226 * Core: Replace withFailMessage() with as() by @nastra in https://github.com/apache/iceberg/pull/12570 * Spark: Improve assertions for better debuggability by @nastra in https://github.com/apache/iceberg/pull/12569 * Docs: Update statements mentioning Hive's alpha/beta versions by @okumin in https://github.com/apache/iceberg/pull/12430 * Infra: Update Bug report template for 1.7.2 by @nastra in https://github.com/apache/iceberg/pull/12574 * docs: update go impl status by @zeroshade in https://github.com/apache/iceberg/pull/12578 * Core: Use InternalData when reading manifests in FileCleanupStrategy by @nastra in https://github.com/apache/iceberg/pull/12575 * Docs: Site updates for 1.7.2 by @jbonofre in https://github.com/apache/iceberg/pull/12576 * ORC: Support timestamp(9), variant, and unknown in generics by @rdblue in https://github.com/apache/iceberg/pull/12567 * Flink: Support source watermark for flink sql windows by @swapna267 in https://github.com/apache/iceberg/pull/12191 * Spark: Detect dangling DVs properly by @nastra in https://github.com/apache/iceberg/pull/12270 * OpenAPI: Handle NamespaceNotEmptyException when dropping a namespace by @nastra in https://github.com/apache/iceberg/pull/12518 * Spark: Use correct statistics file in SparkScan::estimateStatistics(Snapshot) by @wypoon in https://github.com/apache/iceberg/pull/12482 * Flink: fix read config of connector.iceberg.max-allowed-planning-failures by @Guosmilesmile in https://github.com/apache/iceberg/pull/12585 * Flink: backport for fix read config of connector.iceberg.max-allowed-planning-failures to 1.18 and 1.19 by @Guosmilesmile in https://github.com/apache/iceberg/pull/12589 * Core: Use InternalData with avro for readers. by @danielcweeks in https://github.com/apache/iceberg/pull/12476 * Core, Parquet, ORC: Fix missing data when writing unknown by @rdblue in https://github.com/apache/iceberg/pull/12581 * Core: Handle NamespaceNotEmptyException in NamespaceErrorHandler by @nastra in https://github.com/apache/iceberg/pull/12505 * Spark 3.4: Read DVs when reading from .position_deletes table / Include content offset/size by @nastra in https://github.com/apache/iceberg/pull/12599 * Migrate Spark 3.4 TestBase-related remaining tests in actions by @tomtongue in https://github.com/apache/iceberg/pull/12579 * Spark 3.4: Test metadata tables with format-version=v3 / add ExtensionsTestBase by @nastra in https://github.com/apache/iceberg/pull/12600 * Core: Bulk deletion in RemoveSnapshots by @gaborkaszab in https://github.com/apache/iceberg/pull/11837 * Spark: Backport Spark 3.5 DVs related part to Spark 3.4 by @tomtongue in https://github.com/apache/iceberg/pull/12603 * Parquet: Implement Variant metrics by @rdblue in https://github.com/apache/iceberg/pull/12496 * Spark 3.4: Rewrite data files with high delete ratio by @nastra in https://github.com/apache/iceberg/pull/12601 * Spark 3.4: Rewrite V2 deletes to V3 DVs / Detect dangling DVs properly by @nastra in https://github.com/apache/iceberg/pull/12606 * Build: Bump mkdocs-material from 9.6.8 to 9.6.9 by @dependabot in https://github.com/apache/iceberg/pull/12614 * Build: Bump nessie from 0.103.0 to 0.103.2 by @dependabot in https://github.com/apache/iceberg/pull/12615 * Spec: Geo spec simplifications by @szehon-ho in https://github.com/apache/iceberg/pull/12533 * Spark 3.5: Adjust repeated INFO logs to DEBUG in SparkWrite and SparkPositionDeltaWrite by @manuzhang in https://github.com/apache/iceberg/pull/12404 * Spark 3.4: Backport Spark actions changes in Spark rewrite_table_path procedure (#12006 #12172 #11929 #12282 #12569) by @slfan1989 in https://github.com/apache/iceberg/pull/12568 * Core: Add update event for rewrite manifests by @bryanck in https://github.com/apache/iceberg/pull/12627 * Build: Enforce error message check on Exception assertions by @lliangyu-lin in https://github.com/apache/iceberg/pull/12624 * Build: Bump com.google.errorprone:error_prone_annotations from 2.36.0 to 2.37.0 by @dependabot in https://github.com/apache/iceberg/pull/12622 * Core: Add commit metrics for rewriting manifests by @nastra in https://github.com/apache/iceberg/pull/12630 * Data: Refactor PartitionStatsHandler by @ajantha-bhat in https://github.com/apache/iceberg/pull/12550 * Spark 3.4: Propagate snapshot properties / Add max allowed failed commits by @nastra in https://github.com/apache/iceberg/pull/12632 * Docs: Fix lifecycle and versions in multi-engine-support by @manuzhang in https://github.com/apache/iceberg/pull/12370 * Build: Bump parquet from 1.15.0 to 1.15.1 by @dependabot in https://github.com/apache/iceberg/pull/12616 * Build: Bump calcite from 1.10.0 to 1.39.0 by @dependabot in https://github.com/apache/iceberg/pull/12617 * Added New Blog Post: Loading Data into Apache Iceberg by @SourabhEstuary in https://github.com/apache/iceberg/pull/12587 * Core: Add option to fallback to thread classloader by @bryanck in https://github.com/apache/iceberg/pull/12613 * Core: child HTTPClient should not close shared resources by @adutra in https://github.com/apache/iceberg/pull/12566 * API, Core: Add geometry and geography types support by @Kontinuation in https://github.com/apache/iceberg/pull/12346 * AWS: fix incorrect parent session when calling delegate auth manager by @adutra in https://github.com/apache/iceberg/pull/12582 * Docs: Update block spacing guideline in contribute.md by @ajantha-bhat in https://github.com/apache/iceberg/pull/12641 * Docs: Fix ASF sponsorship links by @manuzhang in https://github.com/apache/iceberg/pull/12646 * Spark 3.4: Migrate SparkRowLevelOperationsTestBase related tests to JUnit 5 by @tomtongue in https://github.com/apache/iceberg/pull/12656 * Spark 3.4 : Use correct statistics file in SparkScan::estimateStatistics(Snapshot) by @jeesou in https://github.com/apache/iceberg/pull/12647 * Core: Enhance TestRemoveSnapshots by @manuzhang in https://github.com/apache/iceberg/pull/12662 * update status page for pyiceberg as of 0.9.0 by @kevinjqliu in https://github.com/apache/iceberg/pull/12645 * Build: Bump jetty from 11.0.24 to 11.0.25 by @dependabot in https://github.com/apache/iceberg/pull/12618 * Docs: Fix Latest Iceberg Support version of Hive by @manuzhang in https://github.com/apache/iceberg/pull/12640 * Azure: Support vended credentials refresh in ADLSFileIO. by @ChaladiMohanVamsi in https://github.com/apache/iceberg/pull/11577 * Build: Revert AWS SDK from 2.30.31 to 2.29.52 by @ajantha-bhat in https://github.com/apache/iceberg/pull/12649 * AWS: Use assertThat instead of JUnit4 assertions by @nastra in https://github.com/apache/iceberg/pull/12668 * GCP: Use catalog endpoint as base when refreshing OAuth2 token by @nastra in https://github.com/apache/iceberg/pull/12638 * Core: Cleanup unit tests by @sullis in https://github.com/apache/iceberg/pull/12666 * Core: FileRewritePlanner implementation by @pvary in https://github.com/apache/iceberg/pull/12493 * Flink: backport support create table like in flink catalog by @swapna267 in https://github.com/apache/iceberg/pull/12679 * Doc: Update Instructions for rewrite_table_path. by @slfan1989 in https://github.com/apache/iceberg/pull/12628 * Spark, API: Enhance hashing efficiency by operating on raw UTF-8 bytes by @xiaoxuandev in https://github.com/apache/iceberg/pull/12657 * Build: Bump datamodel-code-generator from 0.28.4 to 0.28.5 by @dependabot in https://github.com/apache/iceberg/pull/12683 * Docs: Update link for User-Defined Tag Restrictions in AWS documentation by @XBaith in https://github.com/apache/iceberg/pull/12698 * Build: Bump com.palantir.gradle.gitversion:gradle-git-version from 3.1.0 to 3.2.0 by @dependabot in https://github.com/apache/iceberg/pull/12687 * Build: Bump com.google.cloud:libraries-bom from 26.55.0 to 26.58.0 by @dependabot in https://github.com/apache/iceberg/pull/12688 * AWS: Fix Catalog URI within VendedCredentialsProvider by @wolflex888 in https://github.com/apache/iceberg/pull/12612 * Core: Add MetricsReporter for SnapshotManager by @wangyinsheng in https://github.com/apache/iceberg/pull/12665 * Spark 3.5: Fix RewriteDataFiles with partial progress enabled and max-failed-commits larger than total-file-group by @manuzhang in https://github.com/apache/iceberg/pull/12120 * Use delimited column names in CreateChangelogViewProcedure by @andyglow in https://github.com/apache/iceberg/pull/12418 * Flink: Backport support source watermark for flink sql windows by @swapna267 in https://github.com/apache/iceberg/pull/12697 * Spark 3.4: Fix RewriteDataFiles with partial progress enabled and max-failed-commits larger than total-file-group by @manuzhang in https://github.com/apache/iceberg/pull/12701 * Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4.2 to 5.4.3 by @dependabot in https://github.com/apache/iceberg/pull/12685 * Build: Bump guava from 33.4.0-jre to 33.4.6-jre by @dependabot in https://github.com/apache/iceberg/pull/12686 * Core: Pass storage credentials from LoadTableResponse to FileIO by @nastra in https://github.com/apache/iceberg/pull/12591 * AWS: Update the aws-bundle with latest dependencies by @SanjayMarreddi in https://github.com/apache/iceberg/pull/12553 * Core, Hive: Double check commit status in case of commit conflict for NoLock by @lirui-apache in https://github.com/apache/iceberg/pull/12637 * Spark 3.4: Fix NotSerializableException when migrating Spark tables by @manuzhang in https://github.com/apache/iceberg/pull/12705 * Doc: Remove Warning for resolved issue #11147. by @slfan1989 in https://github.com/apache/iceberg/pull/12694 * Flink: Backport avoid RANGE mode broken chain when write parallelism changes by @huyuanfeng2018 in https://github.com/apache/iceberg/pull/12080 * Updated vendors documentation to add SingleStore by @akoller in https://github.com/apache/iceberg/pull/12708 * Spec: update to reflect lineage is required by @danielcweeks in https://github.com/apache/iceberg/pull/12580 * Core: Enhance remove snapshots efficiency by executing them in bulk by @ricardopereira33 in https://github.com/apache/iceberg/pull/12670 * Core: Update deprecation msg by @nastra in https://github.com/apache/iceberg/pull/12720 * AWS: Add AWS integ tests to check task and enable tests based on required environment variables by @lliangyu-lin in https://github.com/apache/iceberg/pull/12671 * Core, Spark: Add row lineage metadata columns, and surface them in SparkTable metadata columns by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/12596 * Build: Bump mkdocs-material from 9.6.9 to 9.6.11 by @dependabot in https://github.com/apache/iceberg/pull/12728 * Build: Bump io.delta:delta-standalone_2.12 from 3.3.0 to 3.3.1 by @dependabot in https://github.com/apache/iceberg/pull/12731 * Build: Bump net.snowflake:snowflake-jdbc from 3.23.0 to 3.23.2 by @dependabot in https://github.com/apache/iceberg/pull/12732 * Flink: Backport RowConverter to Flink 1.19 and 1.18 by @Guosmilesmile in https://github.com/apache/iceberg/pull/12713 * Flink: Fix npe in SketchUtil when numPartitions bigger than length of samples by @Guosmilesmile in https://github.com/apache/iceberg/pull/12703 * Core: Lazy init workerPool in RemoveSnapshots and SnapshotProducer by @abstractdog in https://github.com/apache/iceberg/pull/12427 * Flink: Backport Typeinfo in RowConverter to Flink 1.19 and 1.18 by @Guosmilesmile in https://github.com/apache/iceberg/pull/12739 * Hive: Refactor HMS table parameter setting to be able to reuse by @zratkai in https://github.com/apache/iceberg/pull/12461 * Flink:Backport fix npe in SketchUtil to Flink 1.19 and 1.18 by @Guosmilesmile in https://github.com/apache/iceberg/pull/12741 * Core: Enable row lineage for all v3 tables by @rdblue in https://github.com/apache/iceberg/pull/12593 * Migrate Spark 3.4 ExtensionsTestBase-related tests by @tomtongue in https://github.com/apache/iceberg/pull/12744 * Build: Bump io.delta:delta-spark_2.12 from 3.3.0 to 3.3.1 by @dependabot in https://github.com/apache/iceberg/pull/12729 * Doc: Remove Hive 2.x/3.x related docs in hive.md by @jackylee-ch in https://github.com/apache/iceberg/pull/12700 * Core: Return this instead of null in enableRowLineage() by @nastra in https://github.com/apache/iceberg/pull/12747 * Core: Drop invalid function comment for HTTPClient.isSuccessful by @gaborkaszab in https://github.com/apache/iceberg/pull/12742 * CORE: Allow HTTPClient to parse headers from properties. by @wolflex888 in https://github.com/apache/iceberg/pull/12595 * Throw on `{write.folder-storage.path,write.object-storage.path}` properties by @Fokko in https://github.com/apache/iceberg/pull/12315 * Build: Bump io.netty:netty-buffer from 4.1.119.Final to 4.2.0.Final by @dependabot in https://github.com/apache/iceberg/pull/12730 * API: Deprecate CredentialSupplier by @nastra in https://github.com/apache/iceberg/pull/12763 * AWS: Add unit tests for AWS s3Async by @sullis in https://github.com/apache/iceberg/pull/12758 * Build: Bump com.google.cloud:libraries-bom from 26.58.0 to 26.59.0 by @dependabot in https://github.com/apache/iceberg/pull/12733 * Upgrades Flink Version to 1.19.2 and 1.20.1 by @rodmeneses in https://github.com/apache/iceberg/pull/12745 * Update hive-quickstart.md by @mollonado in https://github.com/apache/iceberg/pull/12746 * Flink: fix rateLimit argument check in TableMaintenance by @Guosmilesmile in https://github.com/apache/iceberg/pull/12773 * Flink: backport fix rateLimit argument check in TableMaintenance to Flink 1.19 by @Guosmilesmile in https://github.com/apache/iceberg/pull/12776 * Docs: Add Estuary to docs and vendors by @aeluce in https://github.com/apache/iceberg/pull/12764 * Core: Update RewriteFiles tests to test against V3 by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/12777 * Migrate Spark 3.4 ExtensionsTestBase-related tests for Partition, Schema and Branch/Tag by @tomtongue in https://github.com/apache/iceberg/pull/12766 * Build: Bump guava from 33.4.6-jre to 33.4.7-jre by @dependabot in https://github.com/apache/iceberg/pull/12789 * Build: Bump nessie from 0.103.2 to 0.103.3 by @dependabot in https://github.com/apache/iceberg/pull/12786 * Core: Use OutputFile.location(), InputFile.location() in Error Messages by @Jordano-Dremio in https://github.com/apache/iceberg/pull/12755 * Flink: Move unlock from MemoryLock open to TestCase Before by @Guosmilesmile in https://github.com/apache/iceberg/pull/12793 * Flink: backport #12793 to Flink 1.19 by @Guosmilesmile in https://github.com/apache/iceberg/pull/12795 * Build: Bump junit to 5.12.2 by @iProdigy in https://github.com/apache/iceberg/pull/12391 * Flink: Fix TriggerManager to unlock task execution when previous job left an orphaned lock by @Guosmilesmile in https://github.com/apache/iceberg/pull/12794 * Flink: backport fix TriggerManager to unlock task execution when previous job left an orphaned lock for Flink 1.19 by @Guosmilesmile in https://github.com/apache/iceberg/pull/12801 * Flink: fix parameters for test recovery by @Guosmilesmile in https://github.com/apache/iceberg/pull/12800 * Spark 3.4: Migrate integration test to JUnit5 by @nastra in https://github.com/apache/iceberg/pull/12796 * CatalogTests: Fix listNamespaces Check, Avoid Reserved Keyword, Allow Configurable Location by @talatuyarer in https://github.com/apache/iceberg/pull/12768 * Update the docs for working with Flink and REST catalog by @dttung2905 in https://github.com/apache/iceberg/pull/12726 * Migrate Spark 3.4 ExtensionsTestBase-related tests for Snapshot manipulation, ChangeLogView and Distribution/Ordering by @tomtongue in https://github.com/apache/iceberg/pull/12807 * Core: Fix deprecated FileSystem.isDirectory warning and remove redundant test code by @ebyhr in https://github.com/apache/iceberg/pull/12805 * Core: Test loading table/view with non-existing namespace by @nastra in https://github.com/apache/iceberg/pull/12812 * Doc: Fix typo in spark-procedures.md by @slfan1989 in https://github.com/apache/iceberg/pull/12814 * Spark 3.4: Migrate ExtensionsTestBase-related remaining tests by @tomtongue in https://github.com/apache/iceberg/pull/12813 * Docs: Add the recommended style for ArrayAssertions by @tomtongue in https://github.com/apache/iceberg/pull/12820 * Spark 3.5: Use ProcedureInput for SnapshotTableProcedure. by @slfan1989 in https://github.com/apache/iceberg/pull/12783 * Spark 3.5: Use ProcedureInput for MigrateTableProcedure. by @slfan1989 in https://github.com/apache/iceberg/pull/12782 * Fix versions in LICENSE and NOTICE by @jbonofre in https://github.com/apache/iceberg/pull/12831 * Spark3.4: Backport ProcedureInput for MigrateTableProcedure And SnapshotTableProcedure (#12782 #12783) by @slfan1989 in https://github.com/apache/iceberg/pull/12837 * Core: Support first-row-id for manifests and manifest lists by @rdblue in https://github.com/apache/iceberg/pull/12672 * Site: Remove Iceberg Summit Link from the Homepage by @RussellSpitzer in https://github.com/apache/iceberg/pull/12842 * Core: use ALL_VERSIONS constant in TestBase by @sullis in https://github.com/apache/iceberg/pull/12748 * Spec: Update row lineage requirements for upgrading tables by @rdblue in https://github.com/apache/iceberg/pull/12781 * Flink: Add StreamingStartingStrategy.INCREMENTAL_FROM_LATEST_SNAPSHOT_EXCLUSIVE by @morhidi in https://github.com/apache/iceberg/pull/12839 * Spark: Add _row_id and _last_updated_sequence_number readers by @rdblue in https://github.com/apache/iceberg/pull/12836 * spec: Variant lower/upper bounds by @aihuaxu in https://github.com/apache/iceberg/pull/12658 * API: Use normalized JSON path to identify Variant fields by @rdblue in https://github.com/apache/iceberg/pull/12835 * Core: Add test cases for row lineage metadata by @rdblue in https://github.com/apache/iceberg/pull/12843 * Spark 3.5: Add Parallelism Parameter Validation to AddFilesProcedure. by @slfan1989 in https://github.com/apache/iceberg/pull/12784 * Spec: Allow the use of `source-id` in V3 by @Fokko in https://github.com/apache/iceberg/pull/12644 * Core: Use assumeThat instead of assumeTrue by @slfan1989 in https://github.com/apache/iceberg/pull/12822 * Spark3.4: Migrate tests in spark, extensions and functions by @tomtongue in https://github.com/apache/iceberg/pull/12853 * API: Don't check underlying error msg on AIOOBE by @nastra in https://github.com/apache/iceberg/pull/12867 ## New Contributors * @danicafine made their first contribution in https://github.com/apache/iceberg/pull/12256 * @czy006 made their first contribution in https://github.com/apache/iceberg/pull/11966 * @lfrancke made their first contribution in https://github.com/apache/iceberg/pull/12344 * @wenxin-cn made their first contribution in https://github.com/apache/iceberg/pull/12402 * @qining-mj made their first contribution in https://github.com/apache/iceberg/pull/12394 * @istreeter made their first contribution in https://github.com/apache/iceberg/pull/12318 * @jiayuasu made their first contribution in https://github.com/apache/iceberg/pull/12421 * @bharos made their first contribution in https://github.com/apache/iceberg/pull/12327 * @swapna267 made their first contribution in https://github.com/apache/iceberg/pull/12199 * @XBaith made their first contribution in https://github.com/apache/iceberg/pull/12366 * @rbowen made their first contribution in https://github.com/apache/iceberg/pull/12468 * @sida-shen made their first contribution in https://github.com/apache/iceberg/pull/12481 * @SanjayMarreddi made their first contribution in https://github.com/apache/iceberg/pull/12299 * @thjaeckle made their first contribution in https://github.com/apache/iceberg/pull/11780 * @kumarpritam863 made their first contribution in https://github.com/apache/iceberg/pull/12372 * @drexler-sky made their first contribution in https://github.com/apache/iceberg/pull/12546 * @SourabhEstuary made their first contribution in https://github.com/apache/iceberg/pull/12587 * @ChaladiMohanVamsi made their first contribution in https://github.com/apache/iceberg/pull/11577 * @wolflex888 made their first contribution in https://github.com/apache/iceberg/pull/12612 * @andyglow made their first contribution in https://github.com/apache/iceberg/pull/12418 * @akoller made their first contribution in https://github.com/apache/iceberg/pull/12708 * @ricardopereira33 made their first contribution in https://github.com/apache/iceberg/pull/12670 * @abstractdog made their first contribution in https://github.com/apache/iceberg/pull/12427 * @zratkai made their first contribution in https://github.com/apache/iceberg/pull/12461 * @jackylee-ch made their first contribution in https://github.com/apache/iceberg/pull/12700 * @mollonado made their first contribution in https://github.com/apache/iceberg/pull/12746 * @aeluce made their first contribution in https://github.com/apache/iceberg/pull/12764 * @Jordano-Dremio made their first contribution in https://github.com/apache/iceberg/pull/12755 * @iProdigy made their first contribution in https://github.com/apache/iceberg/pull/12391 * @talatuyarer made their first contribution in https://github.com/apache/iceberg/pull/12768 * @dttung2905 made their first contribution in https://github.com/apache/iceberg/pull/12726 * @morhidi made their first contribution in https://github.com/apache/iceberg/pull/12839 **Full Changelog**: https://github.com/apache/iceberg/compare/apache-iceberg-1.8.0...apache-iceberg-1.9.0
## What's Changed * 1.7.x cherry pick #11526 by @bryanck in https://github.com/apache/iceberg/pull/11629 * [1.7] Revert "Support WASB scheme in ADLSFileIO" by @mrcnc in https://github.com/apache/iceberg/pull/11817 * Core, Spark, Flink, Hive: Remove unused failsafe dependency from core and add Failsafe to runtime LICENSE(s) by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11828 * [1.7.x] AWS, Core, GCP: Support relative credential endpoint / pass OAuth2 token to credential provider by @nastra in https://github.com/apache/iceberg/pull/11971 * Spark: Fix empty scan issue when start timestamp retrieves root snapshot and end timestamp is missing (#11967) by @Fokko in https://github.com/apache/iceberg/pull/11983 * Remove `slf4j-api` reference in `LICENSE` (#12052) by @Fokko in https://github.com/apache/iceberg/pull/12068 * [1.7.x] Core: Retain current view version during expiration (#12067) by @nastra in https://github.com/apache/iceberg/pull/12084 * Bump the versions of `site/mkdocs.yml` by @Fokko in https://github.com/apache/iceberg/pull/12175 * [1.7.x] Kafka: Pin Kafka-Connect version to fix integration tests by @Fokko in https://github.com/apache/iceberg/pull/12354 * [1.7.x] Bump Nessie to 0.120.5 to include updated License/Notice by @Fokko in https://github.com/apache/iceberg/pull/12356 * [1.7.x] Fix `{LICENSE,NOTICE}` for Kafka Connect Runtime by @Fokko in https://github.com/apache/iceberg/pull/12353 * [1.7.x] Fix `{LICENSE,NOTICE}` for Flink Runtime by @Fokko in https://github.com/apache/iceberg/pull/12358 * [1.7.x] Fix `{LICENSE,NOTICE}` for GCP Bundle by @Fokko in https://github.com/apache/iceberg/pull/12359 * [1.7.x] Fix `{LICENSE,NOTICE}` for AWS Bundle by @Fokko in https://github.com/apache/iceberg/pull/12360 * [1.7.x] Fix `{LICENSE,NOTICE}` for Azure Bundle by @Fokko in https://github.com/apache/iceberg/pull/12361 * [1.7.x] Fix `{LICENSE,NOTICE}` for Spark Runtime by @Fokko in https://github.com/apache/iceberg/pull/12355 * [1.7.x] Align azure-storage-blob version in azure-bundle LICENSE by @jbonofre in https://github.com/apache/iceberg/pull/12445 * [1.7.x] Fix Kafka-connect `LICENSE` and `NOTICE` by @Fokko in https://github.com/apache/iceberg/pull/12400 * [1.7.x] AWS: Don't fetch credential from endpoint if properties contain a valid credential (#12504) by @nastra in https://github.com/apache/iceberg/pull/12515 **Full Changelog**: https://github.com/apache/iceberg/compare/apache-iceberg-1.7.1...apache-iceberg-1.7.2
## What's Changed * Doc: Update rewrite data files spark procedure by @dramaticlly in https://github.com/apache/iceberg/pull/11396 * Docs: warn `parallelism > 1` doesn't work for migration procedures by @manuzhang in https://github.com/apache/iceberg/pull/11417 * Core: log retry sleep time by @sullis in https://github.com/apache/iceberg/pull/11413 * Core: Use RoaringPositionBitmap in position index by @aokolnychyi in https://github.com/apache/iceberg/pull/11441 * Core: Add validation for table commit properties by @dramaticlly in https://github.com/apache/iceberg/pull/11437 * Core: Add cardinality to PositionDeleteIndex by @aokolnychyi in https://github.com/apache/iceberg/pull/11442 * Puffin: Add delete-vector-v1 blob type by @rdblue in https://github.com/apache/iceberg/pull/11238 * Spec v3: Add deletion vectors to the table spec by @rdblue in https://github.com/apache/iceberg/pull/11240 * API, Core: Add data file reference to DeleteFile by @aokolnychyi in https://github.com/apache/iceberg/pull/11443 * Build: Bump software.amazon.awssdk:bom from 2.29.1 to 2.29.6 by @dependabot in https://github.com/apache/iceberg/pull/11454 * Build: Bump com.gradleup.shadow:shadow-gradle-plugin from 8.3.3 to 8.3.5 by @dependabot in https://github.com/apache/iceberg/pull/11452 * Build: Bump com.google.cloud:libraries-bom from 26.49.0 to 26.50.0 by @dependabot in https://github.com/apache/iceberg/pull/11451 * Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4 to 5.4.1 by @dependabot in https://github.com/apache/iceberg/pull/11450 * Build: Bump com.azure:azure-sdk-bom from 1.2.28 to 1.2.29 by @dependabot in https://github.com/apache/iceberg/pull/11453 * Flink: Maintenance - TableManager + ExpireSnapshots by @pvary in https://github.com/apache/iceberg/pull/11144 * Build: Bump mkdocs-material from 9.5.42 to 9.5.43 by @dependabot in https://github.com/apache/iceberg/pull/11455 * Build: Bump net.snowflake:snowflake-jdbc from 3.19.1 to 3.20.0 by @dependabot in https://github.com/apache/iceberg/pull/11447 * Build: Bump kafka from 3.8.0 to 3.8.1 by @dependabot in https://github.com/apache/iceberg/pull/11449 * Build: Bump jackson-bom from 2.18.0 to 2.18.1 by @dependabot in https://github.com/apache/iceberg/pull/11448 * Core: Fix generated position delete file spec by @aokolnychyi in https://github.com/apache/iceberg/pull/11458 * API, Core: Add content offset and size to DeleteFile by @aokolnychyi in https://github.com/apache/iceberg/pull/11446 * Build: Revert Parquet to 1.13.1 by @RussellSpitzer in https://github.com/apache/iceberg/pull/11462 * Spark 3.5: Preserve data file reference during manifest rewrites by @aokolnychyi in https://github.com/apache/iceberg/pull/11457 * Core: Make PositionDeleteIndex serializable by @aokolnychyi in https://github.com/apache/iceberg/pull/11463 * Spark 3.5: Preserve content offset and size during manifest rewrites by @aokolnychyi in https://github.com/apache/iceberg/pull/11469 * Spark 3.5: Fix flaky test due to temp directory not empty during delete by @manuzhang in https://github.com/apache/iceberg/pull/11470 * Core, Data, Flink, Spark: Improve tableDir initialization for tests by @nastra in https://github.com/apache/iceberg/pull/11460 * Core: Support DVs in DeleteFileIndex by @aokolnychyi in https://github.com/apache/iceberg/pull/11467 * Core: Adapt commit, scan, and snapshot stats for DVs by @aokolnychyi in https://github.com/apache/iceberg/pull/11464 * Spark: Merge new position deletes with old deletes during writing by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11273 * Fix ADLSLocation file parsing by @mrcnc in https://github.com/apache/iceberg/pull/11395 * open-api: Build runtime jar for test fixture by @ajantha-bhat in https://github.com/apache/iceberg/pull/11279 * Core, Puffin: Add DV file writer by @aokolnychyi in https://github.com/apache/iceberg/pull/11476 * Flink: Fix config key typo in error message of SplitComparators by @liuml07 in https://github.com/apache/iceberg/pull/11482 * API: Removes Explicit Parameterization of Schema Tests by @RussellSpitzer in https://github.com/apache/iceberg/pull/11444 * Docs: Fix verifying release candidate with Spark and Flink by @manuzhang in https://github.com/apache/iceberg/pull/11461 * Flink: Port #11144 to v1.19 by @pvary in https://github.com/apache/iceberg/pull/11473 * Docs: Fix format of verifying release candidate with Flink by @manuzhang in https://github.com/apache/iceberg/pull/11487 * Core: Support DVs in DeleteLoader by @aokolnychyi in https://github.com/apache/iceberg/pull/11481 * Infra: Update DOAP.RDF for Apache Iceberg 1.7.0 by @RussellSpitzer in https://github.com/apache/iceberg/pull/11492 * Docs: Site Update for 1.7.0 Release by @RussellSpitzer in https://github.com/apache/iceberg/pull/11494 * Infra: Add 1.7.0 to issue template by @RussellSpitzer in https://github.com/apache/iceberg/pull/11491 * Build: Let revapi compare against 1.7.0 by @RussellSpitzer in https://github.com/apache/iceberg/pull/11490 * Docs: Adds Release notes for 1.6.1 by @RussellSpitzer in https://github.com/apache/iceberg/pull/11500 * Docs: Fixes Release Formatting for 1.7.0 Release Notes by @RussellSpitzer in https://github.com/apache/iceberg/pull/11499 * Spec: Explicitly specify `operation` as a required field of Snapshot's `summary` field by @sungwy in https://github.com/apache/iceberg/pull/11355 * Exclude reading _pos column if it's not in the scan list by @huaxingao in https://github.com/apache/iceberg/pull/11390 * Build: Bump mkdocs-redirects from 1.2.1 to 1.2.2 by @dependabot in https://github.com/apache/iceberg/pull/11511 * Build: Bump mkdocs-material from 9.5.43 to 9.5.44 by @dependabot in https://github.com/apache/iceberg/pull/11510 * Build: Bump software.amazon.awssdk:bom from 2.29.6 to 2.29.9 by @dependabot in https://github.com/apache/iceberg/pull/11509 * Docs: Update multi-engine support after 1.7.0 release by @manuzhang in https://github.com/apache/iceberg/pull/11503 * Spark: Fix typo in spark ddl document by @hantangwangd in https://github.com/apache/iceberg/pull/11517 * Core: Support commits with DVs by @aokolnychyi in https://github.com/apache/iceberg/pull/11495 * Kafka Connect: fix Hadoop dependency exclusion by @bryanck in https://github.com/apache/iceberg/pull/11516 * Upgrade to Gradle 8.11.0 by @jbonofre in https://github.com/apache/iceberg/pull/11521 * Spark 3.5: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in https://github.com/apache/iceberg/pull/11480 * use `dist/release` KEYS by @kevinjqliu in https://github.com/apache/iceberg/pull/11526 * Remove iceberg-pig by @jbonofre in https://github.com/apache/iceberg/pull/11380 * Core, Flink, Spark: Verify maintenance actions with DVs by @nastra in https://github.com/apache/iceberg/pull/11485 * Spark: Use assumeThat(format).isEqualTo(FileFormat.PARQUET) instead of assumeThat(format).isEqualTo(parquet) by @huaxingao in https://github.com/apache/iceberg/pull/11540 * Spark 3.4: Support Spark Column Stats by @saitharun15 in https://github.com/apache/iceberg/pull/11532 * Docs: Fix rendering lists by @manuzhang in https://github.com/apache/iceberg/pull/11546 * Build: Bump kafka from 3.8.1 to 3.9.0 by @dependabot in https://github.com/apache/iceberg/pull/11508 * Support WASB scheme in ADLSFileIO by @mrcnc in https://github.com/apache/iceberg/pull/11504 * Docs: 4 Spaces are Required for Sublists by @RussellSpitzer in https://github.com/apache/iceberg/pull/11549 * API, Core, Spark: Ignore schema merge updates from long -> int by @rocco408 in https://github.com/apache/iceberg/pull/11419 * Docs: Fix level of Deletion Vectors by @manuzhang in https://github.com/apache/iceberg/pull/11547 * API, Core: Replace deprecated ContentFile#path usage with location by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11550 * API: Add Variant data type by @aihuaxu in https://github.com/apache/iceberg/pull/11324 * Spark 3.5: Adapt DeleteFileIndexBenchmark for DVs by @aokolnychyi in https://github.com/apache/iceberg/pull/11529 * Spark 3.5: Adapt PlanningBenchmark for DVs by @aokolnychyi in https://github.com/apache/iceberg/pull/11531 * Spark 3.5: Add DVReaderBenchmark by @aokolnychyi in https://github.com/apache/iceberg/pull/11537 * Build: Bump datamodel-code-generator from 0.26.2 to 0.26.3 by @dependabot in https://github.com/apache/iceberg/pull/11572 * Build: Bump software.amazon.awssdk:bom from 2.29.9 to 2.29.15 by @dependabot in https://github.com/apache/iceberg/pull/11568 * Build: Bump io.netty:netty-buffer from 4.1.114.Final to 4.1.115.Final by @dependabot in https://github.com/apache/iceberg/pull/11569 * Data, Flink, Spark: Test deletes with format-version=3 by @nastra in https://github.com/apache/iceberg/pull/11538 * Build: Bump nessie from 0.99.0 to 0.100.0 by @dependabot in https://github.com/apache/iceberg/pull/11567 * Build: Bump orc from 1.9.4 to 1.9.5 by @dependabot in https://github.com/apache/iceberg/pull/11571 * API, Arrow, Core, Data, Spark: Replace usage of deprecated ContentFile#path API with location API by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11563 * Core: Serialize `null` when there is no current snapshot by @Fokko in https://github.com/apache/iceberg/pull/11560 * Spark 3.4: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in https://github.com/apache/iceberg/pull/11579 * Spark 3.3: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in https://github.com/apache/iceberg/pull/11580 * Core: Inherited classes from SnapshotProducer has TableOperations red… by @gaborkaszab in https://github.com/apache/iceberg/pull/11578 * Revert "Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner" by @nastra in https://github.com/apache/iceberg/pull/11574 * Core: delete temp metadata file when version already exists by @leesf in https://github.com/apache/iceberg/pull/11350 * Build: Bump Apache Parquet 1.14.4 by @Fokko in https://github.com/apache/iceberg/pull/11502 * core: Filter on live entries when reading the manifest by @Fokko in https://github.com/apache/iceberg/pull/9996 * Core: Fix CCE when retrieving TableOps by @nastra in https://github.com/apache/iceberg/pull/11585 * API, Core: Remove unnecessary casts to Iterable<T> by @nastra in https://github.com/apache/iceberg/pull/11601 * Spark 3.5: Fix NotSerializableException when migrating Spark tables by @manuzhang in https://github.com/apache/iceberg/pull/11157 * Spark 3.3: Deprecate support by @aokolnychyi in https://github.com/apache/iceberg/pull/11596 * Bugfix for incorrect Deletion of Snapshot Metadata Due to OutOfMemoryError by @ZhendongBai in https://github.com/apache/iceberg/pull/11576 * Docs: add iceberg-go to doc site by @zeroshade in https://github.com/apache/iceberg/pull/11607 * Procedure to compute table stats by @karuppayya in https://github.com/apache/iceberg/pull/10986 * Parquet: Use native getRowIndexOffset support instead of calculating it by @wypoon in https://github.com/apache/iceberg/pull/11520 * Spark: Fix changelog table bug for start time older than current snapshot by @Acehaidrey in https://github.com/apache/iceberg/pull/11564 * Spark 3.5: Fix flaky TestRemoveOrphanFilesAction3 by @manuzhang in https://github.com/apache/iceberg/pull/11616 * Upgrade to Gradle 8.11.1 by @jbonofre in https://github.com/apache/iceberg/pull/11619 * Core: Optimize MergingSnapshotProducer to use referenced manifests to determine if manifest needs to be rewritten by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11131 * Revert "Core: Update TableMetadataParser to ensure all streams closed (#11220)" by @hussein-awala in https://github.com/apache/iceberg/pull/11621 * Add REST Catalog tests to Spark 3.5 integration test by @haizhou-zhao in https://github.com/apache/iceberg/pull/11093 * Spark 3.5: Correct the two-stage parsing strategy of antlr parser by @pan3793 in https://github.com/apache/iceberg/pull/11628 * Spark 3.4: Correct the two-stage parsing strategy of antlr parser by @pan3793 in https://github.com/apache/iceberg/pull/7734 * Docs: Add new blog post to Iceberg Blogs by @ismailsimsek in https://github.com/apache/iceberg/pull/11627 * Docs: Mention look-free requires HIVE-28121 for MySQL/MariaDB-based HMS by @pan3793 in https://github.com/apache/iceberg/pull/11631 * Spark 3.4: IcebergSource extends SessionConfigSupport by @pan3793 in https://github.com/apache/iceberg/pull/7732 * Spark 3.5: IcebergSource extends SessionConfigSupport by @pan3793 in https://github.com/apache/iceberg/pull/11624 * Spark 3.3: IcebergSource extends SessionConfigSupport by @pan3793 in https://github.com/apache/iceberg/pull/11625 * Build: Bump testcontainers from 1.20.3 to 1.20.4 by @dependabot in https://github.com/apache/iceberg/pull/11640 * Build: Bump mkdocs-material from 9.5.44 to 9.5.45 by @dependabot in https://github.com/apache/iceberg/pull/11641 * Spark 3.3: Correct the two-stage parsing strategy of antlr parser by @pan3793 in https://github.com/apache/iceberg/pull/11630 * Build: Bump software.amazon.awssdk:bom from 2.29.15 to 2.29.20 by @dependabot in https://github.com/apache/iceberg/pull/11639 * Core,Open-API: Don't expose the `last-column-id` by @Fokko in https://github.com/apache/iceberg/pull/11514 * Build: Bump com.google.errorprone:error_prone_annotations from 2.35.1 to 2.36.0 by @dependabot in https://github.com/apache/iceberg/pull/11638 * Flink: Add table.exec.iceberg.use-v2-sink option by @arkadius in https://github.com/apache/iceberg/pull/11244 * Docs: Use DataFrameWriterV2 in Spark's example by @pan3793 in https://github.com/apache/iceberg/pull/11647 * Docs: add `WHEN NOT MATCHED BY SOURCE` to Spark `MERGE INTO` doc by @hussein-awala in https://github.com/apache/iceberg/pull/11636 * Build: Bump nessie from 0.100.0 to 0.100.2 by @dependabot in https://github.com/apache/iceberg/pull/11637 * Build: Delete branch automatically on PR merge by @manuzhang in https://github.com/apache/iceberg/pull/11635 * Flink: Test both "new" Flink Avro planned reader and "deprecated" Avro reader by @jbonofre in https://github.com/apache/iceberg/pull/11430 * Adding ComputeTableStats Procedure to Spark 3.4 by @jeesou in https://github.com/apache/iceberg/pull/11652 * Flink: Backport #11244 to Flink 1.19 (Add table.exec.iceberg.use-v2-sink option) by @arkadius in https://github.com/apache/iceberg/pull/11665 * Doc: Fix some Javadoc URLs. by @zhongyujiang in https://github.com/apache/iceberg/pull/11666 * Docs: Add blog post showing Nussknacker with Iceberg integration by @arkadius in https://github.com/apache/iceberg/pull/11667 * Kafka Connect: Add config to prefix the control consumer group by @hugofriant in https://github.com/apache/iceberg/pull/11599 * Backport Avro planned reader (and corresponding tests) on Flink v1.18 and v1.19 by @jbonofre in https://github.com/apache/iceberg/pull/11668 * Docs: Add RisingWave by @hengm3467 in https://github.com/apache/iceberg/pull/11642 * REST: Docker file for REST Fixture by @ajantha-bhat in https://github.com/apache/iceberg/pull/11283 * Core: Propagate custom metrics reporter when table is created/replaced through Transaction by @nastra in https://github.com/apache/iceberg/pull/11671 * Spark: remove ROW_POSITION from project schema by @huaxingao in https://github.com/apache/iceberg/pull/11610 * Default to `overwrite` when operation is missing by @Fokko in https://github.com/apache/iceberg/pull/11421 * Core,API: Set `503: added_snapshot_id` as required by @Fokko in https://github.com/apache/iceberg/pull/11626 * Create publish-docker.yml by @sungwy in https://github.com/apache/iceberg/pull/11632 * Replace wrong order of assertion by @ebyhr in https://github.com/apache/iceberg/pull/11677 * REST: Refactor docker image files by @ajantha-bhat in https://github.com/apache/iceberg/pull/11676 * Build: Bump software.amazon.awssdk:bom from 2.29.20 to 2.29.23 by @dependabot in https://github.com/apache/iceberg/pull/11683 * Build: Bump mkdocs-material from 9.5.45 to 9.5.46 by @dependabot in https://github.com/apache/iceberg/pull/11680 * REST: Use HEAD request to check table existence by @ebyhr in https://github.com/apache/iceberg/pull/10999 * Build: Bump jackson-bom from 2.18.1 to 2.18.2 by @dependabot in https://github.com/apache/iceberg/pull/11681 * Build: Bump org.xerial:sqlite-jdbc from 3.47.0.0 to 3.47.1.0 by @dependabot in https://github.com/apache/iceberg/pull/11682 * Spark-3.5: make `where` sql case sensitive setting alterable in rewrite data files procedure by @ludlows in https://github.com/apache/iceberg/pull/11439 * Spark: Remove extra columns for ColumnBatch by @huaxingao in https://github.com/apache/iceberg/pull/11551 * Spark: Add view support to SparkSessionCatalog by @nastra in https://github.com/apache/iceberg/pull/11388 * REST: Fix warning message for deprecated OAuth2 server URI by @ebyhr in https://github.com/apache/iceberg/pull/11694 * Build: Bump Parquet to 1.15.0 by @Fokko in https://github.com/apache/iceberg/pull/11656 * Spark 3.3,3.4: Make where clause case sensitive in rewrite data files by @ludlows in https://github.com/apache/iceberg/pull/11696 * Core: Generalize Util::blockLocations by @okumin in https://github.com/apache/iceberg/pull/11053 * Document procedure for stats collection by @karuppayya in https://github.com/apache/iceberg/pull/11606 * Spark 3.5: Align RewritePositionDeleteFilesSparkAction filter case sensitivity with Spark case sensitivity by @huaxingao in https://github.com/apache/iceberg/pull/11700 * Spark: Write DVs for V3 MoR tables by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11561 * Infra: Add 1.7.1 to issue template by @bryanck in https://github.com/apache/iceberg/pull/11711 * Update ASF doap.rdf to release 1.7.1 by @bryanck in https://github.com/apache/iceberg/pull/11712 * Spark 3.3/3.4: Align RewritePositionDeleteFilesSparkAction filter case sensitivity with Spark case sensitivity by @huaxingao in https://github.com/apache/iceberg/pull/11710 * Build: Bump software.amazon.awssdk:bom from 2.29.23 to 2.29.29 by @dependabot in https://github.com/apache/iceberg/pull/11723 * Build: Bump com.google.cloud:libraries-bom from 26.50.0 to 26.51.0 by @dependabot in https://github.com/apache/iceberg/pull/11724 * Build: Bump mkdocs-material from 9.5.46 to 9.5.47 by @dependabot in https://github.com/apache/iceberg/pull/11726 * Add C++ to the list of languages in `doap.rdf` by @Fokko in https://github.com/apache/iceberg/pull/11714 * Build: Bump com.azure:azure-sdk-bom from 1.2.29 to 1.2.30 by @dependabot in https://github.com/apache/iceberg/pull/11725 * Added curl to the iceberg rest fixture Docker image #11688 by @dominikhei in https://github.com/apache/iceberg/pull/11705 * Build: Bump nessie from 0.100.2 to 0.101.0 by @dependabot in https://github.com/apache/iceberg/pull/11722 * Docs: Add release notes for 1.7.1 by @bryanck in https://github.com/apache/iceberg/pull/11717 * Docs: Add guidelines for contributors to become committers by @rdblue in https://github.com/apache/iceberg/pull/11670 * Core, Flink, Spark: Drop deprecated APIs scheduled for removal in 1.8.0 by @findepi in https://github.com/apache/iceberg/pull/11721 * Flink: Fix range distribution npe when value is null by @Guosmilesmile in https://github.com/apache/iceberg/pull/11662 * AWS: Enable Adaptive Retries for AWS KMS client by @hsiang-c in https://github.com/apache/iceberg/pull/11420 * Core, Flink, Spark, KafkaConnect: Remove remaining usage of deprecated path API by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11744 * docker: Build for `arm64` architecture by @Fokko in https://github.com/apache/iceberg/pull/11753 * Docs: fix typo in spec by @xxchan in https://github.com/apache/iceberg/pull/11759 * Spark3.4,3.5: Fix the BUG of iceberg views when resolved "group by ordinals" by @Ppei-Wang in https://github.com/apache/iceberg/pull/11729 * Spark: Remove deprecated SparkAppenderFactory by @ajantha-bhat in https://github.com/apache/iceberg/pull/11727 * Hadoop: Log where the missing metadata file is located by @manuzhang in https://github.com/apache/iceberg/pull/11643 * Core: Use HEAD request to check if view exists by @nastra in https://github.com/apache/iceberg/pull/11760 * Core: Use HEAD request to check if namespace exists by @nastra in https://github.com/apache/iceberg/pull/11761 * Hive: Optimize tableExists API in hive catalog by @dramaticlly in https://github.com/apache/iceberg/pull/11597 * GCS: Suppress JavaUtilDate in OAuth2RefreshCredentialsHandler by @ebyhr in https://github.com/apache/iceberg/pull/11773 * Flink: Add RowConverter for Iceberg Source by @abharath9 in https://github.com/apache/iceberg/pull/11301 * Spark 3.5: Fix comment and assertion mismatch in PartitionedWritesTestBase/TestRewritePositionDeleteFilesAction by @wzx140 in https://github.com/apache/iceberg/pull/11748 * Build: Bump nessie from 0.101.0 to 0.101.2 by @dependabot in https://github.com/apache/iceberg/pull/11791 * Core: Add missing REST endpoint definitions by @ajreid21 in https://github.com/apache/iceberg/pull/11756 * Build: Bump software.amazon.awssdk:bom from 2.29.29 to 2.29.34 by @dependabot in https://github.com/apache/iceberg/pull/11793 * Spark: Read DVs when reading from .position_deletes table by @nastra in https://github.com/apache/iceberg/pull/11657 * Core: Add TableUtil to provide access to a table's format version by @nastra in https://github.com/apache/iceberg/pull/11620 * Build: Bump mkdocs-material from 9.5.47 to 9.5.48 by @dependabot in https://github.com/apache/iceberg/pull/11790 * Spark 3.4: Add REST catalog to Spark integration tests by @nastra in https://github.com/apache/iceberg/pull/11698 * Parquet: Implement defaults for generic data by @rdblue in https://github.com/apache/iceberg/pull/11785 * Avro: Support default values for generic data by @rdblue in https://github.com/apache/iceberg/pull/11786 * REST: Use apache/iceberg-rest-fixture docker image by @ajantha-bhat in https://github.com/apache/iceberg/pull/11673 * Docs: Default value of table level distribution-mode should be not set by @manuzhang in https://github.com/apache/iceberg/pull/11663 * Docs: Fix Spark catalog `table-override` description by @manuzhang in https://github.com/apache/iceberg/pull/11684 * API: Add missing deprecations by @Fokko in https://github.com/apache/iceberg/pull/11734 * Core, Spark3.5: Fix tests failure due to timeout by @manuzhang in https://github.com/apache/iceberg/pull/11654 * Auth Manager API part 1: HTTPRequest, HTTPHeader by @adutra in https://github.com/apache/iceberg/pull/11769 * Flink: make `StatisticsOrRecord` to be correctly serialized and deser… by @huyuanfeng2018 in https://github.com/apache/iceberg/pull/11557 * Spark3.4,3.5: In describe extended view command: fix wrong view catal… by @Ppei-Wang in https://github.com/apache/iceberg/pull/11751 * Use try-with-resources in TestParallelIterable by @sopel39 in https://github.com/apache/iceberg/pull/11810 * Spark 3.5: Support default values in Parquet reader by @rdblue in https://github.com/apache/iceberg/pull/11803 * Data: Fix Parquet and Avro defaults date/time representation by @rdblue in https://github.com/apache/iceberg/pull/11811 * Revert "Support WASB scheme in ADLSFileIO" by @mrcnc in https://github.com/apache/iceberg/pull/11812 * Core, Spark, Flink, Hive: Remove unused failsafe dependency from core and add Failsafe to runtime LICENSE(s) by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11816 * Docs: Change to Flink directory for instructions by @liuml07 in https://github.com/apache/iceberg/pull/11031 * Spark 3.5: Support default values in vectorized reads by @rdblue in https://github.com/apache/iceberg/pull/11815 * Remove number from assert description by @TQJADE in https://github.com/apache/iceberg/pull/11827 * Auth Manager API part 2: AuthManager by @adutra in https://github.com/apache/iceberg/pull/11809 * Core: Add Variant implementation to read serialized objects by @rdblue in https://github.com/apache/iceberg/pull/11415 * Spark: Test reading default values in Spark by @rdblue in https://github.com/apache/iceberg/pull/11832 * Build: Bump datamodel-code-generator from 0.26.3 to 0.26.4 by @dependabot in https://github.com/apache/iceberg/pull/11856 * Build: Bump mkdocs-awesome-pages-plugin from 2.9.3 to 2.10.0 by @dependabot in https://github.com/apache/iceberg/pull/11855 * Build: Bump mkdocs-material from 9.5.48 to 9.5.49 by @dependabot in https://github.com/apache/iceberg/pull/11854 * Build: Bump io.netty:netty-buffer from 4.1.115.Final to 4.1.116.Final by @dependabot in https://github.com/apache/iceberg/pull/11853 * Build: Bump software.amazon.awssdk:bom from 2.29.34 to 2.29.39 by @dependabot in https://github.com/apache/iceberg/pull/11851 * Build: Bump guava from 33.3.1-jre to 33.4.0-jre by @dependabot in https://github.com/apache/iceberg/pull/11850 * Build: Bump junit from 5.11.3 to 5.11.4 by @dependabot in https://github.com/apache/iceberg/pull/11849 * Build: Bump org.assertj:assertj-core from 3.26.3 to 3.27.0 by @dependabot in https://github.com/apache/iceberg/pull/11847 * Build: Bump nessie from 0.101.2 to 0.101.3 by @dependabot in https://github.com/apache/iceberg/pull/11852 * Build: Bump junit-platform from 1.11.3 to 1.11.4 by @dependabot in https://github.com/apache/iceberg/pull/11848 * Doc: Add status page for different implementations. by @liurenjie1024 in https://github.com/apache/iceberg/pull/11772 * Build: Upgrade to Gradle 8.12 by @jbonofre in https://github.com/apache/iceberg/pull/11861 * Build: Fix ignoring `.asf.yaml` in PR by @manuzhang in https://github.com/apache/iceberg/pull/11860 * Gradle 8.12 updated the gradlew with better APP_HOME definition by @jbonofre in https://github.com/apache/iceberg/pull/11869 * Core, Spark: Avoid deprecated methods in Guava Files by @ebyhr in https://github.com/apache/iceberg/pull/11865 * Core: Don't reset snapshotLog in `TableMetadata.removeRef` method by @ebyhr in https://github.com/apache/iceberg/pull/11779 * Core: Replace deprecated Schema.toString with SchemaFormatter by @ebyhr in https://github.com/apache/iceberg/pull/11867 * Build: Fix ignoring `license-check.yml` in PR by @manuzhang in https://github.com/apache/iceberg/pull/11873 * API: Replace deprecated asList with asInstanceOf in TestExceptionUtil by @ebyhr in https://github.com/apache/iceberg/pull/11875 * Flink: Avoid RANGE mode broken chain when write parallelism changes by @huyuanfeng2018 in https://github.com/apache/iceberg/pull/11702 * Update README.md to add link to iceberg-cpp by @gabeiglio in https://github.com/apache/iceberg/pull/11882 * Build: Bump software.amazon.awssdk:bom from 2.29.39 to 2.29.43 by @dependabot in https://github.com/apache/iceberg/pull/11886 * Build: Bump mkdocs-awesome-pages-plugin from 2.10.0 to 2.10.1 by @dependabot in https://github.com/apache/iceberg/pull/11885 * Core: Fix typo in HadoopTableOperations by @okumin in https://github.com/apache/iceberg/pull/11880 * Revert "Hive: close the fileIO client when closing the hive catalog" by @Fokko in https://github.com/apache/iceberg/pull/11858 * Docs: Add history to Hive's metadata tables by @okumin in https://github.com/apache/iceberg/pull/11902 * Doc: Fix format of Hive by @ebyhr in https://github.com/apache/iceberg/pull/11892 * Flink: Backport #11662 Fix range distribution npe when value is null to Flink 1.18 and 1.19 by @Guosmilesmile in https://github.com/apache/iceberg/pull/11745 * Spark: Change Delete granularity to file for Spark 3.5 by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11478 * Bump Spark 3.5.4 by @pan3793 in https://github.com/apache/iceberg/pull/11731 * Kafka-connect-runtime: remove code duplications in integration tests by @wombatu-kun in https://github.com/apache/iceberg/pull/11883 * Flink: Backport #11557 to Flink 1.19 and 1.18 by @huyuanfeng2018 in https://github.com/apache/iceberg/pull/11834 * Use ExternalTypeInfo in Rowconverter code instead of deprecated TableSchema.getFieldTypes by @abharath9 in https://github.com/apache/iceberg/pull/11838 * Update maintenance.md by @hgeraldino in https://github.com/apache/iceberg/pull/11916 * Build: Bump software.amazon.awssdk:bom from 2.29.43 to 2.29.45 by @dependabot in https://github.com/apache/iceberg/pull/11910 * Build: Bump org.xerial:sqlite-jdbc from 3.47.1.0 to 3.47.2.0 by @dependabot in https://github.com/apache/iceberg/pull/11907 * Hive: Optimize viewExists API in hive catalog by @dramaticlly in https://github.com/apache/iceberg/pull/11813 * Core: Add support for `view-default` property in catalog by @ebyhr in https://github.com/apache/iceberg/pull/11064 * Build: Bump io.delta:delta-standalone_2.12 from 3.2.1 to 3.3.0 by @dependabot in https://github.com/apache/iceberg/pull/11909 * Build: Bump org.assertj:assertj-core from 3.27.0 to 3.27.2 by @dependabot in https://github.com/apache/iceberg/pull/11908 * Doc: Add missing fields to metadata tables in Spark page by @ebyhr in https://github.com/apache/iceberg/pull/11897 * API: Support removeUnusedSpecs in ExpireSnapshots by @advancedxy in https://github.com/apache/iceberg/pull/10755 * Spark 3.5: Implement RewriteTablePath by @szehon-ho in https://github.com/apache/iceberg/pull/11555 * Infra: Add manuzhang to collaborators by @manuzhang in https://github.com/apache/iceberg/pull/11927 * Put a CFP Banner on the Homepage by @RussellSpitzer in https://github.com/apache/iceberg/pull/11942 * Use compatible column name to set Parquet bloom filter by @huaxingao in https://github.com/apache/iceberg/pull/11799 * Core: Allow adding files to multiple partition specs in FastAppend by @anuragmantri in https://github.com/apache/iceberg/pull/11771 * Avro: Add internal writer by @ajantha-bhat in https://github.com/apache/iceberg/pull/11919 * Core: Fix possible deadlock in ParallelIterable by @sopel39 in https://github.com/apache/iceberg/pull/11781 * Hive: Remove Hive runtime by @manuzhang in https://github.com/apache/iceberg/pull/11801 * Build: Bump software.amazon.awssdk:bom from 2.29.45 to 2.29.50 by @dependabot in https://github.com/apache/iceberg/pull/11949 * Core, Rest: Read the max connection for rest client from properties by @munendrasn in https://github.com/apache/iceberg/pull/11522 * Docs: Use the correct YAML text block indicator to prevent formatting issues by @neodon in https://github.com/apache/iceberg/pull/11552 * API: Fix parameter of ScanTask by @engraving-knife in https://github.com/apache/iceberg/pull/11941 * Build: Bump io.delta:delta-spark_2.12 from 3.2.1 to 3.3.0 by @dependabot in https://github.com/apache/iceberg/pull/11911 * Build: Bump net.snowflake:snowflake-jdbc from 3.20.0 to 3.21.0 by @dependabot in https://github.com/apache/iceberg/pull/11792 * Build: Bump com.google.cloud:libraries-bom from 26.51.0 to 26.52.0 by @dependabot in https://github.com/apache/iceberg/pull/11846 * Core: Add tests for catalogs supporting empty namespaces by @nastra in https://github.com/apache/iceberg/pull/9890 * Spec: Add cross-region bucket access property to config by @munendrasn in https://github.com/apache/iceberg/pull/11260 * Core: Fix test failure caused by check empty namespace on REST session catalog by @hantangwangd in https://github.com/apache/iceberg/pull/11960 * [docs] Update docs link about Apache Doris and update vendors list by @morningman in https://github.com/apache/iceberg/pull/11956 * docs: update `README.md` fix brand name `macOS` by @jbampton in https://github.com/apache/iceberg/pull/11964 * Core: Fix loading a table in CachingCatalog with metadata table name by @gaborkaszab in https://github.com/apache/iceberg/pull/11738 * Open-API: Bump to OpenAPI 3.1 by @Fokko in https://github.com/apache/iceberg/pull/11955 * Build: Bump openapi-generator plugin from 6.6.0 to 7.10.0 by @nastra in https://github.com/apache/iceberg/pull/11970 * Run `java-ci` on changes in `open-api/**` by @Fokko in https://github.com/apache/iceberg/pull/11972 * AWS, Core, GCP: Support relative credential endpoint / pass OAuth2 token to credential provider by @nastra in https://github.com/apache/iceberg/pull/11954 * Doc: Add DELETE ORPHAN-FILES example to Hive page by @ebyhr in https://github.com/apache/iceberg/pull/11896 * Spark 3.4: Add view support to SparkSessionCatalog by @nastra in https://github.com/apache/iceberg/pull/11797 * Spark 3.4: Backport rewriting historical file-scoped deletes (#11273) to 3.4 by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11975 * Support sanitizing a `Literal<?>` by @dmgkeke in https://github.com/apache/iceberg/pull/11943 * Auth Manager API part 3: OAuth2 Manager by @adutra in https://github.com/apache/iceberg/pull/11844 * Spark 3.5: Fix flaky tests `withSnapshotIsolation` by @manuzhang in https://github.com/apache/iceberg/pull/11974 * Spark: Fix empty scan issue when start timestamp retrieves root snapshot and end timestamp is missing by @lliangyu-lin in https://github.com/apache/iceberg/pull/11967 * Spark 3.4: Backport support for default values by @rdblue in https://github.com/apache/iceberg/pull/11987 * Doc: Add missing content value to manifests table by @ebyhr in https://github.com/apache/iceberg/pull/11989 * Spark: Fix Puffin suffix for DV files by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11986 * Spec: Add added-rows field to Snapshot by @RussellSpitzer in https://github.com/apache/iceberg/pull/11976 * API: add hashcode cache in StructType by @wzx140 in https://github.com/apache/iceberg/pull/11764 * Build: Bump mkdocs-material from 9.5.49 to 9.5.50 by @dependabot in https://github.com/apache/iceberg/pull/12005 * Build: Bump datamodel-code-generator from 0.26.4 to 0.26.5 by @dependabot in https://github.com/apache/iceberg/pull/12004 * Revert "API: add hashcode cache in StructType (#11764)" by @Fokko in https://github.com/apache/iceberg/pull/12007 * Build: Bump io.netty:netty-buffer from 4.1.116.Final to 4.1.117.Final by @dependabot in https://github.com/apache/iceberg/pull/11999 * Build: Bump org.apache.datasketches:datasketches-java from 6.1.1 to 6.2.0 by @dependabot in https://github.com/apache/iceberg/pull/12000 * Build: Bump org.xerial:sqlite-jdbc from 3.47.2.0 to 3.48.0.0 by @dependabot in https://github.com/apache/iceberg/pull/12001 * Build: Bump org.assertj:assertj-core from 3.27.2 to 3.27.3 by @dependabot in https://github.com/apache/iceberg/pull/12002 * Build: Bump com.google.cloud:libraries-bom from 26.52.0 to 26.53.0 by @dependabot in https://github.com/apache/iceberg/pull/12003 * Spark: Don't skip tests in TestSelect for SparkSessionCatalog by @manuzhang in https://github.com/apache/iceberg/pull/11824 * Core: List namespaces/tables when testing identifier with a dot by @nastra in https://github.com/apache/iceberg/pull/11991 * Support WASB scheme in ADLSFileIO by @mrcnc in https://github.com/apache/iceberg/pull/11830 * Docs: Update Footer Copyright Year by @omkenge in https://github.com/apache/iceberg/pull/12011 * Spec: Clarify `next-row-id` by @Fokko in https://github.com/apache/iceberg/pull/12018 * Flink: Upgrade Flink version 1.19.0 => 1.19.1 to mitigate NoSuchMethodError on commit by @mxm in https://github.com/apache/iceberg/pull/12021 * Update notice files copyright end year to 2025 by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/12013 * Spark 3.4: Backport writing DVs to Spark 3.4 by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/12019 * Spark 3.3: Backport support for default values by @rdblue in https://github.com/apache/iceberg/pull/11988 * Doc: Fix expired link in vendor page by @ebyhr in https://github.com/apache/iceberg/pull/12045 * add RisingWave to the Vendors page by @hengm3467 in https://github.com/apache/iceberg/pull/12043 * Build: Nighly build for Iceberg REST fixtures by @Fokko in https://github.com/apache/iceberg/pull/12008 * ORC: Fail when initial default support is required by @rdblue in https://github.com/apache/iceberg/pull/12026 * REST: Add missing default HEAD endpoints and V1_COMMIT_TRANSACTION by @ebyhr in https://github.com/apache/iceberg/pull/11980 * Spark 3.5: Refactor delete logic in batch reading by @huaxingao in https://github.com/apache/iceberg/pull/11933 * Delta, AWS, REST: Remove redundant charset lookup by @ebyhr in https://github.com/apache/iceberg/pull/12057 * Remove slf4j-api reference in LICENSE as it's now excluded from the distributed jar files by @jbonofre in https://github.com/apache/iceberg/pull/12052 * Adding Crunchy Data to Iceberg Vendors list by @elizabeth-christensen in https://github.com/apache/iceberg/pull/12020 * Flink 1.20: Support default values in Parquet reader by @jbonofre in https://github.com/apache/iceberg/pull/11839 * Flink: Backport default values support in Parquet reader on Flink v1.18 and v1.19 by @jbonofre in https://github.com/apache/iceberg/pull/12072 * Spark 3.5: Fix Javadoc in ColumnarBatchUtil by @huaxingao in https://github.com/apache/iceberg/pull/12058 * Core, Spark: Rewrite data files with high delete ratio by @nastra in https://github.com/apache/iceberg/pull/11825 * Core, Spark: Include content offset/size in PositionDeletesTable by @nastra in https://github.com/apache/iceberg/pull/11808 * Core: Retain current view version during expiration by @nastra in https://github.com/apache/iceberg/pull/12067 * Spark 3.5: Procedure to rewrite table path by @dramaticlly in https://github.com/apache/iceberg/pull/11931 * Spark: Disable rewriting position deletes for V3 tables by @nastra in https://github.com/apache/iceberg/pull/12048 * API: Add `UnknownType` by @Fokko in https://github.com/apache/iceberg/pull/12012 * Spark: Fix typo in NoSuchTableException message by @baolsen in https://github.com/apache/iceberg/pull/12091 * Spark 3.4: Refactor delete logic in batch reading by @huaxingao in https://github.com/apache/iceberg/pull/12061 * Spec, OpenAPI: Adds EnableRowLineage Metadata Update by @RussellSpitzer in https://github.com/apache/iceberg/pull/12050 * Spec: Document Snapshot Summary Optional Fields for Standardization by @HonahX in https://github.com/apache/iceberg/pull/11660 * Parquet: Add readers and writers for the internal object model by @ajantha-bhat in https://github.com/apache/iceberg/pull/11904 * Spark 3.5: Fix broadcasting specs in RewriteTablePath by @manuzhang in https://github.com/apache/iceberg/pull/11982 * Build: Upgrade to Gradle 8.12.1 by @jbonofre in https://github.com/apache/iceberg/pull/12093 * Spark 3.4: Backport Spark actions and procedures for RewriteTablePath by @dramaticlly in https://github.com/apache/iceberg/pull/12111 * Core: Add metadataFileLocation in TableUtil by @dramaticlly in https://github.com/apache/iceberg/pull/12082 * Build: Bump actions/stale from 9.0.0 to 9.1.0 by @dependabot in https://github.com/apache/iceberg/pull/12110 * OpenAPI: Deprecate snapshot-id of SetStatisticsUpdate by @c-thiel in https://github.com/apache/iceberg/pull/12010 * Spark 3.5: Make ColumnVectorWithFilter generic and refactor batch load by @aokolnychyi in https://github.com/apache/iceberg/pull/12056 * Spec: Adds in missing ChangeLog metadata columns - Reassigns Row Line… by @RussellSpitzer in https://github.com/apache/iceberg/pull/12100 * OpenAPI: Changes for freshness-aware table loading by @gaborkaszab in https://github.com/apache/iceberg/pull/11946 * Core: Check referencedDataFile existence for DV by @ebyhr in https://github.com/apache/iceberg/pull/12088 * Build: Bump software.amazon.awssdk:bom from 2.29.50 to 2.30.6 by @dependabot in https://github.com/apache/iceberg/pull/12109 * Build: Bump org.openapitools:openapi-generator-gradle-plugin from 7.10.0 to 7.11.0 by @dependabot in https://github.com/apache/iceberg/pull/12108 * Add IBM to Iceberg vendors list by @alileclerc in https://github.com/apache/iceberg/pull/12101 * Build: Bump nessie from 0.101.3 to 0.102.2 by @dependabot in https://github.com/apache/iceberg/pull/12107 * Core: Update variant class visibility by @rdblue in https://github.com/apache/iceberg/pull/12105 * Parquet: Clean up Parquet generic and internal readers by @rdblue in https://github.com/apache/iceberg/pull/12102 * Build: Bump scala-collection-compat from 2.12.0 to 2.13.0 by @manuzhang in https://github.com/apache/iceberg/pull/12121 * Minor: typo in url by @Fokko in https://github.com/apache/iceberg/pull/12126 * [docs] add spacing to "how to release"'s voting section by @kevinjqliu in https://github.com/apache/iceberg/pull/12123 * Spec: Fix minor typo in `_last_updated_sequence_number` docs by @smaheshwar-pltr in https://github.com/apache/iceberg/pull/12128 * Spec: add variant type by @aihuaxu in https://github.com/apache/iceberg/pull/10831 * Make view metadata path configurable by `write.metadata.path` by @tomtongue in https://github.com/apache/iceberg/pull/12017 * Core: Support removing keys from EnvironmentContext by @rshkv in https://github.com/apache/iceberg/pull/12103 * OpenAPI: add initial/write defaults to schema by @danielcweeks in https://github.com/apache/iceberg/pull/12094 * Fix NOTICE and LICENSE in the aws-bundle jar by @jbonofre in https://github.com/apache/iceberg/pull/12142 * Iceberg/Comet integration POC by @huaxingao in https://github.com/apache/iceberg/pull/9841 * Fix NOTICE and LICENSE in the azure-bundle jar by @jbonofre in https://github.com/apache/iceberg/pull/12143 * Spark 3.5: Iceberg / DataFusion Comet integration by @huaxingao in https://github.com/apache/iceberg/pull/12147 * Spark 3.5: Remove use of File.Separator in RewriteTablePath by @manuzhang in https://github.com/apache/iceberg/pull/12066 * Core, API, Spec: Metadata Row Lineage by @RussellSpitzer in https://github.com/apache/iceberg/pull/11948 * Spec: Fix current-version-id in View Spec example by @ldsantos0911 in https://github.com/apache/iceberg/pull/12146 * Data: open file using stats in scan by @bryanck in https://github.com/apache/iceberg/pull/12151 * Build: Bump nessie from 0.102.2 to 0.102.4 by @dependabot in https://github.com/apache/iceberg/pull/12153 * Build: Bump mkdocs-material from 9.5.50 to 9.6.1 by @dependabot in https://github.com/apache/iceberg/pull/12157 * Build: Bump software.amazon.awssdk:bom from 2.30.6 to 2.30.11 by @dependabot in https://github.com/apache/iceberg/pull/12156 * Build: Bump net.snowflake:snowflake-jdbc from 3.21.0 to 3.22.0 by @dependabot in https://github.com/apache/iceberg/pull/12155 * Build: Bump me.champeau.jmh:jmh-gradle-plugin from 0.7.2 to 0.7.3 by @dependabot in https://github.com/apache/iceberg/pull/12152 * Build: Bump com.azure:azure-sdk-bom from 1.2.30 to 1.2.31 by @dependabot in https://github.com/apache/iceberg/pull/12154 * Spark: make delete file ratio configurable by @MichaelDeSteven in https://github.com/apache/iceberg/pull/12148 * Core: Remove `TableMetadata::Builder::resetMainBranch` by @smaheshwar-pltr in https://github.com/apache/iceberg/pull/12149 * Spark: Update benchmark instructions by @Fokko in https://github.com/apache/iceberg/pull/12171 * Spark: Test metadata tables with format-version=3 by @nastra in https://github.com/apache/iceberg/pull/12135 * Docs: Fix latest and nightly link on javadoc (according to site README.md) by @jbonofre in https://github.com/apache/iceberg/pull/12023 * Variants: Implement toString by @rdblue in https://github.com/apache/iceberg/pull/12138 * Core: Refactor variants to enable moving interfaces to API module by @rdblue in https://github.com/apache/iceberg/pull/12167 * Flink: Add null check to writers to prevent resurrecting null values by @mxm in https://github.com/apache/iceberg/pull/12049 * Bump the versions of `site/mkdocs.yml` by @Fokko in https://github.com/apache/iceberg/pull/12180 * Bump Nessie to include updated License/Notice by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/12186 * API: Null check for auto-unboxed field id in builder by @danielcweeks in https://github.com/apache/iceberg/pull/12165 * Remove `jitpack.yml` by @Fokko in https://github.com/apache/iceberg/pull/12170 * Test Hive: Fix TestHiveMetastore by @2MD in https://github.com/apache/iceberg/pull/12140 * Fix NOTICE and LICENSE in the spark-runtime jar by @jbonofre in https://github.com/apache/iceberg/pull/12160 * Fix NOTICE and LICENSE in the gcp-bundle jar by @jbonofre in https://github.com/apache/iceberg/pull/12144 * Auth Manager API part 4: RESTClient, HTTPClient by @adutra in https://github.com/apache/iceberg/pull/11992 * Fix NOTICE and LICENSE in the flink-runtime jar by @jbonofre in https://github.com/apache/iceberg/pull/12145 * Update LICENSE/NOTICE in flink-runtime jar files by @jbonofre in https://github.com/apache/iceberg/pull/12188 * Update LICENSE/NOTICE for spark-runtime 3.3 and 3.4 by @jbonofre in https://github.com/apache/iceberg/pull/12189 * Docs: Minor improvements to Spark Procedures docs by @smaheshwar-pltr in https://github.com/apache/iceberg/pull/12190 * Core, Spark: Exclude non live content file in RewriteTablePathUtil by @dramaticlly in https://github.com/apache/iceberg/pull/12006 * Spark 3.4: Remove use of File.Separator in RewriteTablePath by @manuzhang in https://github.com/apache/iceberg/pull/12173 * Auth Manager API part 5: SigV4 Auth Manager by @adutra in https://github.com/apache/iceberg/pull/11995 * Core: Fix RewriteTablePath Incremental Replication by @barronfuentes in https://github.com/apache/iceberg/pull/12172 * Spark: support statistics files in RewriteTablePath by @dramaticlly in https://github.com/apache/iceberg/pull/11929 * Build: Bump com.gradleup.shadow:shadow-gradle-plugin from 8.3.5 to 8.3.6 by @dependabot in https://github.com/apache/iceberg/pull/12210 * Build: Bump mkdocs-material from 9.6.1 to 9.6.3 by @dependabot in https://github.com/apache/iceberg/pull/12205 * Build: Bump datamodel-code-generator from 0.26.5 to 0.27.2 by @dependabot in https://github.com/apache/iceberg/pull/12204 * Fix LICENSE and NOTICE for the kafka-connect-runtime distributions by @jbonofre in https://github.com/apache/iceberg/pull/12195 ## New Contributors * @saitharun15 made their first contribution in https://github.com/apache/iceberg/pull/11532 * @rocco408 made their first contribution in https://github.com/apache/iceberg/pull/11419 * @ZhendongBai made their first contribution in https://github.com/apache/iceberg/pull/11576 * @zeroshade made their first contribution in https://github.com/apache/iceberg/pull/11607 * @Acehaidrey made their first contribution in https://github.com/apache/iceberg/pull/11564 * @hugofriant made their first contribution in https://github.com/apache/iceberg/pull/11599 * @hengm3467 made their first contribution in https://github.com/apache/iceberg/pull/11642 * @okumin made their first contribution in https://github.com/apache/iceberg/pull/11053 * @dominikhei made their first contribution in https://github.com/apache/iceberg/pull/11705 * @Guosmilesmile made their first contribution in https://github.com/apache/iceberg/pull/11662 * @Ppei-Wang made their first contribution in https://github.com/apache/iceberg/pull/11729 * @abharath9 made their first contribution in https://github.com/apache/iceberg/pull/11301 * @wzx140 made their first contribution in https://github.com/apache/iceberg/pull/11748 * @ajreid21 made their first contribution in https://github.com/apache/iceberg/pull/11756 * @sopel39 made their first contribution in https://github.com/apache/iceberg/pull/11810 * @TQJADE made their first contribution in https://github.com/apache/iceberg/pull/11827 * @liurenjie1024 made their first contribution in https://github.com/apache/iceberg/pull/11772 * @gabeiglio made their first contribution in https://github.com/apache/iceberg/pull/11882 * @wombatu-kun made their first contribution in https://github.com/apache/iceberg/pull/11883 * @hgeraldino made their first contribution in https://github.com/apache/iceberg/pull/11916 * @neodon made their first contribution in https://github.com/apache/iceberg/pull/11552 * @engraving-knife made their first contribution in https://github.com/apache/iceberg/pull/11941 * @morningman made their first contribution in https://github.com/apache/iceberg/pull/11956 * @jbampton made their first contribution in https://github.com/apache/iceberg/pull/11964 * @dmgkeke made their first contribution in https://github.com/apache/iceberg/pull/11943 * @lliangyu-lin made their first contribution in https://github.com/apache/iceberg/pull/11967 * @omkenge made their first contribution in https://github.com/apache/iceberg/pull/12011 * @mxm made their first contribution in https://github.com/apache/iceberg/pull/12021 * @elizabeth-christensen made their first contribution in https://github.com/apache/iceberg/pull/12020 * @baolsen made their first contribution in https://github.com/apache/iceberg/pull/12091 * @alileclerc made their first contribution in https://github.com/apache/iceberg/pull/12101 * @smaheshwar-pltr made their first contribution in https://github.com/apache/iceberg/pull/12128 * @rshkv made their first contribution in https://github.com/apache/iceberg/pull/12103 * @ldsantos0911 made their first contribution in https://github.com/apache/iceberg/pull/12146 * @MichaelDeSteven made their first contribution in https://github.com/apache/iceberg/pull/12148 * @2MD made their first contribution in https://github.com/apache/iceberg/pull/12140 * @barronfuentes made their first contribution in https://github.com/apache/iceberg/pull/12172 **Full Changelog**: https://github.com/apache/iceberg/compare/apache-iceberg-1.7.1...apache-iceberg-1.8.0
## What's Changed * 1.7.1rc0 cherry picks by @bryanck in https://github.com/apache/iceberg/pull/11593 * 1.7.0rc0 cherry picks #2 by @bryanck in https://github.com/apache/iceberg/pull/11603 * 1.7.1rc0 cherry pick PR #11157 by @bryanck in https://github.com/apache/iceberg/pull/11605 * 1.7.1rc0 cherry pick PR #11564 by @bryanck in https://github.com/apache/iceberg/pull/11613 * 1.7.x apply PR #11220 by @bryanck in https://github.com/apache/iceberg/pull/11622 **Full Changelog**: https://github.com/apache/iceberg/compare/apache-iceberg-1.7.0...apache-iceberg-1.7.1
## What's Changed * [DOCS] Fix link on Concepts page by @gaborkaszab in https://github.com/apache/iceberg/pull/10718 * Core: Support appending files with different specs by @fqaiser94 in https://github.com/apache/iceberg/pull/9860 * Remove unnecessary class-level synchronized in ManifestFiles by @findepi in https://github.com/apache/iceberg/pull/10544 * Spec: Clarify which columns can be used for equality delete files. by @emkornfield in https://github.com/apache/iceberg/pull/8981 * Build: Bump nessie from 0.92.1 to 0.93.1 by @dependabot in https://github.com/apache/iceberg/pull/10727 * Build: Bump org.testcontainers:testcontainers from 1.19.8 to 1.20.0 by @dependabot in https://github.com/apache/iceberg/pull/10730 * Build: Bump mkdocs-material from 9.5.28 to 9.5.29 by @dependabot in https://github.com/apache/iceberg/pull/10734 * Build: Bump org.roaringbitmap:RoaringBitmap from 1.2.0 to 1.2.1 by @dependabot in https://github.com/apache/iceberg/pull/10733 * Build: Bump software.amazon.awssdk:bom from 2.26.20 to 2.26.21 by @dependabot in https://github.com/apache/iceberg/pull/10729 * Build: Bump io.netty:netty-buffer from 4.1.111.Final to 4.1.112.Final by @dependabot in https://github.com/apache/iceberg/pull/10726 * Build: Bump orc from 1.9.3 to 1.9.4 by @dependabot in https://github.com/apache/iceberg/pull/10728 * Build: Bump com.google.errorprone:error_prone_annotations from 2.28.0 to 2.29.2 by @dependabot in https://github.com/apache/iceberg/pull/10731 * Flink: Migrate remaining classes to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/10684 * Api, Build: Fix typo in comments in `Table` and `gradlew` by @hantangwangd in https://github.com/apache/iceberg/pull/10744 * Flink: parameterize Flink table source tests to test both old and FLIP-27 source implementations by @stevenzwu in https://github.com/apache/iceberg/pull/10741 * Core: Limit memory used by ParallelIterable by @findepi in https://github.com/apache/iceberg/pull/10691 * Flink: handle rescale properly and refactor statistics by @stevenzwu in https://github.com/apache/iceberg/pull/10457 * Flink: Backport other remaining classes by @tomtongue in https://github.com/apache/iceberg/pull/10749 * Spec: Clarify time travel implementation in Iceberg by @emkornfield in https://github.com/apache/iceberg/pull/8982 * Build: Let revapi compare against 1.6.0 by @ajantha-bhat in https://github.com/apache/iceberg/pull/10754 * Support for Flink's SpeculativeExecution in batch execution mode by @venkata91 in https://github.com/apache/iceberg/pull/10548 * API: Update StatisticsFile javadoc by @rice668 in https://github.com/apache/iceberg/pull/10769 * Flink: Remove JUnit4 dependency by @nastra in https://github.com/apache/iceberg/pull/10770 * Docs: Add bodo to iceberg vendors by @ritwika314 in https://github.com/apache/iceberg/pull/10756 * Core: Add estimateRowCount for Files and Entries Metadata Tables by @szehon-ho in https://github.com/apache/iceberg/pull/10759 * Update checkstyle definition by @attilakreiner in https://github.com/apache/iceberg/pull/10681 * API: Fix typo in RewriteManifestFiles java doc by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10778 * Update .asf.yaml by @ajantha-bhat in https://github.com/apache/iceberg/pull/10767 * Support building with Java 21 by @findepi in https://github.com/apache/iceberg/pull/10474 * Infra, Docs: Publish Apache Iceberg 1.6.0 release by @jbonofre in https://github.com/apache/iceberg/pull/10752 * Update iceberg version on site to 1.6.0 by @jbonofre in https://github.com/apache/iceberg/pull/10783 * Hive: close the fileIO client when closing the hive catalog by @hussein-awala in https://github.com/apache/iceberg/pull/10771 * Add jbonofre as collaborator on the project by @jbonofre in https://github.com/apache/iceberg/pull/10782 * Docs: Make compatibility example consistent. by @emkornfield in https://github.com/apache/iceberg/pull/10781 * mr:Fix issues 10639 by @lurnagao-dahua in https://github.com/apache/iceberg/pull/10661 * Flink: backport PR #10331 and PR #10457 by @stevenzwu in https://github.com/apache/iceberg/pull/10757 * Build: Bump software.amazon.awssdk:bom from 2.26.21 to 2.26.25 by @dependabot in https://github.com/apache/iceberg/pull/10800 * Build: Bump nessie from 0.93.1 to 0.94.2 by @dependabot in https://github.com/apache/iceberg/pull/10798 * Build: Bump net.snowflake:snowflake-jdbc from 3.17.0 to 3.18.0 by @dependabot in https://github.com/apache/iceberg/pull/10801 * Build: Bump mkdocs-material from 9.5.29 to 9.5.30 by @dependabot in https://github.com/apache/iceberg/pull/10796 * Flink: Disabling flaky test TestIcebergSourceFailover.testBoundedWithSavepoint by @pvary in https://github.com/apache/iceberg/pull/10802 * Build: Bump mkdocs-awesome-pages-plugin from 2.9.2 to 2.9.3 by @dependabot in https://github.com/apache/iceberg/pull/10795 * Kafka Connect: Runtime distribution with integration tests by @bryanck in https://github.com/apache/iceberg/pull/10739 * Flink: improve snapshot compatibility check by comparing projected sort schema in SortKeySerializer by @stevenzwu in https://github.com/apache/iceberg/pull/10794 * Flink: support limit pushdown in FLIP-27 source by @stevenzwu in https://github.com/apache/iceberg/pull/10748 * Flink: Remove MiniClusterResource in Flink by @tomtongue in https://github.com/apache/iceberg/pull/10817 * Docs: Use link addresses instead of descriptions in releases.md by @lurnagao-dahua in https://github.com/apache/iceberg/pull/10815 * Build: Declare avro as an api dependency of iceberg-core by @devinrsmith in https://github.com/apache/iceberg/pull/10573 * Flink: backport PR #10748 for limit pushdown by @stevenzwu in https://github.com/apache/iceberg/pull/10813 * [DOCS] Fix header for entries metadata table by @gaborkaszab in https://github.com/apache/iceberg/pull/10826 * Support Spark Column Stats by @huaxingao in https://github.com/apache/iceberg/pull/10659 * Support for Flink's SpeculativeExecution in batch execution mode - Backport of PR #10548 by @venkata91 in https://github.com/apache/iceberg/pull/10776 * Infra: Improve feature request template by @nastra in https://github.com/apache/iceberg/pull/10825 * Core: (unit test) Replace the duplicated ALL_DATA_FILES with ALL_DELETE_FILES by @hsiang-c in https://github.com/apache/iceberg/pull/10836 * Core: Adds Basic Classes for Iceberg Table Version 3 by @RussellSpitzer in https://github.com/apache/iceberg/pull/10760 * Core: Allow SnapshotProducer to skip uncommitted manifest cleanup after commit by @grantatspothero in https://github.com/apache/iceberg/pull/10523 * Flink: a few small fixes or tuning for range partitioner by @stevenzwu in https://github.com/apache/iceberg/pull/10823 * Core: Drop support for Java 8 by @findepi in https://github.com/apache/iceberg/pull/10518 * Build: Bump com.adobe.testing:s3mock-junit5 from 2.11.0 to 2.17.0 by @nastra in https://github.com/apache/iceberg/pull/10851 * Core: Upgrade Jetty and Servlet API by @nastra in https://github.com/apache/iceberg/pull/10850 * Build for Java 11 by @snazy in https://github.com/apache/iceberg/pull/10849 * Build: Bump kafka from 3.7.1 to 3.8.0 by @dependabot in https://github.com/apache/iceberg/pull/10797 * Build: Update baseline gradle plugin to 5.58.0 by @findepi in https://github.com/apache/iceberg/pull/10788 * Flink: refactor sink tests to reduce the number of combinations with parameterized tests by @stevenzwu in https://github.com/apache/iceberg/pull/10777 * Flink: backport PR #10823 for range partitioner fixup by @stevenzwu in https://github.com/apache/iceberg/pull/10847 * Core: Remove reflection from TestParallelIterable by @findepi in https://github.com/apache/iceberg/pull/10857 * Spec: Deprecate the file system table scheme. by @rdblue in https://github.com/apache/iceberg/pull/10833 * Core, API: Add addNonDefaultSpec to UpdatePartitionSpec to not set the new partition spec as default by @shanielh in https://github.com/apache/iceberg/pull/10736 * Build: Bump com.palantir.baseline:gradle-baseline-java from 5.58.0 to 5.61.0 by @dependabot in https://github.com/apache/iceberg/pull/10864 * Build: Bump nessie from 0.94.2 to 0.94.4 by @dependabot in https://github.com/apache/iceberg/pull/10869 * Build: Bump org.xerial:sqlite-jdbc from 3.46.0.0 to 3.46.0.1 by @dependabot in https://github.com/apache/iceberg/pull/10871 * Build: Bump org.apache.commons:commons-compress from 1.26.0 to 1.26.2 by @dependabot in https://github.com/apache/iceberg/pull/10868 * Build: Bump software.amazon.awssdk:bom from 2.26.25 to 2.26.29 by @dependabot in https://github.com/apache/iceberg/pull/10866 * Build: Bump mkdocs-material from 9.5.30 to 9.5.31 by @dependabot in https://github.com/apache/iceberg/pull/10863 * Build: Fix Scala compilation by @snazy in https://github.com/apache/iceberg/pull/10860 * Build: Enable FormatStringAnnotation error-prone check by @findepi in https://github.com/apache/iceberg/pull/10856 * Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner by @nastra in https://github.com/apache/iceberg/pull/10858 * Aliyun: Replace assert usage with assertThat by @nastra in https://github.com/apache/iceberg/pull/10880 * Core: Extract filePath comparator into it's own class by @deniskuzZ in https://github.com/apache/iceberg/pull/10664 * Docs: Fix SQL in branching docs by @nakaken-churadata in https://github.com/apache/iceberg/pull/10876 * API: Add SupportsRecoveryOperations mixin for FileIO by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10711 * Spec: Clarify identity partition edge cases. by @emkornfield in https://github.com/apache/iceberg/pull/10835 * Build: Bump org.testcontainers:testcontainers from 1.20.0 to 1.20.1 by @dependabot in https://github.com/apache/iceberg/pull/10865 * Flink: add 1.20 support and remove 1.17 by @stevenzwu in https://github.com/apache/iceberg/pull/10881 * Build: Add checkstyle rule to ban assert usage by @nastra in https://github.com/apache/iceberg/pull/10886 * Build: Bump Apache Avro to 1.12.0 by @Fokko in https://github.com/apache/iceberg/pull/10879 * Spec: Fix rendering of unified partition struct by @findepi in https://github.com/apache/iceberg/pull/10896 * Docs: Nit Fix catalog name for S3 MRAP by @tomtongue in https://github.com/apache/iceberg/pull/10897 * Fix stage-binaries.sh and docs after #10881 by @snazy in https://github.com/apache/iceberg/pull/10888 * Flink: Remove deprecated RowDataUtil.clone method by @findepi in https://github.com/apache/iceberg/pull/10902 * AWS: Fix flaky TestS3RestSigner by @nastra in https://github.com/apache/iceberg/pull/10898 * AWS: Implement SupportsRecoveryOperations for S3FileIO by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10721 * Remove deprecated APIs up to 1.7.0 by @nk1506 in https://github.com/apache/iceberg/pull/10818 * Core, Flink: Fix build warnings by @nk1506 in https://github.com/apache/iceberg/pull/10899 * Build: Bump Spark 3.5 to 3.5.2 by @manuzhang in https://github.com/apache/iceberg/pull/10918 * Build: Bump com.google.errorprone:error_prone_annotations from 2.29.2 to 2.30.0 by @dependabot in https://github.com/apache/iceberg/pull/10915 * Build: Bump org.awaitility:awaitility from 4.2.1 to 4.2.2 by @dependabot in https://github.com/apache/iceberg/pull/10912 * Build: Bump datamodel-code-generator from 0.25.8 to 0.25.9 by @dependabot in https://github.com/apache/iceberg/pull/10917 * Build: Bump nessie from 0.94.4 to 0.95.0 by @dependabot in https://github.com/apache/iceberg/pull/10910 * Docs: Add Trademark symbol where appropriate by @Fokko in https://github.com/apache/iceberg/pull/10921 * Build: Bump com.google.cloud:libraries-bom from 26.43.0 to 26.44.0 by @dependabot in https://github.com/apache/iceberg/pull/10916 * Build: Bump org.apache.commons:commons-compress from 1.26.2 to 1.27.0 by @dependabot in https://github.com/apache/iceberg/pull/10914 * Build: Bump software.amazon.awssdk:bom from 2.26.29 to 2.27.2 by @dependabot in https://github.com/apache/iceberg/pull/10913 * Build: Bump org.xerial.snappy:snappy-java from 1.1.10.5 to 1.1.10.6 by @dependabot in https://github.com/apache/iceberg/pull/10911 * [Docs, Infra] Mount local versioned doc branch for testing by @gaborkaszab in https://github.com/apache/iceberg/pull/10838 * API: Fix JavaDoc typos in `Transaction` API by @hantangwangd in https://github.com/apache/iceberg/pull/10931 * Core: (unit test) Set partition to the right PartitionKey by @hsiang-c in https://github.com/apache/iceberg/pull/10925 * AWS, Core, Hive: Extract FileIO tracker/closer into separate class by @nastra in https://github.com/apache/iceberg/pull/10893 * Build warning fix. by @nk1506 in https://github.com/apache/iceberg/pull/10938 * Core: add JSON serialization for BaseFilesTable.ManifestReadTask, AllManifestsTable.ManifestListReadTask, and BaseEntriesTable.ManifestReadTask by @stevenzwu in https://github.com/apache/iceberg/pull/10735 * AWS, Core: Slim down Jetty config for tests by @nastra in https://github.com/apache/iceberg/pull/10945 * 1 Cloudera blog in February 2023 by @SaketaChalamchala in https://github.com/apache/iceberg/pull/10947 * Core: V3 Metadata Upgrade Validation and Testing by @leangjonathan in https://github.com/apache/iceberg/pull/10861 * OpenAPI: Clarify in REST spec that server implementations of commit endpoints must fail with 400 for unknown requirements/updates by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10848 * Build: Bump guava from 33.2.1-jre to 33.3.0-jre by @dependabot in https://github.com/apache/iceberg/pull/10960 * Build: Bump org.springframework:spring-web from 5.3.37 to 5.3.39 by @dependabot in https://github.com/apache/iceberg/pull/10959 * Build: Bump software.amazon.awssdk:bom from 2.27.2 to 2.27.7 by @dependabot in https://github.com/apache/iceberg/pull/10961 * Docs: Update MRAP endpoint and add more docs by @singhpk234 in https://github.com/apache/iceberg/pull/9362 * Flink: put everything together for range distribution in Flink sink by @stevenzwu in https://github.com/apache/iceberg/pull/10859 * Flink: FLIP-27 IcebergSource builder missed a couple of configs compared to old FlinkSource: expose locality and plan parallelism by @stevenzwu in https://github.com/apache/iceberg/pull/10957 * Build: Prevent implicit default locale/charset usage by @findepi in https://github.com/apache/iceberg/pull/10969 * Core: Add ManifestWrite benchmark by @Fokko in https://github.com/apache/iceberg/pull/8637 * AWS: Don't complete multipart upload on finalize for S3OutputStream by @jasonf20 in https://github.com/apache/iceberg/pull/10874 * Build: Enable UnusedMethod error-prone check by @findepi in https://github.com/apache/iceberg/pull/10968 * Upgrade to Gradle 8.10 by @jbonofre in https://github.com/apache/iceberg/pull/10976 * #10668 - Support case-insensitivity for column names in PartitionSpec by @sl255051 in https://github.com/apache/iceberg/pull/10678 * Core: Remove unused throws declarations by @findepi in https://github.com/apache/iceberg/pull/10974 * Flink: deprecate ReaderFunction with a new Converter interface to simplify user experience by @stevenzwu in https://github.com/apache/iceberg/pull/10956 * Core: Drop ParallelIterable's queue low water mark by @findepi in https://github.com/apache/iceberg/pull/10978 * Check for minimal queue size in ParallelIterable by @findepi in https://github.com/apache/iceberg/pull/10977 * Spark Action to Analyze table by @karuppayya in https://github.com/apache/iceberg/pull/10288 * Core,AWS: Fix NPE in ResolvingFileIO when HadoopConf is not set by @munendrasn in https://github.com/apache/iceberg/pull/10872 * Spark 3.5: Fix incorrect catalog loaded in TestCreateActions by @manuzhang in https://github.com/apache/iceberg/pull/10952 * Flink: Maintenance - TriggerManager by @pvary in https://github.com/apache/iceberg/pull/10484 * Flink: backport PR #10956 for converter interface that deprecates ReaderFunction by @stevenzwu in https://github.com/apache/iceberg/pull/10985 * Flink: backport PR #10777 from 1.19 to 1.18 for sink test refactoring. by @stevenzwu in https://github.com/apache/iceberg/pull/10965 * Spec: Minor modifications for v3 by @rdblue in https://github.com/apache/iceberg/pull/10948 * Flink: backport PR #10859 for range distribution by @stevenzwu in https://github.com/apache/iceberg/pull/10990 * Flink: Port #10484 to v1.20 by @pvary in https://github.com/apache/iceberg/pull/10989 * Flink: Maintenance - TableChange refactor by @pvary in https://github.com/apache/iceberg/pull/10992 * Flink: Port #10992 to v1.19 by @pvary in https://github.com/apache/iceberg/pull/10994 * OpenAPI: Add endpoint field to CatalogConfig by @nastra in https://github.com/apache/iceberg/pull/10928 * Spark 3.5: Add utility to load table state reliably by @aokolnychyi in https://github.com/apache/iceberg/pull/10984 * AWS: Include http-auth-aws-crt module into iceberg-aws-bundle by @aajisaka in https://github.com/apache/iceberg/pull/10972 * Build: Bump software.amazon.awssdk:bom from 2.27.7 to 2.27.12 by @dependabot in https://github.com/apache/iceberg/pull/11006 * Build: Bump org.apache.commons:commons-compress from 1.27.0 to 1.27.1 by @dependabot in https://github.com/apache/iceberg/pull/11005 * Build: Bump jetty from 11.0.22 to 11.0.23 by @dependabot in https://github.com/apache/iceberg/pull/11003 * Build: Bump mkdocs-material from 9.5.31 to 9.5.33 by @dependabot in https://github.com/apache/iceberg/pull/11002 * Docs: Fix wrong field name in CDC by @ebyhr in https://github.com/apache/iceberg/pull/11000 * Docs: Rename Clickhouse to ClickHouse by @ebyhr in https://github.com/apache/iceberg/pull/10998 * Flink: infer source parallelism for FLIP-27 source in batch execution mode by @stevenzwu in https://github.com/apache/iceberg/pull/10832 * Flink: Fix duplicate data with upsert writer in case of aborted checkpoints by @zhongqishang in https://github.com/apache/iceberg/pull/10526 * Introduces the new IcebergSink based on the new V2 Flink Sink Abstraction by @rodmeneses in https://github.com/apache/iceberg/pull/10179 * Flink: Backport PR #10179 to Flink 1.20 for v2 sink by @rodmeneses in https://github.com/apache/iceberg/pull/11011 * Core: Project data file stats only if there are equality deletes by @aokolnychyi in https://github.com/apache/iceberg/pull/11013 * Build: Bump org.xerial:sqlite-jdbc from 3.46.0.1 to 3.46.1.0 by @dependabot in https://github.com/apache/iceberg/pull/11007 * Docs: Add Druid docs url to sidebar by @techdocsmith in https://github.com/apache/iceberg/pull/10997 * Flink: backport PR #10832 of inferring parallelism in FLIP-27 source by @stevenzwu in https://github.com/apache/iceberg/pull/11009 * Add REST Compatibility Kit by @danielcweeks in https://github.com/apache/iceberg/pull/10908 * Core: Generate realistic bounds in benchmarks by @aokolnychyi in https://github.com/apache/iceberg/pull/11022 * OpenAPI, Build: Apply spotless to testFixtures source code by @danielcweeks in https://github.com/apache/iceberg/pull/11024 * Docs: bump latest version to 1.6.1 by @cwsteinbach in https://github.com/apache/iceberg/pull/11036 * OpenAPI: Add RemovePartitionSpecsUpdate REST update type by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10846 * Build: Ignore benchmark output folders across all modules by @aokolnychyi in https://github.com/apache/iceberg/pull/11030 * Core: Add benchmark for adding files by @aokolnychyi in https://github.com/apache/iceberg/pull/11029 * Spark 3.5: Use FileGenerationUtil in PlanningBenchmark by @aokolnychyi in https://github.com/apache/iceberg/pull/11027 * Flink: add unit tests for range distribution on bucket partition column by @stevenzwu in https://github.com/apache/iceberg/pull/11033 * Kafka Connect: Disable publish tasks in runtime project by @bryanck in https://github.com/apache/iceberg/pull/11032 * Flink: Backport PR #10526 to v1.18 and v1.20 by @zhongqishang in https://github.com/apache/iceberg/pull/11018 * Build: Bump mkdocs-material from 9.5.33 to 9.5.34 by @dependabot in https://github.com/apache/iceberg/pull/11062 * Build: Bump com.google.errorprone:error_prone_annotations from 2.30.0 to 2.31.0 by @dependabot in https://github.com/apache/iceberg/pull/11055 * API: implement types timestamp_ns and timestamptz_ns by @jacobmarble in https://github.com/apache/iceberg/pull/9008 * Core: Refactor ZOrderByteUtils by @ajantha-bhat in https://github.com/apache/iceberg/pull/10624 * Initial committer guidelines and requirements for merging by @emkornfield in https://github.com/apache/iceberg/pull/10780 * Flink: Fix compile warning by @ajantha-bhat in https://github.com/apache/iceberg/pull/11072 * Docs: Fix Flink 1.20 support versions by @manuzhang in https://github.com/apache/iceberg/pull/11065 * Build: Enable more error-prone checks by @findepi in https://github.com/apache/iceberg/pull/11078 * open-api: Fix compile warnings for testFixtures by @ajantha-bhat in https://github.com/apache/iceberg/pull/11071 * Spark 3.3, 3.4: Parallelize reading files in migrate procedures by @manuzhang in https://github.com/apache/iceberg/pull/11043 * Spark 3.5: Mandate identifier fields when create_changelog_view for table contain unsortable columns by @dramaticlly in https://github.com/apache/iceberg/pull/11045 * Core: Fix setting hasNewDataFile flag in MergingSnapshotProducer by @aokolnychyi in https://github.com/apache/iceberg/pull/11088 * Docs: Document accessing instance variables by @aokolnychyi in https://github.com/apache/iceberg/pull/11087 * Build: Bump jetty from 11.0.23 to 11.0.24 by @dependabot in https://github.com/apache/iceberg/pull/11096 * Spec: Fix rendering of partition stats file spec by @ajantha-bhat in https://github.com/apache/iceberg/pull/11068 * Build: Bump software.amazon.awssdk:bom from 2.27.12 to 2.27.21 by @dependabot in https://github.com/apache/iceberg/pull/11098 * Build: Bump io.netty:netty-buffer from 4.1.112.Final to 4.1.113.Final by @dependabot in https://github.com/apache/iceberg/pull/11097 * Spark 3.3, 3.4: Fix incorrect catalog loaded in TestCreateActions by @manuzhang in https://github.com/apache/iceberg/pull/11049 * Core: Fix the behavior of IncrementalFileCleanup when expire a snapshot by @hantangwangd in https://github.com/apache/iceberg/pull/10983 * Core, Kafka, Spark: Use AssertJ instead of JUnit assertions by @nastra in https://github.com/apache/iceberg/pull/11102 * Add rmoff blogs by @rmoff in https://github.com/apache/iceberg/pull/11069 * Upgrade to Gradle 8.10.1 by @jbonofre in https://github.com/apache/iceberg/pull/11104 * Build: Remove unused variables, fields and parameters by @findepi in https://github.com/apache/iceberg/pull/11101 * Add Scan Planning Endpoints to open api spec by @rahil-c in https://github.com/apache/iceberg/pull/9695 * Kafka Connect: Docs on configuring the sink by @bryanck in https://github.com/apache/iceberg/pull/10746 * Kafka Connect: Stop commits on terminated coordinator by @bryanck in https://github.com/apache/iceberg/pull/10814 * Build: Upgrade google-java-format to 1.22.0 by @manuzhang in https://github.com/apache/iceberg/pull/11050 * Flink: Maintenance - Lock remover by @pvary in https://github.com/apache/iceberg/pull/11010 * Docs: Update Project links to include contributing and REST spec by @danielcweeks in https://github.com/apache/iceberg/pull/11114 * Flink: Port #10484 to v1.19 (#11010) by @pvary in https://github.com/apache/iceberg/pull/11117 * OpenAPI: Fix YAML example and value json formatting by @danielcweeks in https://github.com/apache/iceberg/pull/11119 * Core: Parallelize manifest writing for many new files by @aokolnychyi in https://github.com/apache/iceberg/pull/11086 * API, Core: Add manifestLocation API to ContentFile by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11044 * Core: Allow servers to express supported endpoints via endpoint field in ConfigResponse by @nastra in https://github.com/apache/iceberg/pull/10929 * Hive: Add View support for HIVE catalog by @nk1506 in https://github.com/apache/iceberg/pull/9852 * Spark 3.4: Action to compute table stats by @karuppayya in https://github.com/apache/iceberg/pull/11106 * Docs: Fix missing options for remove_orphan_files procedure by @manuzhang in https://github.com/apache/iceberg/pull/11080 * Flink: Increase the number of checkpoints from 4 to 6 to fix flakiness. by @stevenzwu in https://github.com/apache/iceberg/pull/11121 * Spark 3.4: Add utility to load table state reliably by @dramaticlly in https://github.com/apache/iceberg/pull/11115 * Build: switch to slf4j-simple 2.x for test implementation dependency by @stevenzwu in https://github.com/apache/iceberg/pull/11001 * Core: Update metadata location without updating lastUpdatedMillis by @nastra in https://github.com/apache/iceberg/pull/11151 * Kafka Connect: separate CI workflow by @bryanck in https://github.com/apache/iceberg/pull/11075 * Core: Move internal struct projection to SupportsIndexProjection by @rdblue in https://github.com/apache/iceberg/pull/11132 * Core: Add explicit JSON parser for LoadTableResponse by @nastra in https://github.com/apache/iceberg/pull/11148 * Build: Add .java-version to gitignore. by @zhongyujiang in https://github.com/apache/iceberg/pull/11167 * Docs: Clarified Partition Transform by @jasonmfehr in https://github.com/apache/iceberg/pull/8337 * API, Core: Enable dropping rewritten delete files in RowDelta by @aokolnychyi in https://github.com/apache/iceberg/pull/11166 * Docs: `field_id` in name serialisation spec should read `field-id` by @jonaswk in https://github.com/apache/iceberg/pull/11135 * AWS: Bump AWS SDK to version 2.28.5 by @sullis in https://github.com/apache/iceberg/pull/11170 * Build: Bump org.xerial.snappy:snappy-java from 1.1.10.6 to 1.1.10.7 by @dependabot in https://github.com/apache/iceberg/pull/11140 * Supplement test case for `RollbackToTimestampProcedure` by @hantangwangd in https://github.com/apache/iceberg/pull/11171 * Docs: Uppercase keyword in branching by @ebyhr in https://github.com/apache/iceberg/pull/11172 * Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.3.1 to 5.4 by @dependabot in https://github.com/apache/iceberg/pull/11186 * Build: Bump tez010 from 0.10.3 to 0.10.4 by @dependabot in https://github.com/apache/iceberg/pull/11183 * Build: Bump nessie from 0.95.0 to 0.97.1 by @dependabot in https://github.com/apache/iceberg/pull/11184 * Build: Bump com.google.cloud:libraries-bom from 26.44.0 to 26.47.0 by @dependabot in https://github.com/apache/iceberg/pull/11185 * Build: Bump org.roaringbitmap:RoaringBitmap from 1.2.1 to 1.3.0 by @dependabot in https://github.com/apache/iceberg/pull/11187 * API: Deprecate ContentFile#path API and add location API which returns String by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11092 * [Docs] Update AWS docs to add more AWS engines that supports iceberg by @singhpk234 in https://github.com/apache/iceberg/pull/11192 * API, AWS: Retry S3InputStream reads by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10433 * AWS: Fix AWS doc URL by @laurentgo in https://github.com/apache/iceberg/pull/11198 * Build: Bump mkdocs-macros-plugin from 1.0.5 to 1.2.0 by @dependabot in https://github.com/apache/iceberg/pull/11189 * Core: Add rewritten delete files to write results by @aokolnychyi in https://github.com/apache/iceberg/pull/11203 * Core: Support iterating over positions in PositionDeleteIndex by @aokolnychyi in https://github.com/apache/iceberg/pull/11202 * Spark: Added merge schema as spark configuration by @aleenamg21-1 in https://github.com/apache/iceberg/pull/9640 * Core: Support merging in PositionDeleteIndex by @aokolnychyi in https://github.com/apache/iceberg/pull/11208 * Core: Remove unused code for streaming position deletes by @wypoon in https://github.com/apache/iceberg/pull/11175 * Upgrade to Gradle 8.10.2 by @jbonofre in https://github.com/apache/iceberg/pull/11212 * Core: Add a util to compute partition stats by @ajantha-bhat in https://github.com/apache/iceberg/pull/11146 * Parquet: update PruneColumns to inherit from TypeWithSchemaVisitor to have Iceberg type by @aihuaxu in https://github.com/apache/iceberg/pull/11179 * Core: Replace use of CharSequenceMap in DeleteFileIndex with Map<String, PositionDeletes> by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/11199 * [Minor][Test] Fix TestFastAppend.testAddManyFiles() by @anuragmantri in https://github.com/apache/iceberg/pull/11218 * Spark: Deprecate SparkAppenderFactory by @ajantha-bhat in https://github.com/apache/iceberg/pull/11076 * Build: Bump guava from 33.3.0-jre to 33.3.1-jre by @dependabot in https://github.com/apache/iceberg/pull/11230 * Build: Bump software.amazon.awssdk:bom from 2.28.5 to 2.28.11 by @dependabot in https://github.com/apache/iceberg/pull/11229 * Build: Bump io.delta:delta-standalone_2.12 from 3.2.0 to 3.2.1 by @dependabot in https://github.com/apache/iceberg/pull/11228 * Build: Bump junit-platform from 1.10.3 to 1.11.1 by @dependabot in https://github.com/apache/iceberg/pull/11227 * Build: Bump io.delta:delta-spark_2.12 from 3.2.0 to 3.2.1 by @dependabot in https://github.com/apache/iceberg/pull/11225 * Core: Improve error handling when parsing view representations by @nastra in https://github.com/apache/iceberg/pull/11236 * REST: Handle Requests with Page Sizes Exceeding Available Number of Namespaces /Tables/Views by @rcjverhoef in https://github.com/apache/iceberg/pull/11143 * Core: Support combining position deletes during writes by @aokolnychyi in https://github.com/apache/iceberg/pull/11222 * Core: Add DataFileSet / DeleteFileSet by @nastra in https://github.com/apache/iceberg/pull/11195 * Build: Bump nessie from 0.97.1 to 0.99.0 by @dependabot in https://github.com/apache/iceberg/pull/11224 * ThreadPools introduce newExitingWorkerPool and newFixedThreadPool for clearer semantics by @fengjiajie in https://github.com/apache/iceberg/pull/11073 * Core: Deprecate legacy ways for loading position deletes by @aokolnychyi in https://github.com/apache/iceberg/pull/11242 * AWS: Set better defaults for S3 retry behaviour by @ookumuso in https://github.com/apache/iceberg/pull/11052 * Puffin: Document stats `ndv` value representation by @findepi in https://github.com/apache/iceberg/pull/10793 * Build: Bump mkdocs-material from 9.5.34 to 9.5.38 by @dependabot in https://github.com/apache/iceberg/pull/11233 * Build: Bump org.eclipse.microprofile.openapi:microprofile-openapi-api from 3.1.1 to 3.1.2 by @dependabot in https://github.com/apache/iceberg/pull/11182 * Build: Bump org.xerial:sqlite-jdbc from 3.46.1.0 to 3.46.1.3 by @dependabot in https://github.com/apache/iceberg/pull/11231 * Build: Update baseline-java 5.69.0 by @findepi in https://github.com/apache/iceberg/pull/11252 * Build: Forbid implicit case fall-through without a comment and enable couple more recommendable error-prone checks by @findepi in https://github.com/apache/iceberg/pull/11251 * API, Core: Add default value APIs and Avro implementation by @wmoustafa in https://github.com/apache/iceberg/pull/9502 * AWS: Make sure overridden configurations are applied by @hsiang-c in https://github.com/apache/iceberg/pull/11274 * Build: Bump com.google.cloud:libraries-bom from 26.47.0 to 26.48.0 by @dependabot in https://github.com/apache/iceberg/pull/11271 * Core: Fix UnicodeUtil#truncateStringMax returns malformed string. by @zhongyujiang in https://github.com/apache/iceberg/pull/11161 * Core: Add internal Avro reader by @rdblue in https://github.com/apache/iceberg/pull/11108 * Arrow: Remove dead code by @wypoon in https://github.com/apache/iceberg/pull/11276 * Spec: Add v3 types and type promotion by @rdblue in https://github.com/apache/iceberg/pull/10955 * Build: Bump mkdocs-material from 9.5.38 to 9.5.39 by @dependabot in https://github.com/apache/iceberg/pull/11272 * Build: Bump com.google.errorprone:error_prone_annotations from 2.31.0 to 2.33.0 by @dependabot in https://github.com/apache/iceberg/pull/11270 * Build: Bump junit-platform from 1.11.1 to 1.11.2 by @dependabot in https://github.com/apache/iceberg/pull/11266 * Build: Bump org.testcontainers:testcontainers from 1.20.1 to 1.20.2 by @dependabot in https://github.com/apache/iceberg/pull/11265 * Build: Bump io.netty:netty-buffer from 4.1.113.Final to 4.1.114.Final by @dependabot in https://github.com/apache/iceberg/pull/11269 * Build: Bump software.amazon.awssdk:bom from 2.28.11 to 2.28.16 by @dependabot in https://github.com/apache/iceberg/pull/11268 * Build: Bump jackson-bom from 2.14.2 to 2.18.0 by @dependabot in https://github.com/apache/iceberg/pull/11226 * Build: Bump datamodel-code-generator from 0.25.9 to 0.26.1 by @dependabot in https://github.com/apache/iceberg/pull/11234 * Build: Bump software.amazon.s3.accessgrants:aws-s3-accessgrants-java-plugin from 2.0.0 to 2.0.1 by @dependabot in https://github.com/apache/iceberg/pull/9705 * Build: Bump net.snowflake:snowflake-jdbc from 3.18.0 to 3.19.0 by @dependabot in https://github.com/apache/iceberg/pull/11057 * Build: Bump org.apache.hadoop.thirdparty:hadoop-shaded-guava from 1.2.0 to 1.3.0 by @dependabot in https://github.com/apache/iceberg/pull/11061 * Arrow: Deprecate unused fixed width binary reader classes by @wypoon in https://github.com/apache/iceberg/pull/11292 * Api, Spark: Make StrictMetricsEvaluator not fail on nested column predicates by @zhongyujiang in https://github.com/apache/iceberg/pull/11261 * Build: Use the active shadow plugin by @ajantha-bhat in https://github.com/apache/iceberg/pull/11315 * Build: Bump software.amazon.awssdk:bom from 2.28.16 to 2.28.21 by @dependabot in https://github.com/apache/iceberg/pull/11311 * Build: Bump org.apache.datasketches:datasketches-java from 6.0.0 to 6.1.1 by @dependabot in https://github.com/apache/iceberg/pull/11307 * Core: Switch usage to DataFileSet / DeleteFileSet by @nastra in https://github.com/apache/iceberg/pull/11158 * [AWS] S3FileIO - Add Cross-Region Bucket Access by @munendrasn in https://github.com/apache/iceberg/pull/11259 * Core: Deprecate ContentCache.invalidateAll by @findepi in https://github.com/apache/iceberg/pull/10494 * Remove unnecessary copying of FileScanTask by @huaxingao in https://github.com/apache/iceberg/pull/11319 * Core: Rename DeleteFileHolder to PendingDeleteFile / Optimize duplicate data/delete file detection by @nastra in https://github.com/apache/iceberg/pull/11254 * Core: Fix version number in deprecation note for invalidateAll by @findepi in https://github.com/apache/iceberg/pull/11325 * Bump junit from 5.10.1 to 5.11.1 by @tomtongue in https://github.com/apache/iceberg/pull/11262 * Support wasb[s] paths in ADLSFileIO by @mrcnc in https://github.com/apache/iceberg/pull/11294 * Make connect compatable with kafka plugin.discovery by @joswlv in https://github.com/apache/iceberg/pull/10536 * Updating SparkScan to only read Apache DataSketches by @jeesou in https://github.com/apache/iceberg/pull/11035 * add checkClassName regex func by @ryanjclark in https://github.com/apache/iceberg/pull/11303 * Remove repeated 'for' by @ebyhr in https://github.com/apache/iceberg/pull/11338 * AWS: Fix S3InputStream retry policy by @edgarRd in https://github.com/apache/iceberg/pull/11335 * Small fix to TestSerializableTypes.java by @aihuaxu in https://github.com/apache/iceberg/pull/11342 * Core: fix NPE with HadoopFileIO because FileIOParser doesn't serialize Hadoop configuration by @stevenzwu in https://github.com/apache/iceberg/pull/10926 * Revert "Support wasb[s] paths in ADLSFileIO" by @RussellSpitzer in https://github.com/apache/iceberg/pull/11344 * Flink: make FLIP-27 default in SQL and mark the old FlinkSource as deprecated by @stevenzwu in https://github.com/apache/iceberg/pull/11345 * Flink: disable the flaky range distribution bucketing tests for now by @stevenzwu in https://github.com/apache/iceberg/pull/11347 * OpenAPI: Standardize credentials in loadTable/loadView responses by @nastra in https://github.com/apache/iceberg/pull/10722 * Core: Add credentials to loadTable / loadView responses by @nastra in https://github.com/apache/iceberg/pull/11173 * Spark: Add RewriteTablePath action interface by @laithalzyoud in https://github.com/apache/iceberg/pull/10920 * AWS: Update ObjectStorageLocationProvider hash to optimize for S3 performance by @ookumuso in https://github.com/apache/iceberg/pull/11112 * Flink: Add IcebergSinkBuilder interface allowed unification of most of operations on FlinkSink and IcebergSink Builders by @arkadius in https://github.com/apache/iceberg/pull/11305 * Build: Bump parquet from 1.13.1 to 1.14.3 by @dependabot in https://github.com/apache/iceberg/pull/11264 * Build: Bump com.palantir.baseline:gradle-baseline-java from 5.69.0 to 5.72.0 by @dependabot in https://github.com/apache/iceberg/pull/11362 * Build: Bump com.google.errorprone:error_prone_annotations from 2.33.0 to 2.34.0 by @dependabot in https://github.com/apache/iceberg/pull/11360 * Build: Bump software.amazon.awssdk:bom from 2.28.21 to 2.28.26 by @dependabot in https://github.com/apache/iceberg/pull/11359 * Build: Bump com.google.cloud:libraries-bom from 26.48.0 to 26.49.0 by @dependabot in https://github.com/apache/iceberg/pull/11363 * Core: code clean up for deleteRemovedMetadataFiles by @leesf in https://github.com/apache/iceberg/pull/11352 * Arrow: Fix indexing in Parquet dictionary encoded values readers by @wypoon in https://github.com/apache/iceberg/pull/11247 * Spark 3.5: Update Spark to use planned Avro reads by @rdblue in https://github.com/apache/iceberg/pull/11299 * Core, Spark: Remove dangling deletes as part of RewriteDataFilesAction by @dramaticlly in https://github.com/apache/iceberg/pull/9724 * Spark: Randomize view/function names in testing by @nastra in https://github.com/apache/iceberg/pull/11381 * Spark 3.4: Randomize view/function names in testing by @nastra in https://github.com/apache/iceberg/pull/11382 * Spark 3.4: Action to remove dangling deletes by @dramaticlly in https://github.com/apache/iceberg/pull/11377 * Reset Spark Conf for each test in TestCompressionSettings by @huaxingao in https://github.com/apache/iceberg/pull/11333 * Spec: Adds Row Lineage by @RussellSpitzer in https://github.com/apache/iceberg/pull/11130 * AWS: Support S3 directory bucket listing by @stubz151 in https://github.com/apache/iceberg/pull/11021 * Core: Add LoadCredentialsResponse class/parser by @nastra in https://github.com/apache/iceberg/pull/11339 * OpenAPI: Add endpoint to retrieve valid credentials for a given table by @nastra in https://github.com/apache/iceberg/pull/11281 * AWS: Use testcontainers-minio instead of S3Mock by @sullis in https://github.com/apache/iceberg/pull/11349 * Kafka Connect: Include third party licenses and notices in distribution by @bryanck in https://github.com/apache/iceberg/pull/10829 * Deprecate iceberg-pig by @jbonofre in https://github.com/apache/iceberg/pull/11379 * Core: Track data files by spec id instead of full PartitionSpec by @nastra in https://github.com/apache/iceberg/pull/11323 * Spark 3.5: Don't change table distribution when only altering local order by @manuzhang in https://github.com/apache/iceberg/pull/10774 * Spec: Fix table of content generation by @ajantha-bhat in https://github.com/apache/iceberg/pull/11067 * [KafkaConnect] Fix RecordConverter for UUID and Fixed Types by @singhpk234 in https://github.com/apache/iceberg/pull/11346 * Core: Snapshot `summary` map must have `operation` key by @kevinjqliu in https://github.com/apache/iceberg/pull/11354 * Core: Update TableMetadataParser to ensure all streams closed by @erik-grepr in https://github.com/apache/iceberg/pull/11220 * Build: Bump Spark 3.4 to 3.4.4 by @manuzhang in https://github.com/apache/iceberg/pull/11366 * Build: Bump junit from 5.11.1 to 5.11.3 by @dependabot in https://github.com/apache/iceberg/pull/11401 * Build: Bump software.amazon.awssdk:bom from 2.28.26 to 2.29.1 by @dependabot in https://github.com/apache/iceberg/pull/11400 * Core: Remove one comment from FastAppend by @gaborkaszab in https://github.com/apache/iceberg/pull/10995 * Build: Bump junit-platform from 1.11.2 to 1.11.3 by @dependabot in https://github.com/apache/iceberg/pull/11402 * Build: Bump org.xerial:sqlite-jdbc from 3.46.1.3 to 3.47.0.0 by @dependabot in https://github.com/apache/iceberg/pull/11407 * Build: Bump software.amazon.s3.accessgrants:aws-s3-accessgrants-java-plugin from 2.2.0 to 2.3.0 by @dependabot in https://github.com/apache/iceberg/pull/11405 * Build: Bump net.snowflake:snowflake-jdbc from 3.19.0 to 3.19.1 by @dependabot in https://github.com/apache/iceberg/pull/11406 * Build: Bump testcontainers from 1.20.2 to 1.20.3 by @dependabot in https://github.com/apache/iceberg/pull/11404 * Build: Bump com.google.errorprone:error_prone_annotations from 2.34.0 to 2.35.1 by @dependabot in https://github.com/apache/iceberg/pull/11403 * Build: Bump mkdocs-macros-plugin from 1.2.0 to 1.3.7 by @dependabot in https://github.com/apache/iceberg/pull/11399 * Build: Bump mkdocs-material from 9.5.39 to 9.5.42 by @dependabot in https://github.com/apache/iceberg/pull/11398 * Flink: Fix disabling flaky range distribution bucketing tests by @manuzhang in https://github.com/apache/iceberg/pull/11410 * Bump Azurite to the latest version by @Fokko in https://github.com/apache/iceberg/pull/11411 * Build: Bump datamodel-code-generator from 0.26.1 to 0.26.2 by @dependabot in https://github.com/apache/iceberg/pull/11356 * Revert "Core: Snapshot `summary` map must have `operation` key" by @kevinjqliu in https://github.com/apache/iceberg/pull/11409 * Aliyun: Remove spring-boot dependency by @jbonofre in https://github.com/apache/iceberg/pull/11291 * Build: Bump com.azure:azure-sdk-bom from 1.2.25 to 1.2.28 by @dependabot in https://github.com/apache/iceberg/pull/11267 * Spark 3.5: Fix flaky test due to deleting temp directory failure by @manuzhang in https://github.com/apache/iceberg/pull/10811 * Core: Add portable Roaring bitmap for row positions by @aokolnychyi in https://github.com/apache/iceberg/pull/11372 * Flink 1.20: Update Flink to use planned Avro reads by @jbonofre in https://github.com/apache/iceberg/pull/11386 * open-api: Fix testFixtures dependencies by @ajantha-bhat in https://github.com/apache/iceberg/pull/11422 * Core: use ManifestFiles.open when possible by @dramaticlly in https://github.com/apache/iceberg/pull/11414 * GCS: Refresh vended credentials by @nastra in https://github.com/apache/iceberg/pull/11282 * New iceberg blogs nov 2024 by @AlexMercedCoder in https://github.com/apache/iceberg/pull/11424 * AWS: Refresh vended credentials by @nastra in https://github.com/apache/iceberg/pull/11389 * Dependencies: Bump Hadoop to 3.4.1 by @Fokko in https://github.com/apache/iceberg/pull/11428 * Core: Remove credentials from LoadViewResponse by @nastra in https://github.com/apache/iceberg/pull/11432 * OpenAPI: Remove credentials from LoadViewResult by @nastra in https://github.com/apache/iceberg/pull/11433 * API: Add compatibility checks for Schemas with default values by @rdblue in https://github.com/apache/iceberg/pull/11434 * 1.7.0-RC1 Cherry-picks by @RussellSpitzer in https://github.com/apache/iceberg/pull/11466 ## New Contributors * @venkata91 made their first contribution in https://github.com/apache/iceberg/pull/10548 * @ritwika314 made their first contribution in https://github.com/apache/iceberg/pull/10756 * @shanielh made their first contribution in https://github.com/apache/iceberg/pull/10736 * @nakaken-churadata made their first contribution in https://github.com/apache/iceberg/pull/10876 * @SaketaChalamchala made their first contribution in https://github.com/apache/iceberg/pull/10947 * @leangjonathan made their first contribution in https://github.com/apache/iceberg/pull/10861 * @sl255051 made their first contribution in https://github.com/apache/iceberg/pull/10678 * @techdocsmith made their first contribution in https://github.com/apache/iceberg/pull/10997 * @rmoff made their first contribution in https://github.com/apache/iceberg/pull/11069 * @jasonmfehr made their first contribution in https://github.com/apache/iceberg/pull/8337 * @jonaswk made their first contribution in https://github.com/apache/iceberg/pull/11135 * @laurentgo made their first contribution in https://github.com/apache/iceberg/pull/11198 * @aleenamg21-1 made their first contribution in https://github.com/apache/iceberg/pull/9640 * @aihuaxu made their first contribution in https://github.com/apache/iceberg/pull/11179 * @rcjverhoef made their first contribution in https://github.com/apache/iceberg/pull/11143 * @ookumuso made their first contribution in https://github.com/apache/iceberg/pull/11052 * @joswlv made their first contribution in https://github.com/apache/iceberg/pull/10536 * @jeesou made their first contribution in https://github.com/apache/iceberg/pull/11035 * @ryanjclark made their first contribution in https://github.com/apache/iceberg/pull/11303 * @laithalzyoud made their first contribution in https://github.com/apache/iceberg/pull/10920 * @arkadius made their first contribution in https://github.com/apache/iceberg/pull/11305 * @leesf made their first contribution in https://github.com/apache/iceberg/pull/11352 * @stubz151 made their first contribution in https://github.com/apache/iceberg/pull/11021 * @erik-grepr made their first contribution in https://github.com/apache/iceberg/pull/11220 **Full Changelog**: https://github.com/apache/iceberg/compare/apache-iceberg-1.6.0...apache-iceberg-1.7.0
## What's Changed * Core: Limit ParallelIterable memory consumption by yielding in tasks by @raunaqmorarka in https://github.com/apache/iceberg/pull/10787 * [1.6] Core: Drop ParallelIterable's queue low water mark by @findepi in https://github.com/apache/iceberg/pull/10979 * Build: Bump orc from 1.9.3 to 1.9.4 (#10728) by @Fokko in https://github.com/apache/iceberg/pull/10988 ## New Contributors * @raunaqmorarka made their first contribution in https://github.com/apache/iceberg/pull/10787 **Full Changelog**: https://github.com/apache/iceberg/compare/apache-iceberg-1.6.0...apache-iceberg-1.6.1
## What's Changed * API, Spark 3.3: Remove all usages of deprecated AssertHelpers by @findepi in https://github.com/apache/iceberg/pull/10500 * API: Fix default FileIO#newInputFile ManifestFile, DataFile and DeleteFile implementation to pass lengths by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/9953 * AWS, Core: Replace .withFailMessage() usage with .as() by @nastra in https://github.com/apache/iceberg/pull/10000 * AWS: Fix TestGlueCatalogTable#testCreateTable by @aajisaka in https://github.com/apache/iceberg/pull/10221 * AWS: Make sure Signer + User Agent config are both applied by @nastra in https://github.com/apache/iceberg/pull/10198 * AWS: Retain Glue Catalog column comment after updating Iceberg table by @lawofcycles in https://github.com/apache/iceberg/pull/10276 * AWS: Retain Glue Catalog table description after updating Iceberg table by @aajisaka in https://github.com/apache/iceberg/pull/10199 * AWS: Support S3 DSSE-KMS encryption by @aajisaka in https://github.com/apache/iceberg/pull/8370 * AWS: close underlying executor for DynamoDb LockManager by @regadas in https://github.com/apache/iceberg/pull/10132 * Add 13 Dremio Blogs + Fix a few incorrect dates by @AlexMercedCoder in https://github.com/apache/iceberg/pull/9967 * Add EnumConfParser to SparkConfParser by @huaxingao in https://github.com/apache/iceberg/pull/10311 * Add Pagination To List Apis by @rahil-c in https://github.com/apache/iceberg/pull/9782 * Add bloom filter fpp config by @huaxingao in https://github.com/apache/iceberg/pull/10149 * Add checkstyle rule for uppercase constant fields by @attilakreiner in https://github.com/apache/iceberg/pull/10673 * Add issue template and docs for iceberg proposals by @danielcweeks in https://github.com/apache/iceberg/pull/9932 * Add local nightly build to test current docs changes by @bitsondatadev in https://github.com/apache/iceberg/pull/9943 * Add stale PRs management by @jbonofre in https://github.com/apache/iceberg/pull/10134 * Add support for providing output-spec-id during rewrite - spark 3.5 by @himadripal in https://github.com/apache/iceberg/pull/9803 * Address Intellij inspection findings by @snazy in https://github.com/apache/iceberg/pull/10583 * Allow Java 17 in contribute.md by @findepi in https://github.com/apache/iceberg/pull/10545 * Apply IntelliJ inspection findings to older Spark + Flink versions by @snazy in https://github.com/apache/iceberg/pull/10625 * Avoid adding a closed client to the pool by @flyrain in https://github.com/apache/iceberg/pull/10337 * Aws: Add Iceberg version to UserAgent in S3 requests by @CsengerG in https://github.com/apache/iceberg/pull/9963 * Backport Flink 1.18 JUnit5 migration to Flink 1.17 by @tomtongue in https://github.com/apache/iceberg/pull/10163 * Backport HadoopCatalog related classes in Flink by @tomtongue in https://github.com/apache/iceberg/pull/10620 * Backport source package changes in Flink to other versions by @tomtongue in https://github.com/apache/iceberg/pull/10663 * Basic manifest encryption by @ggershinsky in https://github.com/apache/iceberg/pull/8252 * Build: Align Jackson versions by @nastra in https://github.com/apache/iceberg/pull/9925 * Build: Bump Nessie to 0.90.4 by @adutra in https://github.com/apache/iceberg/pull/10492 * Build: Bump Nessie to 0.91.2 by @adutra in https://github.com/apache/iceberg/pull/10563 * Build: Bump Spark 3.5 to 3.5.1 by @manuzhang in https://github.com/apache/iceberg/pull/9832 * Build: Bump arrow from 15.0.0 to 15.0.1 by @dependabot in https://github.com/apache/iceberg/pull/9910 * Build: Bump arrow from 15.0.1 to 15.0.2 by @dependabot in https://github.com/apache/iceberg/pull/10034 * Build: Bump com.azure:azure-sdk-bom from 1.2.20 to 1.2.21 by @dependabot in https://github.com/apache/iceberg/pull/9857 * Build: Bump com.azure:azure-sdk-bom from 1.2.21 to 1.2.22 by @dependabot in https://github.com/apache/iceberg/pull/10071 * Build: Bump com.azure:azure-sdk-bom from 1.2.22 to 1.2.23 by @dependabot in https://github.com/apache/iceberg/pull/10238 * Build: Bump com.azure:azure-sdk-bom from 1.2.23 to 1.2.24 by @dependabot in https://github.com/apache/iceberg/pull/10420 * Build: Bump com.azure:azure-sdk-bom from 1.2.24 to 1.2.25 by @dependabot in https://github.com/apache/iceberg/pull/10652 * Build: Bump com.esotericsoftware:kryo from 4.0.2 to 4.0.3 by @dependabot in https://github.com/apache/iceberg/pull/9984 * Build: Bump com.google.cloud:libraries-bom from 26.28.0 to 26.43.0 by @dependabot in https://github.com/apache/iceberg/pull/10699 * Build: Bump com.google.errorprone:error_prone_annotations from 2.24.1 to 2.26.1 by @dependabot in https://github.com/apache/iceberg/pull/9972 * Build: Bump com.google.errorprone:error_prone_annotations from 2.26.1 to 2.27.0 by @dependabot in https://github.com/apache/iceberg/pull/10236 * Build: Bump com.google.errorprone:error_prone_annotations from 2.27.0 to 2.28.0 by @dependabot in https://github.com/apache/iceberg/pull/10418 * Build: Bump com.gorylenko.gradle-git-properties:gradle-git-properties from 2.4.1 to 2.4.2 by @dependabot in https://github.com/apache/iceberg/pull/10239 * Build: Bump com.palantir.gradle.gitversion:gradle-git-version from 3.0.0 to 3.1.0 by @dependabot in https://github.com/apache/iceberg/pull/10468 * Build: Bump datamodel-code-generator from 0.25.4 to 0.25.5 by @dependabot in https://github.com/apache/iceberg/pull/9979 * Build: Bump datamodel-code-generator from 0.25.5 to 0.25.6 by @dependabot in https://github.com/apache/iceberg/pull/10242 * Build: Bump datamodel-code-generator from 0.25.6 to 0.25.7 by @dependabot in https://github.com/apache/iceberg/pull/10507 * Build: Bump datamodel-code-generator from 0.25.7 to 0.25.8 by @dependabot in https://github.com/apache/iceberg/pull/10649 * Build: Bump gradle.plugin.io.morethan.jmhreport:gradle-jmh-report from 0.9.0 to 0.9.6 by @dependabot in https://github.com/apache/iceberg/pull/10193 * Build: Bump guava from 33.0.0-jre to 33.1.0-jre by @dependabot in https://github.com/apache/iceberg/pull/9977 * Build: Bump guava from 33.1.0-jre to 33.2.0-jre by @dependabot in https://github.com/apache/iceberg/pull/10271 * Build: Bump guava from 33.2.0-jre to 33.2.1-jre by @dependabot in https://github.com/apache/iceberg/pull/10414 * Build: Bump io.airlift:aircompressor from 0.26 to 0.27 by @dependabot in https://github.com/apache/iceberg/pull/10383 * Build: Bump io.delta:delta-spark_2.12 from 3.1.0 to 3.2.0 by @dependabot in https://github.com/apache/iceberg/pull/10320 * Build: Bump io.delta:delta-standalone_2.12 from 3.1.0 to 3.2.0 by @dependabot in https://github.com/apache/iceberg/pull/10321 * Build: Bump io.github.goooler.shadow:shadow-gradle-plugin from 8.1.7 to 8.1.8 by @dependabot in https://github.com/apache/iceberg/pull/10612 * Build: Bump io.netty:netty-buffer from 4.1.107.Final to 4.1.108.Final by @dependabot in https://github.com/apache/iceberg/pull/10032 * Build: Bump io.netty:netty-buffer from 4.1.108.Final to 4.1.109.Final by @dependabot in https://github.com/apache/iceberg/pull/10191 * Build: Bump io.netty:netty-buffer from 4.1.109.Final to 4.1.110.Final by @dependabot in https://github.com/apache/iceberg/pull/10384 * Build: Bump io.netty:netty-buffer from 4.1.110.Final to 4.1.111.Final by @dependabot in https://github.com/apache/iceberg/pull/10504 * Build: Bump jetty from 9.4.53.v20231009 to 9.4.54.v20240208 by @dependabot in https://github.com/apache/iceberg/pull/9982 * Build: Bump jetty from 9.4.54.v20240208 to 9.4.55.v20240627 by @dependabot in https://github.com/apache/iceberg/pull/10654 * Build: Bump kafka from 3.6.1 to 3.7.0 by @dependabot in https://github.com/apache/iceberg/pull/9855 * Build: Bump kafka from 3.7.0 to 3.7.1 by @dependabot in https://github.com/apache/iceberg/pull/10653 * Build: Bump mkdocs-material from 9.5.14 to 9.5.15 by @dependabot in https://github.com/apache/iceberg/pull/10031 * Build: Bump mkdocs-material from 9.5.15 to 9.5.17 by @dependabot in https://github.com/apache/iceberg/pull/10092 * Build: Bump mkdocs-material from 9.5.17 to 9.5.18 by @dependabot in https://github.com/apache/iceberg/pull/10189 * Build: Bump mkdocs-material from 9.5.18 to 9.5.19 by @dependabot in https://github.com/apache/iceberg/pull/10241 * Build: Bump mkdocs-material from 9.5.19 to 9.5.21 by @dependabot in https://github.com/apache/iceberg/pull/10272 * Build: Bump mkdocs-material from 9.5.21 to 9.5.23 by @dependabot in https://github.com/apache/iceberg/pull/10353 * Build: Bump mkdocs-material from 9.5.23 to 9.5.25 by @dependabot in https://github.com/apache/iceberg/pull/10413 * Build: Bump mkdocs-material from 9.5.25 to 9.5.26 by @dependabot in https://github.com/apache/iceberg/pull/10464 * Build: Bump mkdocs-material from 9.5.26 to 9.5.27 by @dependabot in https://github.com/apache/iceberg/pull/10555 * Build: Bump mkdocs-material from 9.5.27 to 9.5.28 by @dependabot in https://github.com/apache/iceberg/pull/10648 * Build: Bump mkdocs-material from 9.5.9 to 9.5.14 by @dependabot in https://github.com/apache/iceberg/pull/9983 * Build: Bump nessie from 0.77.1 to 0.79.0 by @dependabot in https://github.com/apache/iceberg/pull/9976 * Build: Bump nessie from 0.79.0 to 0.80.0 by @dependabot in https://github.com/apache/iceberg/pull/10237 * Build: Bump nessie from 0.80.0 to 0.81.1 by @dependabot in https://github.com/apache/iceberg/pull/10267 * Build: Bump nessie from 0.81.1 to 0.82.0 by @dependabot in https://github.com/apache/iceberg/pull/10318 * Build: Bump nessie from 0.82.0 to 0.83.2 by @dependabot in https://github.com/apache/iceberg/pull/10381 * Build: Bump nessie from 0.90.4 to 0.91.1 by @dependabot in https://github.com/apache/iceberg/pull/10551 * Build: Bump nessie from 0.91.2 to 0.91.3 by @dependabot in https://github.com/apache/iceberg/pull/10608 * Build: Bump nessie from 0.92.0 to 0.92.1 by @dependabot in https://github.com/apache/iceberg/pull/10697 * Build: Bump net.snowflake:snowflake-jdbc from 3.14.5 to 3.15.1 by @dependabot in https://github.com/apache/iceberg/pull/10095 * Build: Bump net.snowflake:snowflake-jdbc from 3.15.1 to 3.16.0 by @dependabot in https://github.com/apache/iceberg/pull/10269 * Build: Bump net.snowflake:snowflake-jdbc from 3.16.0 to 3.16.1 by @dependabot in https://github.com/apache/iceberg/pull/10419 * Build: Bump net.snowflake:snowflake-jdbc from 3.16.1 to 3.17.0 by @dependabot in https://github.com/apache/iceberg/pull/10696 * Build: Bump orc from 1.9.2 to 1.9.3 by @dependabot in https://github.com/apache/iceberg/pull/10033 * Build: Bump org.assertj:assertj-core from 3.25.3 to 3.26.0 by @dependabot in https://github.com/apache/iceberg/pull/10416 * Build: Bump org.assertj:assertj-core from 3.26.0 to 3.26.3 by @dependabot in https://github.com/apache/iceberg/pull/10698 * Build: Bump org.awaitility:awaitility from 4.2.0 to 4.2.1 by @dependabot in https://github.com/apache/iceberg/pull/9970 * Build: Bump org.glassfish.jaxb:jaxb-runtime from 2.3.3 to 2.3.9 by @dependabot in https://github.com/apache/iceberg/pull/9988 * Build: Bump org.roaringbitmap:RoaringBitmap from 1.0.1 to 1.0.5 by @dependabot in https://github.com/apache/iceberg/pull/9911 * Build: Bump org.roaringbitmap:RoaringBitmap from 1.0.5 to 1.0.6 by @dependabot in https://github.com/apache/iceberg/pull/10190 * Build: Bump org.roaringbitmap:RoaringBitmap from 1.0.6 to 1.1.0 by @dependabot in https://github.com/apache/iceberg/pull/10552 * Build: Bump org.roaringbitmap:RoaringBitmap from 1.1.0 to 1.2.0 by @dependabot in https://github.com/apache/iceberg/pull/10655 * Build: Bump org.scala-lang.modules:scala-collection-compat_2.13 from 2.11.0 to 2.12.0 by @dependabot in https://github.com/apache/iceberg/pull/10195 * Build: Bump org.springframework:spring-web from 5.3.30 to 5.3.33 by @dependabot in https://github.com/apache/iceberg/pull/9989 * Build: Bump org.springframework:spring-web from 5.3.33 to 5.3.34 by @dependabot in https://github.com/apache/iceberg/pull/10139 * Build: Bump org.springframework:spring-web from 5.3.34 to 5.3.35 by @dependabot in https://github.com/apache/iceberg/pull/10354 * Build: Bump org.springframework:spring-web from 5.3.35 to 5.3.36 by @dependabot in https://github.com/apache/iceberg/pull/10382 * Build: Bump org.springframework:spring-web from 5.3.36 to 5.3.37 by @dependabot in https://github.com/apache/iceberg/pull/10503 * Build: Bump org.testcontainers:testcontainers from 1.19.5 to 1.19.7 by @dependabot in https://github.com/apache/iceberg/pull/9912 * Build: Bump org.testcontainers:testcontainers from 1.19.7 to 1.19.8 by @dependabot in https://github.com/apache/iceberg/pull/10322 * Build: Bump org.xerial:sqlite-jdbc from 3.45.1.0 to 3.45.2.0 by @dependabot in https://github.com/apache/iceberg/pull/9974 * Build: Bump org.xerial:sqlite-jdbc from 3.45.2.0 to 3.45.3.0 by @dependabot in https://github.com/apache/iceberg/pull/10194 * Build: Bump org.xerial:sqlite-jdbc from 3.45.3.0 to 3.46.0.0 by @dependabot in https://github.com/apache/iceberg/pull/10415 * Build: Bump software.amazon.awssdk:bom from 2.24.5 to 2.25.18 by @dependabot in https://github.com/apache/iceberg/pull/10050 * Build: Bump software.amazon.awssdk:bom from 2.25.18 to 2.25.21 by @dependabot in https://github.com/apache/iceberg/pull/10072 * Build: Bump software.amazon.awssdk:bom from 2.25.21 to 2.25.31 by @dependabot in https://github.com/apache/iceberg/pull/10138 * Build: Bump software.amazon.awssdk:bom from 2.25.31 to 2.25.35 by @dependabot in https://github.com/apache/iceberg/pull/10192 * Build: Bump software.amazon.awssdk:bom from 2.25.35 to 2.25.40 by @dependabot in https://github.com/apache/iceberg/pull/10240 * Build: Bump software.amazon.awssdk:bom from 2.25.40 to 2.25.45 by @dependabot in https://github.com/apache/iceberg/pull/10266 * Build: Bump software.amazon.awssdk:bom from 2.25.45 to 2.25.50 by @dependabot in https://github.com/apache/iceberg/pull/10323 * Build: Bump software.amazon.awssdk:bom from 2.25.50 to 2.25.57 by @dependabot in https://github.com/apache/iceberg/pull/10367 * Build: Bump software.amazon.awssdk:bom from 2.25.57 to 2.25.60 by @dependabot in https://github.com/apache/iceberg/pull/10385 * Build: Bump software.amazon.awssdk:bom from 2.25.60 to 2.25.64 by @dependabot in https://github.com/apache/iceberg/pull/10421 * Build: Bump software.amazon.awssdk:bom from 2.25.64 to 2.25.69 by @dependabot in https://github.com/apache/iceberg/pull/10466 * Build: Bump software.amazon.awssdk:bom from 2.25.69 to 2.26.3 by @dependabot in https://github.com/apache/iceberg/pull/10505 * Build: Bump software.amazon.awssdk:bom from 2.26.12 to 2.26.16 by @dependabot in https://github.com/apache/iceberg/pull/10650 * Build: Bump software.amazon.awssdk:bom from 2.26.16 to 2.26.20 by @dependabot in https://github.com/apache/iceberg/pull/10700 * Build: Bump software.amazon.awssdk:bom from 2.26.3 to 2.26.7 by @dependabot in https://github.com/apache/iceberg/pull/10554 * Build: Bump software.amazon.awssdk:bom from 2.26.7 to 2.26.12 by @dependabot in https://github.com/apache/iceberg/pull/10611 * Build: Bump spring-boot from 2.5.4 to 2.7.18 by @dependabot in https://github.com/apache/iceberg/pull/9985 * Build: Clean up Jackson dependency usages by @nastra in https://github.com/apache/iceberg/pull/10448 * Build: Define JUnit4 dependency only where necessary by @nastra in https://github.com/apache/iceberg/pull/10672 * Build: Downgrade Gradle from 8.8 to 8.7 due to bug with older OSX versions by @nastra in https://github.com/apache/iceberg/pull/10637 * Build: Fix ignoring major version update in dependabot by @manuzhang in https://github.com/apache/iceberg/pull/9981 * Build: Free disk space before running action in Spark CI by @manuzhang in https://github.com/apache/iceberg/pull/9786 * Build: Ignore link-checking for Blogs / https://search.maven.org/ by @nastra in https://github.com/apache/iceberg/pull/10081 * Build: Let revapi compare against 1.5.0 by @ajantha-bhat in https://github.com/apache/iceberg/pull/9777 * Build: Merge job definitions in spark-ci.yml by @findepi in https://github.com/apache/iceberg/pull/10513 * Build: Move to `goooler` shadow plugin by @Fokko in https://github.com/apache/iceberg/pull/10568 * Build: Remove links checker by @Fokko in https://github.com/apache/iceberg/pull/10404 * Build: Require approving review by @Fokko in https://github.com/apache/iceberg/pull/10424 * Build: Update NOTICE to include copyright for 2024 by @caicancai in https://github.com/apache/iceberg/pull/10471 * Build: Upgrade to gradle 8.8 by @jbonofre in https://github.com/apache/iceberg/pull/8486 * Build: Use official revapi Gradle plugin by @ajantha-bhat in https://github.com/apache/iceberg/pull/10631 * Build: disable link-check for all medium blog posts by @manuzhang in https://github.com/apache/iceberg/pull/10057 * Build: disable link-check for existing medium blog posts by @manuzhang in https://github.com/apache/iceberg/pull/10042 * Build: don't include slf4j-api in bundled JARs by @devinrsmith in https://github.com/apache/iceberg/pull/10665 * Bump Nessie from 0.91.3 to 0.92.0 by @snazy in https://github.com/apache/iceberg/pull/10689 * CI: Run Markdown links checker only when `{docs,site}/**` changes by @Fokko in https://github.com/apache/iceberg/pull/10049 * Clean backport with:Flink: Backport #10207 to v1.18 and v1.17 by @pvary in https://github.com/apache/iceberg/pull/10235 * Core, Parquet, ORC: Don't write column sizes when metrics mode is None by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10440 * Core, Spark 3.4: Remove redundant output in tests by @aokolnychyi in https://github.com/apache/iceberg/pull/10348 * Core, Spark: Fix handling of null binary values when sorting with zorder by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10026 * Core, Spark: Spark writes/actions should only perform cleanup if failure is cleanable by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10373 * Core, Spark: Use 'delete' if RowDelta only has delete files by @nastra in https://github.com/apache/iceberg/pull/10123 * Core: Add EnvironmentContext to commit summary by @manuzhang in https://github.com/apache/iceberg/pull/9273 * Core: Add explicit JSON parser for ConfigResponse by @nastra in https://github.com/apache/iceberg/pull/9952 * Core: Add property to disable table initialization for JdbcCatalog by @mrcnc in https://github.com/apache/iceberg/pull/10124 * Core: Add test for renaming table to a non-existing namespace by @nastra in https://github.com/apache/iceberg/pull/9895 * Core: Assume issued_token_type is access_token to fully comply with RFC 6749 by @adutra in https://github.com/apache/iceberg/pull/10314 * Core: Calling rewrite_position_delete_files fails on tables with more than 1k columns by @szehon-ho in https://github.com/apache/iceberg/pull/10020 * Core: Exclude unexpected namespaces JdbcCatalog.listNamespaces by @ebyhr in https://github.com/apache/iceberg/pull/10498 * Core: Expose table incremental scan for appends API in SerializableTable by @deniskuzZ in https://github.com/apache/iceberg/pull/10682 * Core: Fix JDBC Catalog table commit when migrating from schema V0 to V1 by @jbonofre in https://github.com/apache/iceberg/pull/10111 * Core: Fix NPE during conflict handling of NULL partitions by @boroknagyz in https://github.com/apache/iceberg/pull/10680 * Core: Fix ParallelIterable memory leak where queue continues to be populated even after iterator close by @Heltman in https://github.com/apache/iceberg/pull/9402 * Core: Fix create v1 table on REST Catalog by @hantangwangd in https://github.com/apache/iceberg/pull/10369 * Core: Fix logging table name in scanning metadata table by @manuzhang in https://github.com/apache/iceberg/pull/10141 * Core: Handles possible heap data corruption of `OAuth2Util.AuthSession#headers` by @tlm365 in https://github.com/apache/iceberg/pull/10615 * Core: Handles potential NPE in `RESTSessionCatalog#newSessionCache` by @tlm365 in https://github.com/apache/iceberg/pull/10607 * Core: Improve size check in CatalogTests by @nastra in https://github.com/apache/iceberg/pull/10182 * Core: Introduce AuthConfig by @nastra in https://github.com/apache/iceberg/pull/10161 * Core: Lazily compute & cache hashCode in CharSequenceWrapper by @nastra in https://github.com/apache/iceberg/pull/10023 * Core: Make constants in `CatalogTests` protected by @snazy in https://github.com/apache/iceberg/pull/9894 * Core: Make new TableMetadata.Builder constructor private by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10714 * Core: Mark 502 and 504 statuses as retryable to the REST exponential retry strategy by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/9885 * Core: Prevent duplicate data/delete files by @nastra in https://github.com/apache/iceberg/pull/10007 * Core: Remove unused ManifestGroup#filterManifests(Predicate) by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10339 * Core: Replace deprecated Roaring64Bitmap#add call with addRange by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10350 * Core: Retry connections in JDBC catalog with user configured error code list by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10140 * Core: Reword exception message in RewriteManifests by @ajantha-bhat in https://github.com/apache/iceberg/pull/10446 * Core: Simplify loadCatalog method call in Iceberg by @dzzxjl in https://github.com/apache/iceberg/pull/10488 * Core: Use 'delete' / 'append' if OverwriteFiles only deletes/appends data files by @nastra in https://github.com/apache/iceberg/pull/10150 * Core: Use <?> as type parameter instead of raw type for SnapshotUpdate by @nastra in https://github.com/apache/iceberg/pull/10015 * Core: Use TestTemplate instead of Test annotation in TestPartitionSpecParser/Info by @nastra in https://github.com/apache/iceberg/pull/10435 * Core: add a new task-type field to task JSON serialization. add data task JSON serialization implementation. by @stevenzwu in https://github.com/apache/iceberg/pull/9728 * Core: add missing `@Test` annotation in TestRESTCatalog by @adutra in https://github.com/apache/iceberg/pull/9899 * Core: fix namespace SQL statement using ESCAPE character working with MySQL, PostgreSQL, ... by @jbonofre in https://github.com/apache/iceberg/pull/10167 * Core: pushdown data_file.content when filter manifests in entries table by @dramaticlly in https://github.com/apache/iceberg/pull/10203 * Core: use bulk delete when removing old metadata.json files by @dramaticlly in https://github.com/apache/iceberg/pull/10679 * Core:Simplify newTableMetadata method in TableMetadata class by @DaqianLiao in https://github.com/apache/iceberg/pull/10528 * Data, Spark, Flink: Migrate TestAppenderFactory and subclasses to JUnit5 by @nk1506 in https://github.com/apache/iceberg/pull/9862 * Data: Switch tests to JUnit5 + AssertJ-style assertions by @attilakreiner in https://github.com/apache/iceberg/pull/10657 * Dell, Hive3: Convert remaining tests to JUnit5 by @nastra in https://github.com/apache/iceberg/pull/10670 * Described as Hive 4.0.0 by @911432 in https://github.com/apache/iceberg/pull/10325 * Doc: Clarify table properties on metadata metrics inferred column defaults by @dramaticlly in https://github.com/apache/iceberg/pull/9865 * Docs: Add BigQuery docs url to sidebar by @uatach in https://github.com/apache/iceberg/pull/10574 * Docs: Add DDL docs for Views by @nastra in https://github.com/apache/iceberg/pull/9878 * Docs: Add Daft into Iceberg documentation by @jaychia in https://github.com/apache/iceberg/pull/9836 * Docs: Add archive for documentations older than 1.4.0 by @manuzhang in https://github.com/apache/iceberg/pull/10374 * Docs: Add flinkVersion and flinkVersionMajor instead of hardcode by @manuzhang in https://github.com/apache/iceberg/pull/10463 * Docs: Add release notes for 1.5.2 by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10295 * Docs: Added Upsolver to vendor list by @jasonf20 in https://github.com/apache/iceberg/pull/10096 * Docs: Document support for binary in truncate transform by @TheNeuralBit in https://github.com/apache/iceberg/pull/10079 * Docs: Don't check links on Release page by @nastra in https://github.com/apache/iceberg/pull/10212 * Docs: Enhance Flink pages by @manuzhang in https://github.com/apache/iceberg/pull/9919 * Docs: Enhance Spark pages by @manuzhang in https://github.com/apache/iceberg/pull/9920 * Docs: Enhance create_changelog_view usage by @manuzhang in https://github.com/apache/iceberg/pull/9889 * Docs: Fix On-screen display issues and minor expressions on Branching and Tagging DDL by @lawofcycles in https://github.com/apache/iceberg/pull/10091 * Docs: Fix links of `Get Started` and `Community` sections in footer by @wayneguow in https://github.com/apache/iceberg/pull/10098 * Docs: Fix links to internal files by @manuzhang in https://github.com/apache/iceberg/pull/9819 * Docs: Fix release notes indentation by @ajantha-bhat in https://github.com/apache/iceberg/pull/9933 * Docs: Point links in metrics-reporting.md to GitHub Java source by @manuzhang in https://github.com/apache/iceberg/pull/10397 * Docs: Refer to the README.md in `site/` for the docs by @Fokko in https://github.com/apache/iceberg/pull/10402 * Docs: Remove link to Flink unit test by @manuzhang in https://github.com/apache/iceberg/pull/10160 * Docs: Update defaults for distribution mode by @szehon-ho in https://github.com/apache/iceberg/pull/10575 * Docs: Update doap.rdf for 1.5.1 release by @ajantha-bhat in https://github.com/apache/iceberg/pull/10255 * Docs: Update features for Hive 4.0 by @SourabhBadhya in https://github.com/apache/iceberg/pull/10162 * Docs: Update releases.md for Spark scala versions by @liko9 in https://github.com/apache/iceberg/pull/10104 * Docs: Update site docs by @ajantha-bhat in https://github.com/apache/iceberg/pull/9946 * Docs: Update vendor information for Cloudera by @bartash in https://github.com/apache/iceberg/pull/10278 * Docs: add metrics-reporting back by @manuzhang in https://github.com/apache/iceberg/pull/10377 * Docs: document view properties by @nastra in https://github.com/apache/iceberg/pull/9961 * DynConstructors cleanup by @findepi in https://github.com/apache/iceberg/pull/10542 * DynFields, DynMethods code cleanup by @findepi in https://github.com/apache/iceberg/pull/10543 * Enable the Gradle build cache by @snazy in https://github.com/apache/iceberg/pull/10602 * Extend HTTPClient Builder to allow setting a proxy server by @harishch1998 in https://github.com/apache/iceberg/pull/10052 * Feature make oauth `audience` configurable by @himadripal in https://github.com/apache/iceberg/pull/9839 * Fix CI script inclusion of release branches by @findepi in https://github.com/apache/iceberg/pull/10514 * Fix `TestStrictMetricsEvaluator` assertion message by @Fokko in https://github.com/apache/iceberg/pull/9992 * Fix aggregate pushdown when optional DataFile stats are null by @jkolash in https://github.com/apache/iceberg/pull/10273 * Fix code depending on JVM default charset by @findepi in https://github.com/apache/iceberg/pull/10529 * Fix incorrect double-checked-locking around `TestStreamScanSql#tEnv` by @tlm365 in https://github.com/apache/iceberg/pull/10605 * Fix lower/upper-case not to depend on JVM locale by @findepi in https://github.com/apache/iceberg/pull/10521 * Fix open-api /rename/views success return code by @c-thiel in https://github.com/apache/iceberg/pull/10166 * Fix pagination description based on new feedback by @rahil-c in https://github.com/apache/iceberg/pull/9917 * Fix some `long` casting issues by @snazy in https://github.com/apache/iceberg/pull/10580 * Fix struct evolution default value rule list by @sfc-gh-dmetzgar in https://github.com/apache/iceberg/pull/10290 * Fix/add dremio blogs by @AlexMercedCoder in https://github.com/apache/iceberg/pull/10028 * Flink 1.19: Fix flaky TestIcebergSourceFailover > testBoundedWithSavepoint by @pvary in https://github.com/apache/iceberg/pull/10393 * Flink, Spark: Rename constants to be all uppercase by @attilakreiner in https://github.com/apache/iceberg/pull/10675 * Flink, Spark: Replace Boolean.getBoolean() with Boolean.parseBoolean() by @nastra in https://github.com/apache/iceberg/pull/10136 * Flink: Adds support for Flink 1.19 version by @rodmeneses in https://github.com/apache/iceberg/pull/10112 * Flink: Apply DeleteGranularity for writes by @pvary in https://github.com/apache/iceberg/pull/10200 * Flink: Backport #10200 to v1.19 and v1.17 by @pvary in https://github.com/apache/iceberg/pull/10259 * Flink: Backport #10208 to v1.18 and v1.17 by @pvary in https://github.com/apache/iceberg/pull/10230 * Flink: Backport #10565 to v1.18 and v1.19 by @fengjiajie in https://github.com/apache/iceberg/pull/10676 * Flink: Bump minor versions by @ajantha-bhat in https://github.com/apache/iceberg/pull/9875 * Flink: Don't fail to serialize IcebergSourceSplit when there is too many delete files by @javrasya in https://github.com/apache/iceberg/pull/9464 * Flink: Fix `long` casting issues by @snazy in https://github.com/apache/iceberg/pull/10629 * Flink: Fix bounded source state restore record duplication by @pvary in https://github.com/apache/iceberg/pull/10208 * Flink: Fix the condition of formatVersion for skipping test cases by @zhongqishang in https://github.com/apache/iceberg/pull/10541 * Flink: Maintenance - MonitorSource by @pvary in https://github.com/apache/iceberg/pull/10308 * Flink: Move ParquetReader to LogicalTypeAnnotationVisitor by @Fokko in https://github.com/apache/iceberg/pull/9719 * Flink: Pre-create fieldGetters to avoid constructing them for each row by @fengjiajie in https://github.com/apache/iceberg/pull/10565 * Flink: Prevent setting endTag/endSnapshotId for streaming source by @pvary in https://github.com/apache/iceberg/pull/10207 * Flink: backport PR #9321 for range partitioner on map statistics by @stevenzwu in https://github.com/apache/iceberg/pull/10061 * Flink: implement range partitioner for map data statistics by @stevenzwu in https://github.com/apache/iceberg/pull/9321 * Flink: port #9464 to v1.17 and v1.19 by @elkhand in https://github.com/apache/iceberg/pull/10177 * Flink: refactor sink shuffling statistics collection by @stevenzwu in https://github.com/apache/iceberg/pull/10331 * Hive, JDBC: Add null check before matching the error message by @nk1506 in https://github.com/apache/iceberg/pull/10082 * Hive: Arrange common part of the code for Iceberg View. by @nk1506 in https://github.com/apache/iceberg/pull/10001 * Hive: Fix metadata file not found by @lurnagao-dahua in https://github.com/apache/iceberg/pull/10069 * Hive: Remove deprecated method by @Fokko in https://github.com/apache/iceberg/pull/10257 * Hive: Tests to do validation hive content and iceberg table with the same name by @nk1506 in https://github.com/apache/iceberg/pull/9980 * Hive: Use base table metadata to create HiveLock by @lirui-apache in https://github.com/apache/iceberg/pull/10016 * Hive: turn off the stats gathering when iceberg.hive.keep.stats is false by @stargrey102 in https://github.com/apache/iceberg/pull/10148 * Import Assertions statically in Flink modules by @findepi in https://github.com/apache/iceberg/pull/10532 * Import Assertions statically in Spark modules by @findepi in https://github.com/apache/iceberg/pull/10531 * Import the right assertThatThrownBy method from assertj by @findepi in https://github.com/apache/iceberg/pull/10512 * Infra: Add 1.5.0 to issue template by @ajantha-bhat in https://github.com/apache/iceberg/pull/9778 * Infra: Add 1.5.1 to issue template by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10214 * Infra: Add Iceberg 1.5.2 to issue template by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10296 * Infra: Fix stale PR workflow by @ajantha-bhat in https://github.com/apache/iceberg/pull/10706 * Infra: Improve Bug report template by @nastra in https://github.com/apache/iceberg/pull/10708 * Infra: Increase operation per limit for stale bot workflow by @ajantha-bhat in https://github.com/apache/iceberg/pull/10712 * Introduce two properties for reading the connection timeout and socke… by @harishch1998 in https://github.com/apache/iceberg/pull/10053 * Kafka Connect: Commit coordination by @bryanck in https://github.com/apache/iceberg/pull/10351 * Kafka Connect: Record converters by @bryanck in https://github.com/apache/iceberg/pull/9641 * Kafka-connect: Handle namespace creation for auto table creation by @ajantha-bhat in https://github.com/apache/iceberg/pull/10186 * Kafka-connect: Update iceberg.hadoop-conf-dir config description by @ajantha-bhat in https://github.com/apache/iceberg/pull/10184 * Make AzureProperties w/ shared-key creds serializable by @snazy in https://github.com/apache/iceberg/pull/10045 * Make proxy endpoint configurable for s3 Http clients by @flyrain in https://github.com/apache/iceberg/pull/10332 * Migrate AWS tests to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/10086 * Migrate Files, Append and Overwrite files in Core to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/9994 * Migrate FlinkTestBase related tests by @tomtongue in https://github.com/apache/iceberg/pull/10232 * Migrate HadoopCatalog related tests in Flink by @tomtongue in https://github.com/apache/iceberg/pull/10358 * Migrate Manifest, FormatVersion and LocationProvider files in Core to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/9964 * Migrate Metadata files in Core to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/9927 * Migrate Read in Core to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/9849 * Migrate Scan, Schema and remaining Partition files in Core to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/10014 * Migrate Snapshot files in Core to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/9892 * Migrate TableTestBase related classes to JUnit5 and delete TableTestBase by @tomtongue in https://github.com/apache/iceberg/pull/10063 * Migrate TableTestBase related classes to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/10080 * Migrate Transactions, Partitions and Statistics files in Core to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/9999 * Migrate WAP, Metrics and FilterFiles in Core to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/10039 * Migrate non TestBase related and Data classes in Flink by @tomtongue in https://github.com/apache/iceberg/pull/10130 * Migrate other files in Core to JUnit5 by @tomtongue in https://github.com/apache/iceberg/pull/10027 * Migrate source package in Flink by @tomtongue in https://github.com/apache/iceberg/pull/10632 * Mr: Optimize schema string retrieval in Iceberg by @dzzxjl in https://github.com/apache/iceberg/pull/10489 * Nessie: Gracefully handle empty namespace lookup by @ajantha-bhat in https://github.com/apache/iceberg/pull/9877 * Nit: fix/suppress false-positivie errorprone warning by @snazy in https://github.com/apache/iceberg/pull/10690 * Open-API: TableRequirements should use union of subclasses by @anuragmantri in https://github.com/apache/iceberg/pull/10434 * OpenAPI: Deprecate `oauth/tokens` endpoint by @snazy in https://github.com/apache/iceberg/pull/10603 * OpenAPI: Fix additionalProperties for SnapshotSummary by @haizhou-zhao in https://github.com/apache/iceberg/pull/9838 * OpenAPI: Fix property names for stats/partition stats by @nastra in https://github.com/apache/iceberg/pull/10662 * Parquet: Refactor BasePageIterator to add initRepetitionLevelsReader by @wgtmac in https://github.com/apache/iceberg/pull/9751 * Parquet: Remove deprecated TestHelpers in parquet module by @advancedxy in https://github.com/apache/iceberg/pull/10428 * Pin 3rd party CI action version by @findepi in https://github.com/apache/iceberg/pull/10481 * Prevent deadlock in Jackson by @snazy in https://github.com/apache/iceberg/pull/10379 * REST: disallow overriding "credential" in table sessions by @adutra in https://github.com/apache/iceberg/pull/10345 * REST: fix incorrect token refresh thread name by @adutra in https://github.com/apache/iceberg/pull/10223 * REST: fix spurious warning when shutting down refresh executor by @adutra in https://github.com/apache/iceberg/pull/10087 * Release: add instruction to update doap.rdf file as part of release process by @jbonofre in https://github.com/apache/iceberg/pull/9655 * Remove deprecated APIs scheduled for removal in 1.6.0 by @findepi in https://github.com/apache/iceberg/pull/10501 * Remove redundant -XX:+IgnoreUnrecognizedVMOptions by @findepi in https://github.com/apache/iceberg/pull/10475 * Remove some dead code, fill some javadocs by @findepi in https://github.com/apache/iceberg/pull/10530 * Removes Flink version 1.16 by @rodmeneses in https://github.com/apache/iceberg/pull/10154 * Rename allVersions to allModules by @findepi in https://github.com/apache/iceberg/pull/10499 * Rename test helper to deconflict with Assertions by @findepi in https://github.com/apache/iceberg/pull/10511 * Require Assertions to be statically imported by @findepi in https://github.com/apache/iceberg/pull/10517 * Run CI checks on all supported JDKs by @findepi in https://github.com/apache/iceberg/pull/10473 * Run Flink tests on Java 17 too by @findepi in https://github.com/apache/iceberg/pull/10477 * Run Hive3 tests on Java 11 and 17 too by @findepi in https://github.com/apache/iceberg/pull/10482 * Run revapi workflow on workflow/build system changes by @findepi in https://github.com/apache/iceberg/pull/10485 * SHOW VIEWS failed with AssertionError by @huaxingao in https://github.com/apache/iceberg/pull/10442 * Site: Update release notes for 1.5.0 by @ajantha-bhat in https://github.com/apache/iceberg/pull/9835 * Sort error-prone configuration options by @findepi in https://github.com/apache/iceberg/pull/10540 * Spark 3.3/3.4: support read of partition metadata column when table is over 1k by @dramaticlly in https://github.com/apache/iceberg/pull/10641 * Spark 3.3: Ignore flaky test taking up all device space by @manuzhang in https://github.com/apache/iceberg/pull/10704 * Spark 3.4, 3.3 : support output-spec-id in rewrite (back port #9803) by @himadripal in https://github.com/apache/iceberg/pull/9901 * Spark 3.4, 3.3: Fix the setting of equalAuthorities in RemoveOrphanFilesProcedure by @hantangwangd in https://github.com/apache/iceberg/pull/10342 * Spark 3.4: Fail on recursive cycle in view by @nastra in https://github.com/apache/iceberg/pull/10048 * Spark 3.4: Fix system function pushdown in CoW row-level commands by @aokolnychyi in https://github.com/apache/iceberg/pull/10119 * Spark 3.4: Only traverse ancestors of current snapshot when building changelog scan by @manuzhang in https://github.com/apache/iceberg/pull/10405 * Spark 3.5: Add max allowed failed commits to RewriteDataFiles when partial progress is enabled by @manuzhang in https://github.com/apache/iceberg/pull/9611 * Spark 3.5: Fix system function pushdown in CoW row-level commands by @aokolnychyi in https://github.com/apache/iceberg/pull/9873 * Spark 3.5: Fix the setting of equalAuthorities in RemoveOrphanFilesProcedure by @hantangwangd in https://github.com/apache/iceberg/pull/10334 * Spark 3.5: Only traverse ancestors of current snapshot when building changelog scan by @manuzhang in https://github.com/apache/iceberg/pull/10252 * Spark 3.5: Parallelize reading files in snapshot and migrate procedures by @manuzhang in https://github.com/apache/iceberg/pull/10037 * Spark 3.5: Remove obsolete conf parsing logic by @aokolnychyi in https://github.com/apache/iceberg/pull/10309 * Spark 3.5: Support camel case session configs and options by @aokolnychyi in https://github.com/apache/iceberg/pull/10310 * Spark-3.5: Support CTAS and RTAS to preserve schema nullability. by @zhongyujiang in https://github.com/apache/iceberg/pull/10074 * Spark3.4: Add support for enums in SparkConfParser by @huaxingao in https://github.com/apache/iceberg/pull/10330 * Spark3.4: Support Aggregate push down for incremental scan by @huaxingao in https://github.com/apache/iceberg/pull/10561 * Spark: Backport #10373 to Spark 3.3 and 3.4 by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10546 * Spark: Backport tests for struct aggregation pushdown to 3.3/3.4 by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10333 * Spark: Bump minor version for Spark-3.4 by @ajantha-bhat in https://github.com/apache/iceberg/pull/10243 * Spark: Clarify schema behavior when working with branches by @nastra in https://github.com/apache/iceberg/pull/10055 * Spark: Coerce shorts and bytes into ints in Parquet Writer by @shardulm94 in https://github.com/apache/iceberg/pull/10349 * Spark: Don't allow branch_ usage with TIMESTAMP AS OF by @nastra in https://github.com/apache/iceberg/pull/10059 * Spark: Fail on recursive cycle in view by @nastra in https://github.com/apache/iceberg/pull/9834 * Spark: Fix issue when partitioning by UUID by @nastra in https://github.com/apache/iceberg/pull/8250 * Spark: Improvements around test initialization by @nastra in https://github.com/apache/iceberg/pull/10131 * Spark: Remove useless code in TestRemoveOrphanFilesProcedure by @hantangwangd in https://github.com/apache/iceberg/pull/10562 * Spark: Simplify SparkSchemaUtil#schemaForTable by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10137 * Spark: Use bulk deletes in rewrite manifests action by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10343 * Spark: support read of partition metadata column when table is over 1k by @dramaticlly in https://github.com/apache/iceberg/pull/10547 * Spec: Clarify missing fields when writing by @Fokko in https://github.com/apache/iceberg/pull/8672 * Spec: remove the JSON spec for content file and file scan task sections by @stevenzwu in https://github.com/apache/iceberg/pull/9771 * Spec: required request bodies by @westse in https://github.com/apache/iceberg/pull/10125 * Support Aggregate push down for incremental scan by @huaxingao in https://github.com/apache/iceberg/pull/10538 * Update 1.5.1 release notes by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10224 * Update ASF DOAP rdf file for 1.5.0 by @ajantha-bhat in https://github.com/apache/iceberg/pull/9922 * Update doap.rdf for 1.5.2 release by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10297 * Update mkdocs.yml - Fixes Apache Doris documentation link by @detinho in https://github.com/apache/iceberg/pull/10263 * Update references to main branch by @findepi in https://github.com/apache/iceberg/pull/10705 * Update site to 1.5.0 docs by @bitsondatadev in https://github.com/apache/iceberg/pull/9931 * Update site to 1.5.1 docs by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10218 * Update site to 1.5.2 docs by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10291 * Update specs from hugo to mkdocs format by @bitsondatadev in https://github.com/apache/iceberg/pull/9861 * Update the version in deprecation messages by @findepi in https://github.com/apache/iceberg/pull/10715 * Updates flink versioning information in our docs by @rodmeneses in https://github.com/apache/iceberg/pull/10155 * Upgrade to Gradle 8.9 by @jbonofre in https://github.com/apache/iceberg/pull/10686 * Url encode field names for partition paths by @danielcweeks in https://github.com/apache/iceberg/pull/10329 * Use `svn mv` when releasing the binaries by @Fokko in https://github.com/apache/iceberg/pull/9926 * Use a unique field-id for delete files elements by @fqaiser94 in https://github.com/apache/iceberg/pull/10347 * [Docs] Add examples for DataFrame branch writes by @anuragmantri in https://github.com/apache/iceberg/pull/10644 * [core] fix #9997 - Handle s3a file upload interrupt which results in table metadata pointing to files that doesn't exist by @abmo-x in https://github.com/apache/iceberg/pull/9998 * docs: Add links checker by @Fokko in https://github.com/apache/iceberg/pull/9965 * docs: Remove roadmap by @Fokko in https://github.com/apache/iceberg/pull/9941 * docs: deploy on changes in `docs/` by @manuzhang in https://github.com/apache/iceberg/pull/10394 * mr: Fix using Date type as partition field by @lurnagao-dahua in https://github.com/apache/iceberg/pull/10210 * nit: Typo in the spec by @Fokko in https://github.com/apache/iceberg/pull/10564 * reduce enum array allocation by @sullis in https://github.com/apache/iceberg/pull/10126 * remove static import from `SmokeTest` by @huaxingao in https://github.com/apache/iceberg/pull/10451 * spec: Fix formatting of Default values by @Fokko in https://github.com/apache/iceberg/pull/10525 ## New Contributors * @himadripal made their first contribution in https://github.com/apache/iceberg/pull/9803 * @AlexMercedCoder made their first contribution in https://github.com/apache/iceberg/pull/9967 * @jaychia made their first contribution in https://github.com/apache/iceberg/pull/9836 * @CsengerG made their first contribution in https://github.com/apache/iceberg/pull/9963 * @lurnagao-dahua made their first contribution in https://github.com/apache/iceberg/pull/10069 * @TheNeuralBit made their first contribution in https://github.com/apache/iceberg/pull/10079 * @liko9 made their first contribution in https://github.com/apache/iceberg/pull/10104 * @lawofcycles made their first contribution in https://github.com/apache/iceberg/pull/10091 * @wayneguow made their first contribution in https://github.com/apache/iceberg/pull/10098 * @harishch1998 made their first contribution in https://github.com/apache/iceberg/pull/10053 * @sullis made their first contribution in https://github.com/apache/iceberg/pull/10126 * @westse made their first contribution in https://github.com/apache/iceberg/pull/10125 * @regadas made their first contribution in https://github.com/apache/iceberg/pull/10132 * @c-thiel made their first contribution in https://github.com/apache/iceberg/pull/10166 * @javrasya made their first contribution in https://github.com/apache/iceberg/pull/9464 * @elkhand made their first contribution in https://github.com/apache/iceberg/pull/10177 * @stargrey102 made their first contribution in https://github.com/apache/iceberg/pull/10148 * @SourabhBadhya made their first contribution in https://github.com/apache/iceberg/pull/10162 * @sfc-gh-dmetzgar made their first contribution in https://github.com/apache/iceberg/pull/10290 * @detinho made their first contribution in https://github.com/apache/iceberg/pull/10263 * @jkolash made their first contribution in https://github.com/apache/iceberg/pull/10273 * @dzzxjl made their first contribution in https://github.com/apache/iceberg/pull/10488 * @caicancai made their first contribution in https://github.com/apache/iceberg/pull/10471 * @DaqianLiao made their first contribution in https://github.com/apache/iceberg/pull/10528 * @zhongqishang made their first contribution in https://github.com/apache/iceberg/pull/10541 * @uatach made their first contribution in https://github.com/apache/iceberg/pull/10574 * @attilakreiner made their first contribution in https://github.com/apache/iceberg/pull/10657 * @fengjiajie made their first contribution in https://github.com/apache/iceberg/pull/10565 * @devinrsmith made their first contribution in https://github.com/apache/iceberg/pull/10665 **Full Changelog**: https://github.com/apache/iceberg/compare/apache-iceberg-1.5.2...apache-iceberg-1.6.0
## What's Changed * [1.5.x] API: Fix default FileIO#newInputFile ManifestFile, DataFile and DeleteFile implementations by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10114 * [1.5.x] Core: Mark 502 and 504 failures as retryable to the exponential retry strategy by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10113 * Core: Fix JDBC Catalog table commit when migrating from schema V0 to V1 (#101111) by @jbonofre in https://github.com/apache/iceberg/pull/10152 * Core: Fix namespace SQL statement using ESCAPE character that works with MySQL/PostgreSQL (#10167) by @jbonofre in https://github.com/apache/iceberg/pull/10169 * (1.5.x cherry-pick) Spark 3.5: Fix system function pushdown in CoW row-level commands by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10170 * (1.5.x Cherry-pick) Spark 3.4: Fix system function pushdown in CoW row-level commands (#10119) by @amogh-jahagirdar in https://github.com/apache/iceberg/pull/10171 **Full Changelog**: https://github.com/apache/iceberg/compare/apache-iceberg-1.5.0...apache-iceberg-1.5.1