DuckLake: SQL as a Lakehouse Format

The complexity of manifests they mention is a real problem for query engine implementations. It’s completely hidden from the user apart from latency - since the query engine is forced to go multiple times to the object storage to reconstruct the current table version. I hope this will catch on, but it will require some other player to choose this format as well. Given the fact that Amazon recently picked Iceberg for S3 tables, seems unlikely that will happen.