#DataLakes

2 posts

AWS S3 Tables and Apache Iceberg

6 min read6.1k

The evolution of the modern data lake has reached a critical inflection point. For years, data engineers have struggled with the "small file problem," the latency of metadata operations in Amazon S3, ...

S3 Data Lake Best Practices in 2023

6 min read5k

The landscape of data engineering has shifted dramatically in 2023. While Amazon S3 has long been the gold standard for object storage, the "set it and forget it" approach to data lakes is now a liabi...