Go to main content
Back to Courses
MODULE 10

S3, Data Lake, and Lakehouse Architecture

Move from buckets with files to a readable, governed data lake compatible with modern lakehouse patterns.

Editorial cover of the module S3, Data Lake, and Lakehouse Architecture
Introduction to Object Storage - official lesson image on GinnyTech, created by AD
1
Advanced 18 min

'Object storage: how it really works'

Object storage: how it really works. Core lesson of the S3, Data Lake, and Lakehouse Architecture module with real problem, conceptual model, rigorous formalization, applied case, 3-level lab, and final checkpoint.

Prerequisites: 1

Go to lesson
Partitioning strategy - official lesson image on GinnyTech
2
Advanced 18 min

Partitioning strategies on data lakes

Designing optimal partitions for query engines on S3: trade-offs and established patterns.

Prerequisites: 1

Go to lesson
Athena e Presto/Trino: query engines su S3 - immagine ufficiale della lezione su GinnyTech, creata da AD
3
Advanced 22 min

Athena and Presto/Trino: query engines on S3

Using SQL query engines to directly query data on data lakes without ETL.

Prerequisites: 1

Go to lesson
Data lifecycle - official lesson image on GinnyTech
4
Advanced 18 min

Data Lifecycle and Storage Management

Strategies for data lifecycle on data lakes: hot/warm/cold storage and retention policy.

Prerequisites: 1

Go to lesson
Apache Iceberg e table formats per data lake - immagine ufficiale della lezione su GinnyTech, creata da AD
5
Advanced 22 min

Apache Iceberg and table formats for data lakes

Modern table formats: Iceberg, Delta Lake, Hudi to bring ACID and time travel to data lakes.

Prerequisites: 1

Go to lesson
Catalogo dati e governance su S3 - immagine ufficiale della lezione su GinnyTech, creata da AD
6
Advanced 18 min

Data catalog and governance on S3

Build a centralized data catalog with AWS Glue and manage access, audit, and lineage.

Prerequisites: 1

Go to lesson
Prestazioni e ottimizzazione query su S3 - immagine ufficiale della lezione su GinnyTech, creata da AD
7
Advanced 18 min

Query performance and optimization on S3

Advanced techniques for fast queries on data lakes: caching, materialization, statistics.

Prerequisites: 1

Go to lesson
Sicurezza e access control su data lake - immagine ufficiale della lezione su GinnyTech, creata da AD
8
Advanced 18 min

Security and access control on data lake

Manage security, authentication, and granular permissions on S3 data lakes.

Prerequisites: 1

Go to lesson
Data lake monitoring e data quality - immagine ufficiale della lezione su GinnyTech, creata da AD
9
Advanced 18 min

Data lake monitoring and data quality

Monitor freshness, completeness, and quality of data on data lakes.

Prerequisites: 1

Go to lesson
Data lake: backup e disaster recovery - immagine ufficiale della lezione su GinnyTech, creata da AD
10
Advanced 18 min

Data lake: backup and disaster recovery

Backup, replication, and disaster recovery strategies for data lakes on S3.

Prerequisites: 1

Go to lesson
Delta Lake: ACID su data lake - immagine ufficiale della lezione su GinnyTech, creata da AD
11
Advanced 22 min

Delta Lake: ACID on data lakes

Delta Lake: ACID transactions, time travel, and schema enforcement on S3.

Prerequisites: 1

Go to lesson
Project: complete data lake on S3 - official lesson image on GinnyTech, created by AD
12
Advanced 28 min

Project: Complete Data Lake on S3

Practical Lab: Build an enterprise-ready data lake on S3 with Athena, Iceberg, and Glue.

Prerequisites: 1

Go to lesson

Module connections

Natural prerequisiteData Warehousing & Analytical Architecture7 lessons

Truly understand how to design a scalable analytical system with correct grain, historization, and architectural trade-offs.

Same stage of the pathKafka & Event Streaming Engineering9 lessons

Teach data logic as a flow, with schema contracts, stream processing, and realistic failure handling.

Same stage of the pathReal-Time Analytics & ClickHouse Systems9 lessons

Turn realtime from slogan to robust system with ingestion patterns, MergeTree thinking, and cost control.

Same stage of the pathInfrastructure & Ops for Data Systems7 lessons

Bring operational discipline from serious engineering to data workloads, deploy, observability, security, and incident response.

Previous moduleCourse Overview and Study Method for Data Work8 lessons

Transform the course from catalog to cognitive system, with study method, technical memory, and professional output plan.

Previous moduleData Collection & Tracking Systems8 lessons

Move from isolated tags and tools to reliable, governed, and observable measurement systems.