Mide-400 May 2026
| Topic | Extra Material | |-------|----------------| | Data Mesh | Data Mesh: Delivering Data‑Driven Value at Scale – Zhamak Dehghani (2022). | | SQL on Big Data | Presto / Trino official docs + “The Trino Book” (free PDF). | | Graph Databases | Neo4j Graph Academy (free courses). | | ML‑Ops for Data Pipelines | Machine Learning Engineering – Andriy Burkov (Chapter 7). | | Cloud‑Native Warehouses | Snowflake University (free modules). | | Testing Data Pipelines | Great Expectations tutorial (open‑source data validation). |
Before analyzing the content, it is crucial to understand the nomenclature. In the JAV industry, codes are the DNA of the product. The MIDE-400 code breaks down into two parts: MIDE-400
| Assessment | Weight | Format | |------------|--------|--------| | Quizzes (Weeks 2, 4, 8) | 10 % | 15‑minute online MCQs (SQL, theory) | | Mid‑term Exam | 25 % | 90‑minute closed‑book (design & short‑answer) | | Lab Grades (cumulative) | 20 % | Lab reports + code repository | | Capstone Project | 35 % | As described above | | Participation (forum, office‑hours) | 10 % | Attendance, contribution to discussion board | | Topic | Extra Material | |-------|----------------| |
Grading tip: Use an automated grading script for the SQL‑quiz portion (e.g.,
pgTAPfor PostgreSQL) to give rapid feedback. Before analyzing the content, it is crucial to
Each lab should be 2 hours, with a short written report (≈300 words).
| Lab | Goal | Deliverable |
|-----|------|-------------|
| Lab 2 | Normalised schema design | ER diagram + SQL DDL |
| Lab 4 | Concurrency control | Screenshot of deadlock detection & fix |
| Lab 6 | Data cleaning script | Python notebook on GitHub |
| Lab 7 | Spark aggregation job | spark-submit script + output CSV |
| Lab 8 | Kafka → Spark streaming | Docker‑Compose file + streaming log |
| Lab 10 | Lakehouse conversion | Parquet/Delta table + query benchmark |
| Lab 11 | Airflow DAG | DAG file + Airflow UI screenshot |
| Lab 12 | CI/CD pipeline | GitHub Actions YAML + Docker image link |