unni@dropzone:~$
← All posts

Hands-On Workshop: Building a Serverless Datalake On AWS

Self-paced lab from AWS TechFest Singapore 2019

Unni Pillai
Unni Pillai

April 2019 was a super busy month for us here in AWS ASEAN Team. We had an action-packed AWS Summit where we hosted one is the largest technology conference in Singapore.

This year in AWS Summit Singapore, we hosted AWS TechFest for the first time AWS TechFest is a skills acceleration day designed to foster special recognition for IT Pro, Developer, Engineer, Solution Architect, and AWS Certified individuals.

In TechFest this year, I facilitated a hands-on workshop to help customers learn the concepts behind Building a Serverless Data Lake on AWS. Thought might be useful for those who couldn’t attend to make the workshop content public on GitHub.

Link to the GitHub repo: https://github.com/unnipillai/techfest-building-serverless-datalake-on-aws

Learning outcomes from this workshop?

  • Design serverless data lake architecture

  • Build a data processing pipeline and Data Lake using Amazon S3 for storing data

  • Use Amazon Kinesis for real-time streaming data

  • Use AWS Glue to automatically catalog datasets

  • Run interactive ETL scripts in an Amazon SageMaker Jupyter notebook connected to an AWS Glue development endpoint

  • Query data using Amazon Athena & visualize it using Amazon QuickSight

Keen to hear your feedback & thoughts on this.

Peace Out ✌🏽

/ Unni