Posts

Showing posts from December, 2021

Udacity Data Engineering - Data Modeling

< 2 years back - need to brush up> This was a good intro to relational modeling, data warehousing with fact and dimensions. using group sets and cubes for faster analytics, slicing, dicing, drill down and roll up. The project was a whole bunch of transformations converting a relational model to a data warehouse model. There were also a bunch of methods used to create schemas repetitively. When I brush up this course, I will update the learning here along with code snippets.

Udacity - Data Engineering - Intro

 This is a challenging course I embarked on two years back and could not complete at that time. I'm back here in an attempt to improve my scope of skills, to improve my mental stamina and give myself something that can make me feel accomplished. This has 4 sections - Data Modeling - Cloud Data Warehousing - Spark and Data Lakes - Automating Data Pipelines There are 4 challenging projects to each of these sections and a final capstone project combining them. The technologies that span these courses are SQL, NOSQL, basic python, AWS, Spark, Airflow.

About me and Why read this blog?

About me :  Hello there, I'm Ananya Jayakumar  - 33 years old when I start this blog , 5 months into my pregnancy , 10 years experience in tech : Operations / Data analysis / ETL / dash-boarding / managing teams / Solving problems. Pregnancy - Slowing your career I just completed a personally fulfilling year onboarding a team and training them to perform, tackling fraud, building dashboards and creating automated ETL behind the dashboard. But since I'm going on maternity leave, I'm training folks on my job - making it easy to replace myself and jeopardizing a promo that I'd otherwise been well placed for and also having to coming back from maternity leave - and starting from scratch as if all the stuff I did before the leave does not count. It's also a time when my company is getting acquired, the business and products are changing and not the best time to be planning maternity.  I feel like I have potential to be in a better place. Pregnancy - the baby's most i