Data Quality made easy with AWS Glue“Data is the new oil”, a phrase that has echoed for years now but what good is unrefined oil. The same thought applies to data. Now, the…Sep 14, 2024Sep 14, 2024
Published inAWS TipConnecting to RDS via EC2Always thought it was a pain to configure all the network rules to connect to an RDS instance and to be honest; as it turns out there…Aug 7, 2022Aug 7, 2022
Published inAWS TipUsing Lambda load data into DynamoDBIsn’t it annoying when in an ETL pipeline, the upstream system fails to deliver the data and your job fails due to the missing data or you…Apr 17, 2022Apr 17, 2022
Published inAWS TipAthena: Query data in S3Isn’t it fascinating that one doesn’t need to load data into a table before querying it to extract insights hence saving the time and cost…Apr 9, 2022Apr 9, 2022
Load data into Redshift from S3Ever wondered how Zomato knows what’s you favorite restaurant? Or how Myntra knows what dresses you like? They do this using your…Apr 2, 2022Apr 2, 2022
Published inAWS TipCreate, Delete, Write and Read from S3While working on data pipelines we are bound to deal with a lot of data which needs to be accessed anytime and from anywhere, and what…Mar 26, 2022Mar 26, 2022
Published inAWS TipCRUD Operations in DynamoDBI was interviewing at a lot of firms for the role of Data Engineer and they all asked if I had any experience with NoSQL database and…Mar 7, 2022Mar 7, 2022
Published inAWS TipHow to set Billing Alarm in AWS?Learning AWS is fun and when I was starting out, the only thing holding me back was, what if I loose money? That too, when I am a miser(PS…Jan 3, 2021Jan 3, 2021
Published inAWS TipCreating IAM UserI have just started learning about AWS services and would like to share my first experience with IAM (Identity and Access Management).Jan 2, 2021Jan 2, 2021
Shooting Words!Learning new words! Sounds boring, right? Or tough? Don’t we all just love the use of nice, juicy and snappy words? The answer is…Jun 13, 2020Jun 13, 2020