Shivam ShrivastavaData Quality made easy with AWS Glue“Data is the new oil”, a phrase that has echoed for years now but what good is unrefined oil. The same thought applies to data. Now, the…Sep 14Sep 14
Shivam ShrivastavainAWS TipConnecting to RDS via EC2Always thought it was a pain to configure all the network rules to connect to an RDS instance and to be honest; as it turns out there…Aug 7, 2022Aug 7, 2022
Shivam ShrivastavainAWS TipUsing Lambda load data into DynamoDBIsn’t it annoying when in an ETL pipeline, the upstream system fails to deliver the data and your job fails due to the missing data or you…Apr 17, 2022Apr 17, 2022
Shivam ShrivastavainAWS TipAthena: Query data in S3Isn’t it fascinating that one doesn’t need to load data into a table before querying it to extract insights hence saving the time and cost…Apr 9, 2022Apr 9, 2022
Shivam ShrivastavaLoad data into Redshift from S3Ever wondered how Zomato knows what’s you favorite restaurant? Or how Myntra knows what dresses you like? They do this using your…Apr 2, 2022Apr 2, 2022
Shivam ShrivastavainAWS TipCreate, Delete, Write and Read from S3While working on data pipelines we are bound to deal with a lot of data which needs to be accessed anytime and from anywhere, and what…Mar 26, 2022Mar 26, 2022
Shivam ShrivastavainAWS TipCRUD Operations in DynamoDBI was interviewing at a lot of firms for the role of Data Engineer and they all asked if I had any experience with NoSQL database and…Mar 7, 2022Mar 7, 2022
Shivam ShrivastavainAWS TipHow to set Billing Alarm in AWS?Learning AWS is fun and when I was starting out, the only thing holding me back was, what if I loose money? That too, when I am a miser(PS…Jan 3, 2021Jan 3, 2021
Shivam ShrivastavainAWS TipCreating IAM UserI have just started learning about AWS services and would like to share my first experience with IAM (Identity and Access Management).Jan 2, 2021Jan 2, 2021
Shivam ShrivastavaShooting Words!Learning new words! Sounds boring, right? Or tough? Don’t we all just love the use of nice, juicy and snappy words? The answer is…Jun 13, 2020Jun 13, 2020
