PinnedPython, Apache Beam, Relational Database (MySQL, PostgreSQL), Struggle and The SolutionBackground We all(most of us) are fans of python programming due to the ease of development efforts we need to put with this programming language. Apache Beam is an SDK to develop a data processing pipeline for batch and streaming data. Now when it comes to the practical use of Apache…Apache Beam4 min readApache Beam4 min read
Jun 18, 2021Solving Data SilosIn a modern data system, It is hard to assume that all of your data will be available in a single database/data warehouse so that you can query efficiently and generate more insights from the data. In a typical scenario, data is located in different system before we build some…Aws Athena5 min readAws Athena5 min read
Feb 28, 2021Securing Load balanced Authenticated Cloud Run Services using IAPWhen designing your cloud run services, you should always consider following points How to run same service in multiple region for multi-regional support You should think about securing cloud run service with authentication support so that only authenticated users can invoke your cloud run service Both of these features are…Google Cloud Platform3 min readGoogle Cloud Platform3 min read
Jun 10, 2019Creating BGP Tunnel between AWS and GCPThis article lists steps for how to create Dynamic BGP enabled VPN tunnel between AWS and GCPAWS1 min readAWS1 min read
Dec 11, 2018How I Cleared 3 Google Cloud Certifications in 3 WeeksYes, you read it right! I have got my 4th Certificate Google Cloud Developer and 5th Certificate Google Cloud Network Engineer each in 1 week again. I was able to clear all 3 Google Cloud certifications in 3 weeks. …Cloud Associate Engineer6 min readCloud Associate Engineer6 min read
Mar 20, 2018Implementing sequence types in MongoDBYes , You read it correct. It is entirely possible and it is simpler than you think. As many of mongodb people out there will advocate to to prefer to use _id (this is alphanumeric and guaranteed to be unique across machine as well) but software engineers like me find…Mongodb2 min readMongodb2 min read
