We all(most of us) are fans of python programming due to the ease of development efforts we need to put with this programming language.
Apache Beam is an SDK to develop a data processing pipeline for batch and streaming data. Now when it comes to the practical use of Apache beam SDK in the real world, we often encounter the limitation or feature supported by Apache beam SDK to process a certain type of source using in-built connectors.
The Apache Beam SDK for python only supports a limited database connectors Google BigQuery, Google Cloud Datastore, Google Cloud Bigtable (Write), MongoDB. The Real-world also depends on MySQL and PostgreSQL being the widely used relational database across all the domains and all the levels of software development. …
Yes, you read it right!
I was able to clear all 3 Google Cloud certifications in 3 weeks. In this post, I will be sharing the resources and my approach to help you prepare for GCP certifications.
A bit about me:
I am a Python+Django developer with hands-on experience of Python-based scripting and Google Cloud Platform working with MediaAgility. I have worked on designing and developing projects to production scale from scratch. At MediaAgility, I am in the Machine Learning team. …
You read it correct. It is entirely possible and it is simpler than you think.
As many of mongodb people out there will advocate to to prefer to use _id (this is alphanumeric and guaranteed to be unique across machine as well) but software engineers like me find them-self in a situation to use auto increment integers or integer sequence types. One use case of this is to use Numeric Order Id that is auto-increment when ever I insert a new document(row) in collection(table).
So how I was able to solve this problem is below:
The key to note here is the new argument passed to find_and_modify function. Passing new = True returns the modified document and as this is pure mongodb dependent and $inc is said to be thread safe in concurrent environment , this will guarantee to generate unique sequence to passed collection…