Must Try (Open-Source) Google Cloud Platform-GCP Projects on GitHub

Mrinal Walia
5 min readFeb 2, 2023

--

Image from unsplash

Google Cloud Platform (GCP) is a public cloud vendor that builds apps faster, makes smarter business decisions, and connects people anywhere. It provides cloud services for Compute, Storage, Databases, Data analytics, AI and machine learning, Networking, and Developer tools to build, scale, and solve your business problems.

Companies like Goldman Sachs and Spotify are using Google Cloud to empower its team to analyze data, scale computing power, and power the playlists of 381 million listeners every month.

Today’s article will help you get familiar with some of the best and most important GCP open-source projects. All the projects are easily accessible on GitHub, and you can play around and customize them to your requirements. (Remember to review their licensing terms before you use them in your project.)

Note: In this article, we will discuss some fantastic open-source GCP Projects/Repositories that you can utilize in your projects in 2023. To read more about each, I recommend following the link given along the project.

Affiliate Courses from DataCamp

Learning isn’t just about being more competent at your job, it is so much more than that. Datacamp allows me to learn without limits.

Datacamp allows you to take courses on your own time and learn the fundamental skills you need to transition to a successful career.

Datacamp has taught me to pick up new ideas quickly and apply them to real-world problems. While I was in my learning phase, Datacamp hooked me on everything in the courses, from the course content and TA feedback to meetup events and the professor’s Twitter feeds.

Here are some of my favorite courses I highly recommend you to learn from whenever it fits your schedule and mood. You can directly apply the concepts and skills learned from these courses to an exciting new project at work or at your university.

Data-scientist-with-python

Data-scientist-with-r

Machine-learning-scientist-with-r

Machine-learning-scientist-with-python

Machine-learning-for-everyone

Data-science-for-everyone

1. Training Data Analyst

GitHub: https://github.com/GoogleCloudPlatform/training-data-analyst

Official Documentation: https://cloud.google.com/training?hl=en

️️GitHub Stars: 6.6K

GitHub Forks: 5.2K

Languages: Jupyter Notebook89.3% , Python6.8%, JavaScript1.5% , Java0.9% , HTML0.9% , Shell0.3% , and Other0.3%

Image Source

Training data analyst is a library containing labels and demos for courses on GCP training to help you grow your skills in emerging cloud technologies with Google Cloud certifications.

The repo has resources for online learning, skills development courses, and many certifications. You can subscribe to their program, which will give you access to join google online cloud events, join the google Cloud community, become a google cloud innovator and read recent training and certification blogs.

NOTE: The training and certifications are provided by Google and come under different price models. Check the details here.

2. Pulumi

GitHub: https://github.com/pulumi/pulumi

Official Documentation: https://www.pulumi.com/

GitHub Stars: 14.9K

GitHub Forks: 844

Languages: Go66.6% , Python13.0% , TypeScript12.5%, JavaScript7.2% , Shell0.4% , and Makefile0.3%

Image Source

Pulumi is an open-source software infrastructure as code SDK. It helps you to create and deploy cloud software that uses containers, serverless functions, hosted services, and Infrastructure on any cloud platform, including GCP.

You can start by writing code in your favorite language and then use Pulumi to automatically provision and manage your AWS, AZURE, GCP, and Kubernetes resources using the Infrastructure as code approach.

You can start by deploying a simple application in AWS, Azure, GCP, or Kubernetes using Pumuli here.

You can download Pulumi for Windows, MacOS, and/or Linux here.

Here are a few quick resources to get started with Pulumi quickly.

Learn

Examples

Docs

Registry

Pulumi Roadmap

Community Slack

GitHub Discussions

3. Terraformer

GitHub: https://github.com/GoogleCloudPlatform/terraformer

Official Documentation: NIL

GitHub Stars: 9.5K

GitHub Forks: 1.3K

Languages: Go(99.1%), HCL(0.9%)

Image Source

Terraformer is an open-source CLI (Command Line Interface) tool by Waze SRE that generates tf/json and tfstate files based on existing infrastructure, i.e., reverse Terraform.

This tool performs the reverse of Terraform and can be thought of as Infrastrustructure to Code (IaC) tool, and you can check a quick demo of Terraformer here.

NOTE: The software is supported on Windows, MacOS, and Linux.

4. Diagrams

GitHub: https://github.com/mingrammer/diagrams

Official Documentation: https://diagrams.mingrammer.com/

GitHub Stars: 27.7K

GitHub Forks: 1.7K

Languages: Python(94.8%), JavaScript(3.7%), and Other(1.5%)

Image Source

Diagram is an open-source tool that allows you to draw the cloud system architecture in python code and prototype a new system architecture design without any design tools.

It lets you track the architecture diagram changes in any version control system and backs necessary providers, including AWS, Azure, GCP, Kubernetes, Alibaba Cloud, Oracle Cloud, etc.

The library sustains on-premise, SaaS, and noteworthy programming frameworks and languages.

NOTE: It does not control any actual cloud resources nor generate cloud formation or terraform code. It is just for drawing the cloud system architecture diagrams.

5. Online Boutique-Microservice Demo

GitHub: https://github.com/GoogleCloudPlatform/microservices-demo

Official Documentation: https://onlineboutique.dev/

GitHub Stars: 13.6K

GitHub Forks: 4.6K

Languages: Python(30.5%), Go(27.1%), HTML(9.0%), C#(7.5%), Dockerfile(5.6%), Shell(5.1%), and Other(15.2%)

Image Source

The online boutique is an open-sourced microservice demo of a cloud-first application consisting of 11-tier microservices applications. It is a web-based e-commerce application where you can browse different items, add them to carts, and purchase them.

Note: This website is hosted for demo purposes only. It is not an actual shop. This is not a Google product.

Google uses this software to showcase its technologies like Kubernetes, Istio, Stackdriver, and gRPC. The project is openly available to Google employees and other people who want to learn to use GCP.

Bonus 🌟

✨ Kubernetes The Hard Way

GitHub: https://github.com/kelseyhightower/kubernetes-the-hard-way

GitHub Stars: 34.2K

GitHub Forks: 11.7K

As a bonus, I am providing a handy tutorial that will help you take the long route but will ensure you understand each task required to bootstrap a Kubernetes cluster.

Suppose you plan to support a production Kubernetes cluster and want to understand how everything fits together. In that case, this guide will walk you through bootstrapping a highly available Kubernetes cluster with end-to-end encryption between components and RBAC authentication.

If you enjoy reading this article, we intercommunicate similar interests and are/will be in similar industries. So let’s connect via LinkedIn and Github. Please do not hesitate to send a contact request!

Subscribe 📧 For Weekly Tech Nuggets! 💻

--

--

Mrinal Walia

I'm a Data Scientist with a goal-driven creative mindset and a passion for learning and innovating.