Forem: Vikas Tiwari

MongoDB: A Beginner’s Guide

Vikas Tiwari — Wed, 07 Apr 2021 17:02:52 +0000

Overview

MongoDB is the most popular NoSQL database and is an open-source document-oriented database. The term ‘NoSQL’ means non-relational. MongoDB doesn't follow the table-like relational database structure rather MongoDB provides us the different mechanisms for storage and retrieval of data.
Format: BSON ( similar to JSON format)

MongoDB Atlas provides an easy way to host and manage your data in the cloud. This tutorial guides you through creating an Atlas cluster, set up the environment, connecting to it, and importing data in CSV format.

1 - Example of Document Model in MongoDB [Just take a look]

2 - Creating an Atlas Free-Tier Cluster

step 1

Signup on https://www.mongodb.com/cloud/atlas
Sign in, select the free pack, and select version 4.4 - give project name and cluster name (Note: Cluster name cannot be changed once deployed) respectively. (ps: wait for a min while the server is setting up)

step 2

Add a new database user as shown below { select MongoDB Roles as atlasAdmin@admin }

step 3

goto NETWORK ACCESS > select ADD IP ADDRESS > select ALLOW ACCESS FROM ANYWHERE > CONFIRM (without doing any changes)

For reference:
My project name = analytics
My cluster name = mflix
My collection name = movies

3 - Installing mongoDB

step 1 - Download Enterprise version -Download
Note: As we are downloading MongoDB version 4.4.0 it has database tools explicitly.

step 2 - we have to download it from Download Tools

Once Installed you will see the interface in the MongoDB folder as shown below -

step 3 -
1) goto C:\Program Files\MongoDB\Server\4.4\bin and copy the path

2) Open Control Panel\All Control Panel Items\System on your computer

3) goto Advanced system settings > select Advanced tab > select Environment Variables

4) Under system variables > select path > New > add C:\Program Files\MongoDB\Server\4.4\bin to path [Note : give it highest priority]

5) Repeat same for Tools and add it to environment variables C:\Program Files\MongoDB\Tools\100\bin

step 4 - create data folder in C drive and in data folder create one db folder - C:\data\db

Once you are done with the above things
step 5 -
1) open command prompt and execute mongod.exe [keep that command prompt window as it is and open new command prompt window]

To open new command prompt click - [Windows + R ] and write cmd > enter

2) In that new command prompt execute mongo.exe

Hurray,🙌 we are all set and now we can run mongoimport.exe and mongoexport.exe to play with the data !!

4 - Importing Data

step 1 - Download dummy data from https://sample-videos.com/download-sample-csv.php or use your own data with .csv extension.

step 2 - Connect cluster to MongoDB compass
1) Sign in - https://account.mongodb.com/account/login and open Clusters under DATA STORAGE as shown below

2) Click on connect > select Connect using MongoDB Compass > copy the string

3) Download MongoDB compass - https://www.mongodb.com/try/download/compass

4) Open your MongoDB compass and paste the string in the section and replace with your respective password which you kept while creating Database User > click on CONNECT.

step 3 - goto clusters under DATA STORAGE and click on 3 dots beside collections > select command-line tools > under DATA IMPORT AND EXPORT TOOLS - copy the URI string under mongoimport

step 4 -
1) open the command prompt with the path where your data resides (where you downloaded the dummy CSV file) and paste the copied string.
2) change password, database name, and collection name[Note: At the first time of creation you can give any name you want, to database and collection] respectively.
3) put as csv and as yourfilename.csv and then add --headerline in that string .

NOTE: When exporting or importing CSV data, an additional --fields flag is often required. Therefore, we are adding --headerline to the string

so your final string will look like 👇

mongoimport --uri mongodb+srv://<Here your project name will come bydefault>:<Enter your password>@mflix.3zfhn.mongodb.net/<Enter your database name> --collection <Enter your collection name> --type csv --headerline --file yourfilename.csv

Now hit the enter and your data will get imported which you can check in MongoDB compass as well on Atlas.

Wrapping up

So, we have discussed how to download the required tools & set up the environment to import the data and access the same in MongoDB Compass or Atlas.

I hope you enjoyed this article…Thanks for reading!

If you have any queries regarding this tutorial, feel free to leave comments in the discussion section below or contact me on LinkedIn.

See you guys in the next article! ❤️ ✌🏼

Getting Started With Kubernetes

Vikas Tiwari — Fri, 05 Mar 2021 14:09:10 +0000

Kubernetes has now become the de facto standard for deploying containerized applications at scale in private, public, and hybrid cloud environments.

okay, but wait what is Kubernetes?

Kubernetes is a container orchestration system that was open-sourced by Google in 2014. It is a portable, extensible platform for managing containerized workloads and services, that facilitates both declarative configuration and automation. It has a large, rapidly growing ecosystem. Kubernetes services, support, and tools are widely available.

Now, what does container actually mean?

In simple terms, a container is a place that holds all the required ingredients to run the respective application. In the end, it can be shipped to run in any environment.

The largest public cloud platforms AWS, Google Cloud, Azure, IBM Cloud, and Oracle Cloud now provide managed services for Kubernetes.

Why use Kubernetes?

In layman's terms, Kubernetes acts like a manager who is responsible for taking care of all the workers(containers).

Now let's see it in technical terms, When we run our production environments using a microservice pattern with many containers, we need to take care of many things. Such as health check, version control, scaling, and rollback mechanism. Kubernetes provides a container-orchestration engine that is used to automate deploying, scaling, and managing containerized applications on a group of servers.

Kubernetes Architecture

As you can see in the above diagram, there is a lot of gibberish terms that you don’t understand. Let's understand it one by one.

Kubernetes follows the master-slave architecture. Where master is master node and slaves are worker nodes.

Kubernetes Architecture consists of

1) Master Node - It manages the other worker nodes e.g node1 and node2

2) Worker Nodes - Generally, Worker nodes are virtual machines / physical servers running within a data center. It makes available the underlying network and storage for the application to use.

3) Kubernetes cluster - After deployment of Kubernetes, you get a cluster. It is a set of node machines called worker nodes for running containerized applications. where every cluster consists of at least one worker node. If you’re running Kubernetes, you’re running a cluster.

Kubernetes Components

Master Node

Master Node is responsible for making decisions about what tasks/operations have to be performed. It monitors everything if something unusual is found then it takes necessary actions respectively to rectify it.

Components of the Master Node

kube-apiserver:

The API server validates and configures data for the API objects which include pods, services, replication controllers, and others.
The layer exposes the API and interfaces to define, deploy, and manage the lifecycle of containers.
The main implementation of a Kubernetes API server is kube-apiserver.

etcd:

Kubernetes makes use of “Etcd” to store configuration data of the cluster and to represent the overall state of the cluster anytime. It is a Consistent and highly-available key-value store and the only source on which several entities are dependent to configure the state.

kube-scheduler:

It selects the node for newly created pods. Where Control plane component keeps watching for newly created Pods with no assigned node.

kube-controller-manager:

The component on the master who runs the controllers includes 4 controllers behind the scenes.
1-Node Controller
2-Replication Controller
3-Endpoint Controller
4-Service Accountant Token Controller
It runs the controller processes in the background to regulate the shared state of the cluster and perform a routine task. When there is any change in the service, the controller spots the change and ensures that nodes are up, running, and healthy.

Worker Nodes

Worker Nodes are slaves who perform the requested, assigned tasks. And they are controlled by Master Node. In simple terms, it is VM or physical server where containers are deployed. This is also known as a Minion node, and it contains the information to manage networking between containers such as Docker.

Components of the Worker Node

Kubelet:

An agent that runs on each node in the cluster and monitors that containers in a Pod are running and healthy. If not, a replication controller observes this change and launches Pods on another healthy Pod.

Containers:

The container runtime environment is responsible for managing containers, image pulling, stopping the containers, starting the containers, destroying the containers, and more. Which is placed inside the pod and needs an external IP address to view the outside process. Kubernetes supports several container runtimes: Docker, containerd, CRI-O, etc.
More about Kubernetes Container Runtime Interface.

Kube-Proxy:

Kube-proxy is a network proxy and a load balancer that runs on each node in your cluster. Kube-proxy maintains network rules on nodes which allows network communication to your pods where the services are exposed to the outside world.

Pods:

The way we use several virtual machines in our system. Similarly, Kubernetes Pod acts as our system which runs several containers within it. Here we can run dependent containers as well where the pod acts as a wrapper. Pods abstract the network and storage away from the underlying containers. With the help of pods, we can maintain our containers. This is a place where your app is running.

Okay Okay, I know a whole lot of theory is covered till now. But you made it through, Congratulations🎉!

In the upcoming blog, we will get our hands dirty and start with Kubernetes commands that will help you improvise your learnings. Till then follow up the Installation Guide and explore the tools available. Use/Install the tools supported by the Kubernetes community.

Reach me out on the following links:

LINKEDIN😀 YOUTUBE🚀