Forem: Peter Johnson

Upload files to AWS S3 using Python

Peter Johnson — Mon, 25 Jul 2022 15:55:57 +0000

Hi, guys in this blog I'm going to share how you can upload files to AWS S3 using Python. Before getting started make sure that you have got the following requirements installed on your machine:

AWS CLI
Configured IAM user
Python

To operate we will be using Boto3 which is an AWS SDK for Python which provides API for AWS infrastructure services.

We will be making use of the upload_file method. This method accepts a file name, a bucket name, and an object name.

import boto3
s3_client = boto3.client("s3")
perform = s3_client.upload_file("FILE PATH","BUCKET NAME", "OBJECT NAME")

Explaining the code:

First of all, we import boto3, then we create an S3 client so that we can access the different methods offered by boto3, and we'll be using the upload_file method to upload our file. Upon running the code the mentioned file will be uploaded to the respective S3 bucket.

It's this simple to upload a file from your machine to an S3 bucket using Python, Hope that this was helpful to you.

AWS Amplify - Deploy your application in minutes.

Peter Johnson — Sat, 02 Jul 2022 18:46:28 +0000

In this blog I would like to provide a guide on how you can deploy your web application whether it be static or dynamic using AWS Amplify.

Before moving on let's basically understand what is Amplify:

In simple words Amplify is a framework that consists of Libraries, UI components, and CLI interfaces to build and deploy mobile and web applications.

1. Search for Amplify on AWS console and you'll land in a page like this:

2. Click on the New app dropdown and select Host web app.

3. In the next page you can see the different ways in which you can connect your code and Amplify:

For example by authenticating using GitHub you can link your corresponding repository and Amplify will do all the things for you, and when you push a new change to GitHub Amplify will automatically start a new build and publish the new change.

For this blog we'll select Deploy without Git provider which means we can directly upload the code files.

4. Now it's time to upload the code files and also you need to provide a App name and Environment name.

Here I've dragged and dropped my code files, alternatively if you have got the files stored in an S3 bucket you can connect to the bucket as well, after uploading click on save and deploy.

Once the deployment is successful you can click on the Domain and access your website.

That's it we are done with the deployment, hope you guys found it useful Thank you.

Host a Website on AWS EC2 Instance

Peter Johnson — Fri, 01 Jul 2022 18:08:56 +0000

Through this blog I'll provide a step-by-step guide through which you can host your static website on an AWS EC2 Instance.

So the services that we'll using are EC2 Instance and S3 Bucket (Used to store the code files).

1. The first step is to create an S3 bucket

Couple of important things to note are:

The bucket name is required to be unique and if you are planning to connect a domain name make sure your domain & bucket name are the same.
Also make sure you uncheck Block all public access otherwise the bucket won't be accessible.

2. The next step is upload the code files

Inside the bucket click on the upload button and upload the respective code files onto the bucket.

3. Change permission

In order for the bucket to be accessible we also need to make a change in the the permission section by modifying the bucket policy with the following code:

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "PublicRead",
            "Effect": "Allow",
            "Principal": "*",
            "Action": [
                "s3:GetObject",
                "s3:GetObjectVersion"
            ],
            "Resource": [
                "arn:aws:s3:::DOC-EXAMPLE-BUCKET/*"
            ]
        }
    ]
}

Here you need to replace DOC-EXAMPLE-BUCKET with your bucket name.

4. Now it's time to create an EC2 Instance

I've created a basic instance within the free-tier eligibility.

5. Connecting to the instance

The connection with instance is established using ssh, you can use the following command and replace the IP with your respective IP and Key.

ssh -i "peterawsjan.pem" ec2-user@18.221.22.171

6. Setting up the web server

First of all let's grab the sudo permission by entering

sudo su

Now its time to set things up, our EC2 Instance will act as an Server so for that we install httpd.

yum install httpd

Now that's done we need to pull data from our S3 bucket to the html folder of our Instance for that lets change directory.

cd  /var/www/html/

To fetch data from S3 bucket we need the object url which can be found in index.html file in the S3 section of the AWS console.

wget "your object URL"

Once you fetch it the type will be .zip and you need to unzip and move

uzip "your folder name"
mv "your folder name"* .

That's it now its time to start our server.

service httpd.service

You can access your hosted website by searching your Instances IP address.

I really hope this blog helped you host your website using EC2 Instance, Thank you.

Will Quantum computing supersede Cloud computing?

Peter Johnson — Sat, 12 Feb 2022 20:16:35 +0000

In this Blog I'll be sharing my view on Quantum Computing superseding Cloud Computing.

Let's start of by understanding what Quantum and Cloud computing is -

Quantum computers use the properties of quantum physics to store data and perform computations. In the case of classical computers the information is stored in the form of bits that can either be 0s or 1s but in a quantum computer, the basic unit of memory is a quantum bit or qubit.

Quantum computers have the unique ability to exist in more than one state simultaneously. So in situations where there are a large number of possible combinations, quantum computers can consider them simultaneously there by providing the output in a fraction of time.

Cloud computing is the delivery of online services (such as servers, databases, software) to users. With the help of cloud computing, storing data on local machines is not required. It helps you access data from a remote server. Moreover, it is also used to store and access data from anywhere across the world.

Will quantum computing supersede cloud computing?

As of now I think it's a NO, both quantum computing and cloud computing has their own advantages and disadvantages.

Quantum computing will be more relevant to certain businesses where highly complex algorithms need to be evaluated which in a normal computer would take days, weeks, months or even years.

Quantum computing is highly efficient in situations where there are a large number of possible combinations as it can consider them simultaneously. For Example in the financial sector quantum computing can perform deep analytics to new, faster trading possibilities. But these kinds of highly complex algorithms and high processing power will be used by only a fraction of businesses.

Not all organizations or technology based businesses require such high computational power for their application to operate, in that case a classical computer with specification optimized for their application would be more than sufficient.

The possibilities of Quantum Computing is immense and can benefit a lot of sectors, moreover more companies are investing on Quantum Computing(Amazon Braket, IBM, Sycamore), moreover a combination of quantum and classical computing can be also beneficial.

Must Know Linux Command that can make your Life Easier.

Peter Johnson — Sun, 30 Jan 2022 11:48:52 +0000

The main intention of this article is to provide a basic understanding of Linux commands, you can learn more about them by using the man command
man 'command name'

1. Locate

The locate command is used to locate files. Either a specific file can be searched or files with specific extensions can be searched as well.

The following command returns the entire path for the file "names.txt" if it exists on the machine.
locate "name.txt"
The following command returns all the files that has the extension ".txt"
locate "*.txt"

2. Find

Find is an important command which is used to find files or directories. So Locate command return the file location and the Find command return the file/directory name if it exists.

The following command return all the files in the current working directory(.).
find .
The following command return all the directories in the current working directory.
find . -type d
The following command returns all the files having the file extension ".txt" in the current working directory. -type f specifies that the type that should be searched is "file".
-name "*.txt" specifies that the name of the file that needs to be searched is everything() with the extension *.txt** .
find . -type f -name "*.txt"
The following command returns all the files that are modified 20 minutes ago.
find . -type f -mmin -20
The following command returns all the files that has a size more than 1Kb.
find . -type f -size +1k
The following command returns all the files that has got read-write-execute permissions.
find . -perm 777

3. File Permissions

Linux offers 3 permissions that can be assigned to all files and directories. There are 3 categories of owners for a file they are User(u) - Group(g) - Other(o). ls -l command displays all the files along with their permission details.

Read(r/4) - Permission to open and read a file. The permission can be assigned either by specifying r or by using the number 4

In the following image you can see that the file test.txt
is having read and write permission for User and read permission for both Groups and Others.

The following command sets the permission to read for all the owners.
chmod 444 test.txt
or
chmod u=r,g=r,o=r test.txt

Output :

Another Example :

The following command sets the permission to read,write and execute for User and read to both Groups and Others

chmod 744 test.txt

Output :

Write(w/2) : Permission to modify a file.
Execute(e/1) : Permission to run a file.

4. Perform an action on multiple files

There can be situations where we need to perform an action to multiple files simultaneously in that case the find command which we discussed earlier comes in handy.

Example :
In the following image you can see that there are 4 files and consider a situation in which we need to delete them in one go.

The following command selects all the files in the current directory("." : current directory, -type f : selects only file) and executes(-exec) the remove file command(rm -f). {} at first holds the first file file.txt then + selects the next file names.txt as + is mentioned and so on.. and for each file the command will be executed
find . -type f -exec rm -f {} +

5. top

The top command displays all the processes that are running along with their PID,CPU usage,Time,Memory,Port Number etc..
The kill (PID) command can be used to kill a process, as the top command provides the PID of a process.

Output :