Forem: Fay Kibowen

Python 101: Introduction to Python as a Data Analytics Tool

Fay Kibowen — Sun, 06 Oct 2024 20:41:53 +0000

Particularly for data analytics, Python has grown rapidly to become one of the most widely used programming languages. It is a preferred tool for analysts, data scientists, and engineers globally due to its ease of use, adaptability, and plenty of libraries. Python provides an easy-to-use starting point for those who are new to programming or are switching from another language to the field of data analytics.

Why Python for Data Analytics?

Simple to Learn and Use: Even novices may easily understand Python because to its simple and intuitive syntax. Python has an extremely low learning curve since it reads like English, in contrast to many other programming languages.

Huge Library Support: Python has an abundance of libraries that facilitate data analysis, visualization, and manipulation. Well-known libraries consist of:

Pandas: For managing huge databases and manipulating data.
NumPy: For effective array management and numerical operations.
Matplotlib and Seaborn: For producing stunning charts and visualizations.
SciPy: For sophisticated computation in science and statistics.
Scikit-learn: For predictive analytics and machine learning.
Scalability & Flexibility: Python is incredibly versatile and works well for both simple, small-scale tasks and intricate, large-scale data processing pipelines. From basic descriptive analytics to deep learning models and machine learning, it can handle it all.

Integration with Other applications: Python has good integrations with a wide range of databases, cloud services, and other applications, making it easy for analysts to work in a variety of settings.

Getting Started with Python for Data Analytics

For those who are just getting started using Python as a data analytics tool, here is a simple road map:

Configuring the surroundings
Setting up your workspace is necessary before you begin Python coding.

Set up Python: The official Python website has the most recent version available for download.
Notebook Jupyter: Jupyter Notebook is a widely used application for data analysts that lets you develop and execute Python code in a cell-based environment. Installing it may be done via the terminal with pip install jupyterlab or with Anaconda.

Getting to Know Python Fundamentals
You must have a firm grasp of fundamental Python ideas like:

Variables and Data Types: Recognize how Python works with various data types, including dictionaries, lists, integers, and strings.

Control Structures: To manage the flow of your programs, learn how to employ conditional statements (if, else) and loops (for, while).
Uses: Creating reusable code blocks can help you maintain a modular and well-organized analysis.

To get you started, consider this little bit of Python code:

# Importing essential libraries
import numpy as np
import pandas as pd

# Creating a small dataset
data = {'Name': ['John', 'Jane', 'Mike', 'Emily'],
        'Age': [28, 34, 29, 42],
        'Salary': [50000, 62000, 59000, 76000]}

# Converting the data to a pandas DataFrame
df = pd.DataFrame(data)

# Displaying the dataset
print(df)

Pandas-Assisted Data Manipulation
The Pandas library in Python is the foundation for its data analytics capabilities. Working with structured data is made simple using pandas, which is especially helpful when working with big datasets in SQL, CSV, or Excel.

A quick overview of some crucial Pandas functions is provided here:

Loading Data: You may use Pandas to import data from a variety of sources, including Excel and CSV files (pd.read_excel and pd.read_csv).
DataFrame Manipulation: You can examine and comprehend your dataset by using functions like df.describe(), df.head(), and df.tail(). Additionally, it is simple to filter, sort, and work with data columns.
Handling Missing Data: In real-world datasets, missing values are common. To deal with these scenarios, Pandas provides useful functions like df.isnull(), df.fillna(), and df.dropna().

# Checking for missing values
print(df.isnull())

# Filling missing values (if any)
df.fillna(0, inplace=True)

# Dropping rows with missing values
df.dropna(inplace=True)

Matplotlib and Seaborn for Data Visualization
Visualizing your data is the next step once it has been cleaned and prepared. In order to assist you in creating graphs, plots, and charts, Python provides robust visualization tools such as Matplotlib and Seaborn.

import matplotlib.pyplot as plt
import seaborn as sns

# Plotting a bar chart of salaries
plt.figure(figsize=(8,6))
sns.barplot(x='Name', y='Salary', data=df)
plt.title('Salary Distribution')
plt.show()

In data analytics, visualization is essential because it can reveal patterns, trends, and outliers that raw data may not be able to.

Analysis of Exploratory Data (EDA)
EDA is the process of examining datasets and compiling a summary of their key features. Python's integration of visualization packages, NumPy, and Pandas makes EDA informative and effective. EDA seeks to comprehend the structure of the data, find connections, and detect any possible trends or abnormalities.

Here are a few EDA methods:

Summary Statistics: The mean, standard deviation, minimum, and maximum values for each numerical column are summarized by the df.describe() function.
Correlation Analysis: df.corr() computes the correlation between variables, which is useful for discovering relationships.

Using Scikit-learn for Machine Learning
You may wish to use machine learning to create classifications or predictions after completing EDA. The Scikit-learn module for Python is a great tool for putting machine learning models like clustering, regression, and classification algorithms into practice.

For instance, the following describes how to use Scikit-learn to build a basic linear regression model:

from sklearn.linear_model import LinearRegression

# Creating a simple regression model
model = LinearRegression()

# Fitting the model with some data
X = df[['Age']]
y = df['Salary']
model.fit(X, y)

# Predicting salaries based on age
predicted_salary = model.predict([[30], [40]])
print(predicted_salary)

In summary
Python is among the greatest tools for data analytics because of its adaptability, simplicity of use, and robust libraries. Python gives you the skills to succeed whether you're cleaning data, examining trends, or creating machine learning models. Even more potent methods and approaches for data analysis and interpretation will become apparent to you as you study and experiment with Python more.

Python for data analytics can be intimidating to start with, but with a well-planned learning path and constant practice, you'll be extracting insightful information from data in no time!

SQL 101: Introduction to Structured Query Language

Fay Kibowen — Sun, 29 Sep 2024 13:55:58 +0000

Structured Query Language, or SQL, is a potent language used for database management and manipulation. It was developed in the 1970s and is now one of the most important tools for handling data in modern times. In relational databases, SQL enables us to create, retrieve, update, and delete (CRUD) data. There's a good possibility you've dealt with SQL if you've ever worked with data!

What is a database?

All that a database is, is a collection of organized or meaningful data. Imagine it as a much larger version of an orderly spreadsheet with rows and columns. Databases can hold vast amounts of text, similar to a library of books, as well as information such as customer records and product catalogs.

Common SQL Commands

SELECT – Retrieve data from a database. INSERT – Add new data to a database. UPDATE – Modify existing data. DELETE – Remove data. CREATE – Create a new database or table. DROP – Delete a table or database.

SQL Syntax: Basic Structure
SQL commands are written as statements. A basic SQL query looks something like this:

SELECT column_name
FROM table_name;

It’s as simple as that! Let's say you want to view all the customer names from a table called customers. You’d write:

SELECT customer_name
FROM customers;

How to Set Up SQL:
To get started with SQL, you’ll need a SQL environment. This could be a database management system (DBMS) like MySQL, PostgreSQL, or SQLite. Once you’ve installed one of these, you can start writing SQL commands to interact with your database.There are also cloud-based SQL services if you prefer to work in the cloud.

Creating a Database

Creating a database is one of the first things you’ll do. It’s like setting up a new workbook for a project. Here’s how you can create a new database in SQL:

CREATE DATABASE Technology;

This command creates a database called Technology. Now you can create tables inside this database to store your information!

If you want to check if the database is created, you use the command:

show databases;

Tables in SQL

Tables are where all your data lives. Each table is organized into rows and columns, where:

Rows = individual records (e.g., one customer’s details).
Columns = categories of data (e.g., customer names, email addresses, etc.).
Let’s create a basic table for storing customer information:

CREATE TABLE customers (
    customer_id INT,
    customer_name VARCHAR(100),
    email VARCHAR(100),
    age INT
);

This command creates a customers table with four columns: customer_id, customer_name, email, and age. Each customer will have a unique customer_id (because of PRIMARY KEY), and the VARCHAR(100) defines the length of text that can be stored in the column.

Inserting Data into a Table

Once you have a table, it’s time to fill it with data! To add a new customer, we use the INSERT statement.

INSERT INTO customers (customer_id, customer_name, email, age)
VALUES (1, 'Faith Jeptoo', 'faykibowen@gmail.com', 20);

This command adds a new row to the customers table. Each value corresponds to a column in the table.

Retrieving Data from a Table

To see the data we’ve inserted, we use the SELECT statement:

SELECT * FROM customers;

The * means "all columns," so this query retrieves everything from the customers table. You should see something like this:

+-------------+---------------+-----------------------+---------+
| customer_id | customer_name  | email                 | age    |
+-------------+---------------+-----------------------+---------+
| 1           | Faith Jeptoo   | faykibowen@gmai.com   | 20     |
+-------------+---------------+-----------------------+---------+

Data Manipulation

use accenture_my;

show tables;

this will shows all the tables in the database

LIMIT

SELECT * from content;
limit 3;

The limit function will only shows records from 3 rows in the content table

DISTINCT
Helps avoid duplicates by choosing unique values/records.

SELECT DISTINCT(column_name)
from content;
SELECT * from reactions;

column_name is the category.
If we hade two hates from the column, the the utcome will choose one avoiding duplicates.

Filtering Data

If you only want to retrieve specific data, you can add a condition using the WHERE clause. For example, to get all customers who are 25 years old, you can write:

SELECT *
FROM Africa;
WHERE country = 'Kenya';

This will return just the names of people from Kenya.

Updating Data
If John Doe’s email changes, we can update it with the UPDATE command:

UPDATE customers
SET email = 'john.new@example.com'
WHERE customer_id = 1;

This command updates the email for the customer with the ID of 1.

Deleting Data

To delete a customer from the database, we can use the DELETE command:

DELETE FROM customers
WHERE customer_id = 1;

This will remove the customer with ID 1 from the table.

SQL Data Types

SQL tables support various data types to store different kinds of information. Here are a few common ones:

INT – Whole numbers. VARCHAR – Variable-length text. DATE – Stores dates. FLOAT – Decimal numbers.

Joins: Combining Data from Multiple Tables
Sometimes, data is spread across multiple tables. You can use a SQL JOIN to combine related data. For example, if you have an orders table and a customers table, you can link them with a join to see which customer placed which order.

SELECT customers.customer_name, orders.order_id
FROM customers
JOIN orders
ON customers.customer_id = orders.customer_id;

Wrapping Up
SQL is a simple yet incredibly powerful language for managing and working with databases. From retrieving data to manipulating tables, SQL is the go-to language for anyone looking to manage data efficiently. Whether you’re working with small datasets or managing big databases, SQL is a must-learn!

CTE
Common Table Expression-I want the results of a certain query or statement be stored with a given. Somewhat like variables in C.

WITH kibowen AS (
SELECT *
FROM reactions
WHERE react = 'Disgust');

Final Thoughts
Learning SQL might seem intimidating at first, but with practice, you’ll get the hang of it. Start small—try creating your first database, add some tables, insert data, and experiment with basic queries. Before you know it, you'll be a SQL pro! Happy querying!