Forem: Acar Emmanuel

The Data Revolution: How Data Science and Analytics Are Reshaping Industries

Acar Emmanuel — Wed, 23 Apr 2025 09:40:58 +0000

In today's highly-connected world, data is being generated at an unprecedented rate. But raw data alone holds little value. It's the ability to collect, process, and analyze this information – the realm of data science and analytics – that is proving truly transformative. These fields, combining statistics, computer science, and domain expertise, are moving beyond historical analysis to leverage tools like machine learning and AI, enabling businesses across sectors to unlock powerful insights, drive efficiency, and forge new paths for growth.

The integration of data science and analytics is fundamentally changing how organizations operate:

Informed Decision-Making: Gone are the days of relying solely on intuition. Businesses now use data analysis to gain concrete evidence about market trends, customer preferences, and operational performance, leading to more strategic and reliable decisions.
Operational Efficiency: Identifying bottlenecks, optimizing supply chains, predicting maintenance needs, and streamlining resource allocation are key benefits. By analyzing operational data, companies can significantly reduce costs, minimize waste, and boost productivity.\
Enhanced Customer Understanding and Personalization: Analytics provides deep insights into customer behavior, needs, and purchase patterns. This allows businesses to tailor products, services, and marketing campaigns, creating personalized experiences that foster loyalty and drive sales. Examples like Amazon's recommendation engine highlight the power of this approach.
Innovation and Competitive Edge: By analyzing market data, customer feedback, and emerging trends, companies can identify unmet needs, develop innovative products faster, and refine their strategies to stay ahead of the competition.
Proactive Risk Management: Data analytics helps businesses anticipate and mitigate risks, from financial fraud detection and credit risk assessment to identifying potential operational disruptions or cybersecurity threats.

Transformation Across the Board: Industry Examples
The impact of data science and analytics is felt virtually across every industry:

Healthcare: Predictive analytics helps forecast disease outbreaks, personalize treatment plans based on patient data (including genomics), optimize hospital resource allocation, and accelerate drug discovery.
Finance: Banks and financial institutions use data science extensively for real-time fraud detection, algorithmic trading, credit risk assessment, and personalizing financial products for customers.
Retail and E-commerce: Personalized recommendations, demand forecasting, optimized inventory management, dynamic pricing, and targeted marketing campaigns are now standard practice, driven by customer behavior analysis.
Manufacturing: Predictive maintenance minimizes equipment downtime, quality control is enhanced through data analysis, and supply chains are optimized for efficiency, paving the way for smarter factories.
Transportation and Logistics: Companies optimize delivery routes (like UPS's ORION system), manage traffic flow, predict demand fluctuations, and improve overall supply chain logistics using real-time data analysis.
Energy: Data science aids in optimizing energy consumption, predicting equipment performance, managing smart grids, and improving the efficiency of renewable energy sources.

The Way Forward
Data science and analytics are no longer niche fields but core components of modern business strategy. As technologies like AI and machine learning continue to evolve, their ability to extract actionable insights from vast datasets will only grow. Businesses that effectively harness the power of data will be better positioned to innovate, adapt, enhance customer experiences, and ultimately thrive in the increasingly data-driven future.

Introduction to SQL for Data Science and Data Analysis

Acar Emmanuel — Tue, 15 Apr 2025 07:38:50 +0000

Whether you're diving into data science or data analysis, SQL (Structured Query Language) is a must-have skill. It’s the language of databases—powerful, efficient, and everywhere.

In this article, we’ll walk through the basics of SQL, including the types of statements used to create, manage, and retrieve data. By the end, you'll be comfortable working with SQL queries and understanding how they fit into your data workflow.

📁 What is a Database?

A database is an organised collection of data stored electronically. Think of it as a digital filing system where information is organized for easy access and management.

For example, a retail business might have a database with tables for customers, orders, and products.

🧱 What is a Schema?

A schema is the blueprint of a database. It defines how data is organized—what tables exist, what fields they have, and how they relate to each other.

Imagine a schema as the floor plan of your data house.

💽 What is a Relational Database Management System (RDBMS)?

A Relational Database Management System (RDBMS) is software that manages databases based on a relational model—data is stored in tables (also called relations), and tables can be linked using keys.

Popular RDBMSs include MySQL, PostgreSQL, SQLite, SQL Server, and Oracle.

🧪 Example Database: `sales_db`

To demonstrate SQL concepts, we’ll use a simple example database called sales_db, with the following tables:

-- customers table
CREATE TABLE customers (
  customer_id INT PRIMARY KEY,
  name VARCHAR(100),
  country VARCHAR(50)
);

-- products table
CREATE TABLE products (
  product_id INT PRIMARY KEY,
  name VARCHAR(100),
  price DECIMAL(10,2)
);

-- orders table
CREATE TABLE orders (
  order_id INT PRIMARY KEY,
  customer_id INT,
  product_id INT,
  quantity INT,
  order_date DATE,
  FOREIGN KEY (customer_id) REFERENCES customers(customer_id),
  FOREIGN KEY (product_id) REFERENCES products(product_id)
);

🔨 SQL Categories: DDL, DML, DQL

SQL commands are grouped into several categories. Let’s break them down:

📐 1. Data Definition Language (DDL)

Used to define and modify database structure:

CREATE: Creates tables or databases.
ALTER: Modifies existing tables.
DROP: Deletes tables or databases.

-- Add a column to products table
ALTER TABLE products ADD COLUMN stock INT;

✍️ 2. Data Manipulation Language (DML)

Used to insert, update, or delete data:

INSERT: Adds data.
UPDATE: Modifies data.
DELETE: Removes data.

-- Insert new customer
INSERT INTO customers (customer_id, name, country)
VALUES (1, 'Alice', 'Uganda');

-- Update a product's price
UPDATE products SET price = 15.99 WHERE product_id = 2;

-- Delete an order
DELETE FROM orders WHERE order_id = 10;

🔍 3. Data Query Language (DQL)

Used to fetch data—this is the bread and butter of data analysis:

SELECT: Retrieves data from one or more tables.

-- Get all products
SELECT * FROM products;

-- Get customer names from Kenya
SELECT name FROM customers WHERE country = 'Kenya';

🧮 Aggregate Functions

Aggregate functions summarize data across multiple rows:

COUNT(): Number of rows
SUM(): Total value
AVG(): Average value
MIN() / MAX(): Lowest / highest value

-- Total quantity sold
SELECT SUM(quantity) AS total_units_sold FROM orders;

-- Average product price
SELECT AVG(price) AS average_price FROM products;

🔤 ORDER BY and HAVING

🗂 `ORDER BY`: Sort results

-- List products by price, highest first
SELECT * FROM products
ORDER BY price DESC;

🧾 `HAVING`: Filter groups (used with GROUP BY)

-- Find customers with more than 3 orders
SELECT customer_id, COUNT(*) AS num_orders
FROM orders
GROUP BY customer_id
HAVING COUNT(*) > 3;

🎯 Final Thoughts

SQL is a foundational tool in the data world. By mastering its basic commands and understanding how databases work, you unlock the power to retrieve insights from raw data.

Next up, you can explore JOINs, subqueries, window functions, and performance optimization.

🚀 Tip: Practice using free tools like SQLite Online, DB Fiddle, or Mode SQL to build and query databases.

Let me know in the comments if you'd like a Part 2!

Python Dictionaries.

Acar Emmanuel — Wed, 11 Aug 2021 18:13:25 +0000

Hello all, before we dive into today's article. I would like to inform you that I have been attending a four week python bootcamp organised by Data Science East Africa and Lux Tech Academy.
So far I have learnt all the basics of python some of which I have been writing about here. Additionally, we have also been introduced to Flask and FAST API and this week we shall be handling data science.

Now back to today's article.

Dictionaries.

Dictionary in Python is an ordered collection of data values, used to store data values like a map, which, unlike other Data Types that hold only a single value as an element, Dictionary holds key:value pair. Key-value is provided in the dictionary to make it more optimized.

Creating a dictionary You can use the dict() function to create an empty dictionary in python.

   # creating an empty dictionary
  dictionary = dict()
  print(dictionary)
  {}

The curly brackets represent an empty dictionary. To add an item to the dictionary we use the square brackets.

   >>>dictionary['one'] = 'uno'

The above piece of code creates an item that maps from the key 'one' to the value 'uno'.
Printing the dictionary again gives a key-value pair with the key and value. {'one':'uno'}.
We can continue adding more items to the dictionary using the method demonstrated above.

   >>> dictionary = {'one': 'uno', 'two': 'dos', 'three': 'tres'}
   >>> print(dictionary)
   {'one': 'uno', 'three': 'tres', 'two': 'dos'}

Accessing the items in the dictionary. The order of items in a dictionary is not the same. You may get a different arrangement when you type the same items in the above demonstration example. The elements in a dictionary are not indexed meaning we can not access them via indices, instead we use keys as a 'substitute' for indices to access the values against it.

   >>>print(dictionary['one'])
      'uno'

From above, we see that 'uno' is returned because we used it's key 'one' to access it.
To know the number of key-value pairs we use len() function.

   >>>len(dictionary)
      3

The in operator can be used to tell whether something appears as a key in the dictionary.

>>>'one' in dictionary
    True
>>> 'uno' in dictionary
    False

To check whether something appear as a value, you can use the method values to return a list of values and them use the in operator to find it.

   >>>values  = list(dictionary.values())
   >>> 'uno' in values
      True

Dictionaries as counters. Suppose we want to count the number of times a letter appears in a word, we can loop through and increment our counter every time the letter is found.

  word = 'brontosaurus'
  d  = dict()
  for o in word:
      if o not in d:
         d[0] = 1
     else:
        d[0] = d[0] + 1
print(d)
# we get {'o':2}

This article is being updated.

Python Functions.

Acar Emmanuel — Tue, 03 Aug 2021 16:28:12 +0000

What is a function?

Simply put, a function in general terms is a sequence of statements that performs a computation. When you define a function , you give it a name followed by these sequence of statements.
Later on, you call the function by the defined name to perform what it was assigned to do.
If you have worked with python before you have probably worked with a function already! Chances are high that you did not know it even , take an example when you are trying to find the type of a value,

type(32)
 # Output is <class 'int'>

Tada! Easy right? Right there was among the functions you used along the way. It is one of many inbuilt functions that come along with python.
The name of the function right there is type and the expression in the parenthesis is called the argument of the function. An argument is a value that we pass into the function as an input and in this case the result of the type function is the type of the argument - an integer.
Briefly the main take away is that a function takes an argument and returns a return value.

Let's take a dive into in-built functions;

Python comes bundled with a lot of in- built functions. We will only look at a few of them.

The max and min function. These return the largest and smallest value respectively.

        numbers  = [4,6,1,0,56,78]
        print(max(numbers)) # returns 78
        print(min(numbers)) # returns 0

Type conversion function. These take values of one type and convert them to the type specified by that particular function but of course only when it can. Otherwise, an error is returned. Let's visualize it;

      >>> int('32')   #returns 32
      >>> int('Hello')  
       """ Returns value error. ValueError: 
          invalid literal for int() with base 10: 'Hello' """
      >>>int(3.455966696)  # returns 3

      >>>float(32)  #returns 32.0

      >>> float('3.14159') #returns 3.14159

      >>> str(40) # returns '40'
      >>> str(23.9)  # returns '23.9'

Random numbers. These are used to avoid a deterministic approach to things for example when designing a game you probably would not want your users to guess the next move so why not make them random. Not only that, how about the issue of security and privacy? Imagine a One Time Pin(OTP) or internet banking password that can be easily guessed because it follows a certain known pattern , why not do it the random way using python's inbuilt random function. For example when you want to generate 10 random numbers,check below.

   import random
   for x in range(10):
       x  = random.random()
       print(x)
   # returns 10 random numbers.

The random function returns a float betwen 0.00 and 1.00(including 0.00 but not 1.00).
Each time you run the above function a different set of 10 random numbers are generated as values of x.
Other functions that handle random numbers are randint and choice

    >>> random.randint(5,9) # returns any number from 5 to 9
     t = [3,6,4]
     >>> random.choice(t) #returns any value

Math function. There are set of in built functions in python that simplifies mathematical computations. We import the math library to be able to use these functions e.g. sqrt,log,sin,tan.

   import math
   >>> degrees = 45
   >>> radians = degrees/360.0 * 2 * math.pi
   >>>math.sin(radians)

User-defined functions.

You most likely have been waiting for this one. On top of Python's in-built functions. We can as well create our own functions.
To do this we use the def keyword followed by the function name and parameters if any.

   #defining a function in python
   def function_name(parameters): #may or may not have 
                                   #parameters
         # function statements here

Take an example of a function that prints the name of movies and takes no parameters.

   def movie_titles():
       print("Coming 2 America")
       print("Out of Death")
       print("War room")

   movie_title()  # function call

    #Output is the movie titles above

See also an example of a function that takes parameters. This one counts the number of items in a list.

   list  = [2,5,6,3]
   def count_list(list):
        count = 0
        for number in list:
              count = count + 1
        return count

   print(f"The number of items in the list is {count_list(list)})

Arguments and parameters.

Parameters are the variables that are defined during function declaration. They are found inside the the parenthesis.
On the other hand, arguments are the actual values that are assigned to the parameters.

def add(a,b):
   added  = a + b
   return added
x = add(3,5) # returns 8. 5 and 3 are the arguments of the function.

Fruitful and void functions.

"Fruitful" functions are those that have a return value. For example the above function which adds two numbers. When you assign it to x we get a return value of 8.
On the other hand, void functions are those that gives an output but do not have a return value.This is demonstrated by the previous example that was printing movie titles. When we assign the movie_list() function to let's say movies we get None simply because there is no return value.

That's the end of today's article I hope you learnt something.

Python Basics, Python 101!

Acar Emmanuel — Sat, 24 Jul 2021 18:58:45 +0000

In this article I am going to introduce the basics of Python and what you need to know to get started.

What is Python?

According to the official Python docs Python is an interpreted, object-oriented, high-level programming language with dynamic semantics.

Python was created by Guido van Rossum, and first released on February 20, 1991.
The need to develop Python was premised on the idea of easy code readability which is facilitates easy understanding, and a simple syntax which allows programmers to write programs in fewer lines of code.

The very first version of python released was version 0.9 on February 20,1991 and the latest version at the moment is python 3.10 released on October 04, 2021.

Python has become very popular over the years and the following are some of the reasons why it has become a darling among most software developers;

Easy to Learn and Use.
Mature and Supportive Python Community.
Support from Renowned Corporate Sponsors.
Hundreds of Python Libraries and Frameworks.
Versatility, Efficiency, Reliability, and Speed.
Big data, Machine Learning and Cloud Computing capabilities.

Installing and setting up Python.

Python is free for download from the official python website . Choose the appropriate operating system and computer architecture. Make sure to add Python to path during installation to be able to use it via the command line.

Installing the IDE to use.

There are several IDEs that you can use among which include;

Visual Studio Code download from here and be sure to install the appropriate extensions for Python.
PyCharm download from here.
Anaconda among others.

Getting started.

1. Python variables.

Variables also known as identifiers are reserved memory locations used to store values.
There are a couple of rules to follow when naming variables as follows;

A variable name must start with a letter or the underscore character
A variable name cannot start with a number
A variable name can only contain alpha-numeric characters and underscores (A-z, 0-9, and _ )
Variable names are case-sensitive (age, Age and AGE are three different variables)

  # correct variables
  name = "Manuel"
  my_name = "Manuel"
  myName = "Manuel"
  name1 = "Manuel"
  _name = "Manuel"

  # incorrect variable
  2name = "Manuel"
  *myName = "Manuel"

2. Python keywords.

These are reserved words that can not be used when naming variables in Python and for version 3.9 there are about 36 keywords.
Some few of them are; True,While,if,elif and for among many others.
The full list of keywords can be found from here.

3. Data types.

A data type is an attribute associated to a piece of data that tells a computer system how to interpret and execute its value.
Python data types or simply type include;

string
integer
float
boolean
byte

     string_demo = ' I am a string'
     float_demo = 2.45
     integer_demo = 245
     character_demo = 'A'
     bool_demo = True

4. Python operators.

There are various operators used in python.

Comparison operators.
Logical operators.
Arithmetic operators.
Bitwise operators.

     #Arithmetic operators
     y += 1 #incrementing by 1
     y -= 2 #incrementinh y by 2
     #comparison operators
     y = 2
     x = 3
     y > x  #evaluates to false
     x > y #evaluates to True
     x == y  #evaluates to false
     #logical operators
     logical_stuff = ['and','or','not']

5. Python literals.

Generally, literals are a notation for representing a fixed value in source code. They can also be defined as raw value or data given in variables or constants.(Geek for geeks)

String literals
Numeric literals
Boolean literals

    #string literal
    letter = 'n'
    #integer literal
    score = 90
    #string literal
    fruit = 'banana'

Happy reading and feel free to suggest any improvements. Stay safe.