Forem: Samuel Kalu

Exploratory Data Analysis on the Iris Flower Dataset

Samuel Kalu — Tue, 02 Jul 2024 13:05:23 +0000

Motivation

This is my submission of stage zero in the HNG 11 internship, I am currently deep exploring the field of data analysis , I believe this internship gives me the opportunity to learn and grow more in this field

To know more:

Observation from first glance

Looking at the Iris dataset from first glance,
The Iris flower dataset comprises 150 samples with four features each: sepal length, sepal width, petal length, and petal width, distributed across three species: Iris-setosa, Iris-versicolor, and Iris-virginica, with 50 samples per species

Exploratory Data Analysis

The pairplot above easily summarizes how the entire distribution of the 4 features are against the target variable.

We can infer all of the above

The pairplot of the Iris dataset provides a visual summary of the relationships between the four features (sepal length, sepal width, petal length, and petal width) for the three Iris species: setosa, versicolor, and virginica. Here are some detailed observations:

Species Separation:
- Iris-setosa: This species is distinctly separated from the other two species in almost all pairwise comparisons. The petal length and petal width features are particularly effective in distinguishing Iris-setosa, as the points representing this species form a distinct cluster in the lower left corner in the petal length vs. petal width plot.
- Iris-versicolor and Iris-virginica: These two species overlap more but show some degree of separation. The petal length and petal width features again provide good separation, with Iris-versicolor generally having smaller petal measurements compared to Iris-virginica. However, there is still some overlap between these two species in the middle range of the feature values.
Feature Distributions:
- The diagonal plots show the kernel density estimates (KDE) for each feature within each species. These plots reveal that the distribution of each feature varies significantly between species. For example, Iris-setosa has a much narrower and distinct distribution for petal length and petal width compared to the other two species.
- Sepal length and sepal width have more overlapping distributions, especially between Iris-versicolor and Iris-virginica, making them less effective for classification on their own.
Inter-feature Relationships:
- There is a noticeable positive correlation between petal length and petal width across all species, particularly within Iris-versicolor and Iris-virginica.
- Sepal length and petal length also exhibit a positive correlation, especially for Iris-versicolor and Iris-virginica, while Iris-setosa remains distinctly separated.
- Sepal width shows a weaker correlation with other features compared to the petal measurements.
Within-Species Variability:
- Iris-setosa shows low variability in petal measurements, which are consistently small.
- Both Iris-versicolor and Iris-virginica exhibit more variability in their petal measurements, with Iris-virginica generally showing the largest measurements.

CORRELATION

The correlation matrix heatmap of the Iris dataset reveals the relationships between the features. Sepal length shows a strong positive correlation with petal length (0.87) and petal width (0.82). Petal length and petal width are highly correlated (0.96), indicating that as petal length increases, petal width also tends to increase significantly. Sepal width, on the other hand, has a weak negative correlation with sepal length (-0.12) and moderate negative correlations with petal length (-0.43) and petal width (-0.37). These insights suggest that petal measurements are more strongly interrelated compared to sepal measurements, which are less correlated with each other and with petal measurements

Thanks so much for reading😊, Cya👋.

How to Land a Job as an AI Engineer 🤖

Samuel Kalu — Thu, 26 Oct 2023 00:26:08 +0000

If you've set your sights on a career as an AI engineer, you're in the right place. Landing a job in this exciting field requires a combination of technical skills, experience, and a strategic approach to job hunting. In this comprehensive guide, we'll walk you through the steps to help you secure that coveted position as an AI engineer.

1. Master the Fundamentals 🧠

Before you dive into the job search, it's essential to ensure you have a strong foundation in artificial intelligence and machine learning. This means understanding the basic principles, algorithms, and programming languages used in AI development. Python, TensorFlow, and PyTorch are some of the key tools you should be comfortable with. Consider taking online courses or earning a degree in computer science or AI to bolster your knowledge.

2. Build a Stellar Portfolio 📚

One of the most effective ways to stand out as an AI engineer is by showcasing your skills and projects. Create a portfolio that highlights your AI-related work, including personal projects, research, or contributions to open-source initiatives. Potential employers will be impressed by tangible examples of your abilities, so make sure to provide detailed explanations of the projects you've undertaken.

3. Network, Network, Network 🌐

Networking is often the key to unlocking great job opportunities in the tech industry. Attend AI conferences, seminars, and meetups. Connect with professionals on LinkedIn and participate in AI-related forums and communities. Building a strong network can help you access unadvertised job openings and gain insights into the industry.

4. Customize Your Resume 📃

Your resume is your first impression on potential employers. Tailor it to the specific job you're applying for by emphasizing the skills and experiences relevant to the role. Highlight your AI projects, technical skills, and any relevant certifications or publications. Don't forget to include a concise yet compelling summary statement at the top.

5. Ace the Technical Interviews 💡

AI engineer interviews often include technical assessments, so be prepared to showcase your skills. Practice coding challenges, algorithm questions, and be ready to discuss your past projects in depth. Consider joining AI-related coding platforms to hone your problem-solving abilities.

6. Stay Informed 📰

The field of AI is ever-evolving. To be a competitive AI engineer, you must stay updated with the latest trends and breakthroughs. Follow leading AI research journals, subscribe to AI-focused newsletters, and participate in online courses to keep your knowledge fresh and relevant.

7. Seek Internships or Entry-Level Positions 🚀

If you're new to the AI industry, consider starting with internships or entry-level positions to gain practical experience. These opportunities can help you build your professional network and add valuable entries to your resume.

8. Prepare for Behavioral Interviews 🤝

AI engineer roles often require collaboration and problem-solving in a team setting. Be ready to answer behavioral interview questions that assess your interpersonal and communication skills. Use the STAR method (Situation, Task, Action, Result) to structure your responses.

9. Leverage Online Job Platforms 💻

When you're ready to apply, use online job platforms like LinkedIn, Glassdoor, and Indeed. Customize your applications for each position, and follow up with personalized messages to express your enthusiasm for the role.

10. Stay Persistent and Positive 🌟

The job search process can be challenging, but maintaining a positive attitude and staying persistent is crucial. Rejections are part of the journey, and each one brings an opportunity to learn and improve.

In conclusion, securing a job as an AI engineer requires dedication, continuous learning, and a strategic approach. Master the fundamentals, build a strong portfolio, network with industry professionals, and tailor your application materials to each job. By following these steps and staying committed, you can position yourself as a top candidate and land the AI engineer job you've been dreaming of.

How Machine Learning Supercharges Cybersecurity

Samuel Kalu — Sun, 23 Jul 2023 18:54:59 +0000

Introduction

In an era where cyber threats are evolving at lightning speed, the traditional approaches to cybersecurity are struggling to keep pace. Enter machine learning , a revolutionary technology that is changing the game and supercharging cybersecurity. In this article, we will explore how machine learning is transforming the world of cybersecurity, safeguarding us against an ever-growing array of digital dangers

Here I would be mentioning some applications of machine learning in the field of Cybersecurity

Detecting Anomalies with Unparalleled Precision

Traditional security systems often rely on predetermined rules to detect and prevent cyber threats. While these rules serve as a basic line of defense, they struggle to keep up with the ever-changing tactics of hackers. Machine learning, on the other hand, uses sophisticated algorithms to analyze vast amounts of data, enabling it to identify patterns and anomalies that would be impossible for human operators to spot.

By continuously learning from new data, machine learning models can adapt to emerging threats and detect abnormal behavior in real-time. Whether it's a stealthy malware infection or an attempted data breach, these intelligent algorithms can raise the alarm promptly, allowing security teams to respond swiftly and prevent potential disasters.

DDOS(Distributed Denial of Service) Attacks Mitigation

Machine learning plays a vital role in fortifying cybersecurity defenses, and when it comes to DDoS prevention, it becomes an invaluable ally. Imagine it as a watchful guardian, constantly scanning for potential threats. DDoS attacks are usually those nasty floods of traffic meant to overwhelm websites, can cripple online services, causing headaches for users and businesses alike.

However, machine learning steps in as a superhero with its data-crunching prowess. It learns from past attack patterns, identifying anomalies and suspicious activities in real-time. This helps it swiftly recognize and mitigate these DDoS attacks, acting like a shield to keep websites running smoothly and securely.

Malware detection

Malware, short for malicious software, poses a grave threat in the digital landscape. To tackle this menace effectively, machine learning emerges as a powerful ally. Machine learning equips computer systems with the ability to learn and recognize patterns from vast datasets. In malware detection, ML algorithms scrutinize code and behaviors to spot new and emerging threats, even those previously unseen. By continuously adapting and evolving, these smart systems stay one step ahead of cyber criminals, safeguarding individuals and organizations from potential harm. Through its intelligent and swift analysis, machine learning fortifies our cybersecurity defenses, making our digital world safer and more resilient.

Some other applications of Machine Learning which I couldn't cover here are:

-Spam Detection
-Phishing detection
-User Behavioral Analytics
-Network security, and so on.

See you next time😉

Machine Learning in Healthcare: How AI is Improving Patient Care

Samuel Kalu — Sat, 22 Jul 2023 16:18:20 +0000

Introduction

In the fast-paced world of technology, the healthcare industry is experiencing a revolutionary transformation with the integration of Artificial Intelligence (AI) and Machine Learning (ML). These cutting-edge technologies are not just buzzwords; they are superheroes changing the face of patient care. In this article, we'll embark on a captivating journey exploring how AI-driven ML is redefining healthcare, making it more personalized, efficient, and ultimately, life-saving.

The Rise of AI in Healthcare

AI and ML are not just science-fiction dreams; they are tangible tools making a real impact on patient care. In healthcare, AI acts as a skilled assistant to medical professionals, augmenting their expertise with data-driven insights. Machine Learning algorithms analyze vast amounts of patient data, helping doctors make accurate diagnoses and tailor treatment plans to individual needs.

Empowering Early Detection

Imagine a world where diseases can be detected even before they manifest symptoms. AI-powered ML systems are making this dream a reality. By continuously monitoring patients' health data in real-time, these vigilant systems identify minute changes and red flags that may indicate an underlying health issue. Early detection means early intervention, potentially saving lives and preventing complications.

The Personalized Healthcare Revolution

One-size-fits-all treatment approaches are becoming a thing of the past, thanks to AI. Machine Learning algorithms can analyze a patient's genetic makeup, lifestyle habits, and medical history to create personalized treatment plans. This level of customization ensures that patients receive the most effective and appropriate care, improving outcomes and reducing unnecessary medical procedures.

Enhancing Medical Imaging

The field of medical imaging has witnessed a major overhaul with AI's intervention. ML algorithms excel at analyzing complex medical images, such as X-rays, MRIs, and CT scans, with remarkable accuracy. This not only expedites the diagnostic process but also helps in identifying early-stage abnormalities that might be overlooked by the human eye. AI-driven image analysis ensures no detail goes unnoticed.

Streamlining Administrative Tasks

AI doesn't just benefit patients; it also lends a helping hand to healthcare providers. By automating administrative tasks like appointment scheduling, billing, and record-keeping, AI streamlines operations, allowing medical professionals to focus more on patient care. This boost in efficiency means reduced waiting times, smoother workflows, and an overall enhanced patient experience.

Fighting Pandemics with Data

When a health crisis strikes, such as a pandemic, AI can be a powerful ally in managing and containing the spread of diseases. ML models can process vast amounts of data from various sources, predicting disease hotspots, analyzing infection patterns, and even aiding in vaccine development. With AI on our side, we can arm ourselves with data-driven strategies to combat outbreaks effectively.

Ethical Considerations and the Human Touch

While the benefits of AI in healthcare are immense, we must also address ethical considerations. Patient data privacy and security are paramount, and transparent guidelines must be established to safeguard sensitive information. Additionally, AI should 'augment' human expertise rather than replace it. The human touch in healthcare, including empathy and intuition, remains invaluable in patient care.

The Road Ahead

As AI and ML continue to advance, the future of healthcare appears brighter than ever. With the ongoing collaboration between medical experts and tech innovators, we can expect even more groundbreaking solutions. The synergy between human knowledge and AI-driven insights will lead to better treatment options, faster diagnoses, and more accessible healthcare for all.

Conclusion

The integration of AI and Machine Learning in healthcare is a remarkable journey towards a more patient-centric and efficient system. From empowering early detection to personalizing treatment plans, these technological marvels are revolutionizing patient care. As we embrace this new era of healthcare, we must ensure that ethical considerations and the human touch remain at the heart of this transformation. With AI as our ally, we embark on a promising path to a healthier and happier future.🚀🚀

Introduction to Open Source

Samuel Kalu — Fri, 26 May 2023 21:53:15 +0000

What exactly is open source?

Open source refers to the collaborative approach of developing software where the source code is freely available, allowing anyone to view, modify, and distribute it.

This helps to foster a community driven ecosystem that allows anybody around the world to copy , modify and collaborate on building software.

It brings forth a lot of transparency in how software is built when everyone and their grandmother can actually see the source code and identify any flaws.

My Experience in Open Source

Exactly Three months ago , I took it upon myself to venture on a 30 day challenge in Open Source, my objective , to actively participate in open source development , whether it was code contributions , helpful comments or documentation fixes. I decided to document my journey by constantly tweeting my progress.

Just do it

At the start of the challenge, I absolutely had no idea about what I was going to contribute to as there was an unbelievable gap between my current knowledge about coding and what I was actually seeing on the repositories I planned to contribute to.

It might be quite counter-intuitive but the only way to get better is by actually surpassing your limits and actually making those contributions.

Start Small

So whatever repository you plan to contribute to, I assure you , you most likely aren't going to understand the codebase the first time you go there. So you start by raising an issue(it could be in form of a question about a bug you've experienced in the past with the library) , you could easily get more experienced contributors put you through and answer your question

You see!, Just asking a question in itself already counts as open source contribution

Most open source communities(as far as I know) are very welcoming and would not hesitate to help you out.

Still on starting small , most repositories have a "good first issue" policy, this is a tag found on their issues page and it consists of issues/bugs in the repository that are quite easier to resolve. It mostly is a dependency issues, import errors or even typos.

Speaking about typos , yes they also count as Open source contributions😂.

Create your own Open Source projects

There is no better way of contributing to open source projects than actually writing your own , and quick tip , it doesn't even have to be code , it could be a list of some useful tools for developers which would absolutely be appreciated.

Consistency

Proceeding with my journey , I subconsciously proceeded from making typo-fix contributions to actually making code contributions, and it became quite interesting.

I finished my 30 days challenge, and ended up contributing to over 10 repositories.I also got to learn useful things about software projects like how unit testing is done and the importance of most weird files.

Talk More

What's the point in doing open source if you don't talk about it .Talk about it everywhere, to your friends, to your dog, in church, also whenever you go to the club🙂.

On a more serious note , the secret to enjoying open source is continuous interaction. The codebase becomes seemingly clearer and uncomplicated the more you interact with other people on the project, you could interact with other contributors mostly through a discord / IRC channel which is available for most repositories

Conclusion

Of course I wouldn't end this writeup without giving you some resources to aid you in your journey

Learn Git Properly - This teaches you git , a version control system
Up For Grabs - Shows you repositories that need your attention , it's quite amazing because it's mostly beginner rated issues that are quite easy to solve
Eddie Hub- An amazing Open Source community that I'd absolutely recommend for you to join

Thanks for reading 👋

Introduction to BERT Language Model

Samuel Kalu — Tue, 07 Mar 2023 12:36:12 +0000

BERT, an acronym for Bidirectional Encoder Representations, is a language model architecture that was created by Google in 2018.

This architecture was trained using a massive dataset consisting of approximately 2.5 billion words from the entire Wikipedia library and around 800 million words from the Google Books Corpus.

Training a model using such a large dataset would typically require a very long period of time, but thanks to the newly introduced Transformer architecture and the use of high-speed TPU's (Tensor Processing Units), Google was able to complete the training process in just four days

So as I said in the paragraph above , it is built on the transformer architecture a novel approach to NLP modelling which uses techniques like self-attention to identify the context of words.

Transformers usually consist of encoder and decoder blocks , but the Bert architecture only used encoders stacked onto one another.

Google initially released 2 versions:

Bert Base: with 12 encoders
Bert large: with 24 encoders

Bert was such a hit because it could also be used for many NLP problems like sentiment analysis, text summarization, and question answering.

We would be building a simple sentiment analysis classifier using a Bert model and the transformers library

You would want to use a Jupyter notebook for this tutorial(a Google Colab Environment will be preferable)

Firstly , we install these 2 libraries

!pip install transformers torch

Then we proceed to use these few lines of code for importing and loading our model


from transformers import pipeline
pipe = pipeline(task= "sentiment-analysis")
# the pipeline object defaults to using a lightweight version of BERT

Then we can simply check the semantic score of a piece of text by doing


pipe("This book was amazing , great read")

#[{'label': 'POSITIVE', 'score': 0.9998821020126343}]


pipe("The pig smelled very terribly")

#[{'label': 'NEGATIVE', 'score': 0.9984949827194214}]

The transformers library implements a lot of large language models very easily in python with only a few lines of code

You can check out a lot of other usecases of BERT here on HuggingFace

Thanks for the read, See ya👋

Introduction to Ensemble modelling

Samuel Kalu — Mon, 06 Mar 2023 13:11:54 +0000

What is Ensembling?

Ensembling is simply a way of aggregating predictions from different machine learning models with the hope of creating a much better model capable of generalizing well to new data.

Ensembling provides a sense of confidence in our predictions by leveraging the collective strength of multiple models. As living beings, we understand the concept of "unity in strength", the same principle also applies to machine learning models. By combining the strengths of individual models, ensembling can improve the accuracy and robustness of predictions.

Ensemble algorithms, such as random forest, XGBoost, CatBoost, and AdaBoost, utilize multiple weak learners to achieve impressive results. These weak learners are typically small decision trees with limited depth and features

Types of Ensembles

Boostrapping aggregation (e.g random forest)

This is also known as bagging, with this method , the model is trained on few "boostrapped" datasets , bootstrapped datasets are basically variants of the original training set but with repeated or missing samples.

Multiple weak learners are trained on those bootstrapped datasets and a voting of corresponding predictions is carried out.

Boosting(e.g catboost, xgboost)

This also uses weak learners , but here the weak learners get better by correcting the errors of their preceding learners.
To visualize this , the data points are usually assigned equal weights , then a model is trained on those weights. The misclassified samples from the data are then assigned larger weights and then retrained, this done multiple times.

Stacking
In stacking, the predictions of several models are used as input to another model, called the meta-model. The meta-model is trained on the predictions of the base models to make the final prediction.

There are myraid of creative ways even outside of the popular methods in which one can ensemble two or more different models together. By combining models we tend to reduce their weaknesses and amplify their strengths.

Thanks for reading, Adios👋.

INTRODUCTION TO MACHINE LEARNING, A DUMMY APPROACH

Samuel Kalu — Sat, 24 Sep 2022 10:13:26 +0000

Have you ever wondered how you as a sentient human is able to identify images? , how you are able to tell the difference between looking a table and a chair , or a cat and a dog.

What if you travel thousand of light years into space and meet aliens and make friends with them ,One day you're trying to explain the significant physical differences between a cat and a dog, how would you do it?
I guess you'd start from describing whiskers on the cat,more teeth on the dog , their relative sizes and probably the jaw shapes of both animals. Those characteristics are what you call "features".

Let's probably assume you don't have a photo like this one you'd have to explain major features to differentiate these animals

Now , away from advanced lifeforms who could actually comprehend your explanation.
Let's say you're trying to explain it to a computer,
....Can you?, We know computers understand stuff in zeros and ones so how would we be able to even give instructions in the first place 😂. Well, hold up... Computer programmers are people who writes programs to make a computer perform a specific task.

Now, let's assume that you're a computer programmer who commands a computer system. Now how can you explain the pressing issue of differentiating between a cat and a dog to a computer?Actually if you can it'll be an Herculean task having to hard-code all the pixels and their specific locations.
Moreso what if you're presented with a different breed of dogs and cats to work with, what if the location of cats and dog in the image is changed or even worst-case scenario you are presented pictures of horses and now you have to re-adjust the entire program to meet those edge cases.

Machine learning is way of finding patterns in data through feeding tons and tons of data to a computer system. From our last paragraphs problem, instead of we writing a program to differentiate these two animals , we could give the computer thousands of images of these two animals and with the help of some algorithms, find suitable patterns and differentiate to even human level capabilities between these two animals

Machine learning could be applied not to only our problem but to many other problems , it could perform not just differentiating between images but differentiating between text , automated (self) driving cars and even recently ,generating images that have never existed before.

Above are just a few of the applications of machine learning , it possesses a lot of untapped potential and has a lot in store for the future

Hey, check out this app I built to differentiate dogs from cats using neural networks , a form of machine learning.
Cats-and-Dog-Classifier

Thanks for reading 🙏

Getting started with machine learning on your Android device in 2022.

Samuel Kalu — Sun, 02 Jan 2022 13:45:35 +0000

Machine learning has been a tech buzz word for the past few years. Its simplest definition is that it basically leverages on the use of tons of data to make predictions.

Well , in this article , I'm going to be showing you on how to get started using just your mobile phone(Android preferably).

Firstly , install an app called termux from the Android PlayStore

Then open the app and run the following commands :

$ apt update && apt upgrade
$ apt install python
$ pip install jupyter

Definitely , the above commands will take several minutes to run and complete. When you are done with that, run

$ jupyter notebook

It then pops up a browser window.

Click on the new button to create a new notebook and select python3.

Congrats , you have Jupyter notebook up and running on your mobile.

Wishing you a happy new year🥳 and also a productive 2022.
I'll definitely be creating contents around machine learning and AI this year.