Forem: Khan Areeb Khalid

Extract YouTube Playlist Links Instantly: Open-Source Tool Built with Next.js 14

Khan Areeb Khalid — Tue, 02 Dec 2025 10:29:02 +0000

I recently built the YouTube Playlist Video Extractor—a modern web application that lets you extract all video links and metadata from any public YouTube playlist or video with just a few clicks. If you’ve ever struggled with copying individual YouTube video links for notes, research, or content curation, this tool is designed to streamline your workflow.

Why I Built It

As a student and developer, I often found myself opening dozens of videos from NPTEL and other educational playlists just to copy their links. This repetitive process was tedious and time-consuming. So, I created this open-source tool to solve that problem—now you can extract all video links, titles, thumbnails, and metadata in one go, with options to copy or export data for your notes or research.

Key Features

Playlist & Video Extraction: Extract all video URLs, titles, thumbnails, and metadata from YouTube playlists or individual videos.
Bulk Operations: Copy all links, titles, or combined data with a single click.
CSV Export: Export playlist data to CSV for external use.
Real-time Loading: Progressive video loading with live progress indicators.
Dual View Modes:
- Paginated View: Navigate videos page by page (5, 10, 15, 20, 30, or 50 videos per page).
- Real-time Stream: Load all videos progressively in one continuous view.
Responsive Design: Modern Tailwind CSS interface optimized for desktop and mobile.
Interactive UI: Toast notifications, loading spinners, and visual feedback.
Concurrent Processing: Parallel video fetching for improved performance.
Smart Caching: 1-hour cache for video metadata to reduce API calls.
Error Handling: Graceful handling of private, deleted, or unavailable videos.
TypeScript: Full type safety throughout the application.

Tech Stack

Frontend: React 18+ with Next.js 14 (App Router)
Backend: Next.js API Routes (serverless functions)
Database: MongoDB (for link history storage)
YouTube Integration: YouTube Data API v3 + ytdl-core
Styling: Tailwind CSS
Language: TypeScript
Caching: In-memory caching with Redis support

Quick Start

Clone the Repository

   git clone https://github.com/curiousbud/YouTube-Playlist-videos-link-Extractor.git
   cd YouTube-Playlist-videos-link-Extractor

Install Dependencies

   npm install

Set Up Environment Variables

   cp .env.example .env.local

Add your YouTube API key and MongoDB URI (optional) to .env.local.

Start Development Server

   npm run dev

Access Application Open your browser and navigate to http://localhost:3000.

Usage Guide

Paste a YouTube playlist or video URL.
Choose between paginated or real-time stream view modes.
Extract videos and use bulk copy or CSV export for your needs.

Project Structure

The application uses a clean, modular structure:

app/ for Next.js app directory
components/ for React components
lib/ for utility libraries (MongoDB, YouTube integration)
API endpoints for playlist and video processing

Deployment

Deploy to Vercel, Netlify, Railway, Render, AWS, Google Cloud, or Azure.
Add environment variables and you’re live!

Migration Notes

This project was migrated from Django/Python to the MERN stack, leveraging modern web standards and improved performance. The core functionality remains the same, with a more responsive and scalable architecture.

Contributing

Contributions are welcome! Fork the repository, create a feature branch, and submit a pull request. Follow TypeScript best practices and update documentation for new features.

License

MIT License. Check the LICENSE file for details.

Check out the project on GitHub and give it a star if you find it useful:
🔗 GitHub - YouTube Playlist Video Extractor

Demo Available here: https://youtube-extractor-seven.vercel.app/

🔐 Setting up FoxyProxy with Burp Suite for Web App Security Testing

Khan Areeb Khalid — Wed, 09 Jul 2025 10:43:27 +0000

A Beginner's Guide: Setting Up FoxyProxy with Burp Suite for Web App Testing

Getting started with web application security? One of the most powerful (and beginner-friendly) setups you can use is combining Burp Suite and FoxyProxy. Together, they let you intercept and inspect web traffic—perfect for learning how the internet really works, and how attackers find vulnerabilities.

💻 What is Burp Suite?

Burp Suite is a toolkit used by ethical hackers and security researchers to:

Intercept and inspect browser traffic
Find security bugs like broken authentication or misconfigurations
Modify requests and responses on the fly

🔧 Key Tools Inside Burp Suite:

Proxy – Captures browser traffic
Scanner – Finds vulnerabilities automatically (Pro version)
Intruder – Runs brute-force or fuzzing attacks
Repeater – Lets you tweak and resend requests
Decoder & Comparer – Help you read encoded data and see changes 💡 Think of Burp Suite like a magnifying glass for your web browser.

🦊 What is FoxyProxy?

FoxyProxy is a browser extension for Firefox/Chrome. It helps you quickly switch between proxy settings—especially useful when routing your browser through Burp Suite.

Why use it?

Avoid manual proxy setup every time
Route only certain traffic through Burp
Enable/disable with one click

⚙️ Step-by-Step Setup

Configure Burp Suite

Open Burp Suite
Go to Proxy > Options
Ensure it's listening on 127.0.0.1:8080 (default)

Install and Set Up FoxyProxy

Add FoxyProxy Standard extension to your browser
Open the add-on settings
Click Add New Proxy
Title: Burp Suite Proxy
Proxy Type: HTTP
Host: 127.0.0.1
Port: 8080

Connect the Tools

In FoxyProxy, enable the profile you just created
In Burp Suite, go to the Intercept tab and turn interception "on"
Now, open any website—and you'll see the request paused in Burp

🧪 Test It with a Vulnerable App: OWASP Juice Shop

Want to practice without legal risk? Use Juice Shop, a purposely insecure web app hosted at:

https://juice-shop.herokuapp.com/#/

Quick Tips:

Add Juice Shop to Burp's scope under the Target tab
Enable the AND operator in the intercept settings—this ensures only in-scope traffic is captured
Visit /score-board on Juice Shop to view available hacking challenges

🔐 Important: Handle HTTPS Correctly

To intercept secure (HTTPS) traffic:
Go to Burp’s Proxy > Intercept > Open Browser OR
Import Burp's CA certificate into your browser under Authorities

Without this, your browser won’t trust Burp to decrypt HTTPS—and traffic won’t be visible.

✅ Wrap-Up

With Burp Suite and FoxyProxy, you're not just observing—you’re interacting with the flow of web traffic. That’s the foundation of web app security testing.

Whether you're a cybersecurity student or just curious about how requests and responses really work, this setup is your gateway.

Nerva - Opensource Script Repository with Modern Web Interface | Looking for Contributors!

Khan Areeb Khalid — Sat, 28 Jun 2025 10:15:21 +0000

Hey r/opensource! 👋

I'm excited to share Nerva, an open-source repository of useful automation scripts and tools that I've been working on. It's designed to be a community-driven collection of practical scripts across multiple programming languages.

🌟 What is Nerva?

Nerva is a curated collection of automation scripts, utilities, and tools designed to solve common development and system administration tasks. Each script is thoroughly documented, tested, and comes with clear usage instructions.

🔗 Repository: https://github.com/your-username/Nerva

🌐 Website: https://curioussbud.github.io/Nerva

📊 Current Stats

14 scripts across 4 programming languages
Python, JavaScript, PowerShell, and Bash support
Modern web interface with dark/light theme
Comprehensive documentation for each script

🛠️ Featured Scripts Include:

🖥️ System Information Gatherer - Comprehensive system diagnostics tool
🗂️ Advanced File Organizer - Smart file organization with multiple modes
🛡️ SHADOW Vulnerability Scanner - Template-based security scanning
⚡ GitHub Label Automation - Automated GitHub repository setup
🔍 Duplicate File Finder - Efficient duplicate detection and management
🌐 URL Status Checker - Bulk website monitoring tool
📧 Email Automation - Bulk email sending with templates

🎯 What Makes Nerva Special?

Multi-language support: Scripts in Python, JavaScript, PowerShell, and Bash
Beautiful web interface: Modern, responsive design with theme support
Detailed documentation: Each script has comprehensive READMEs with usage examples
Easy contribution: Simple process for adding new scripts
Cross-platform: Scripts designed to work across Windows, macOS, and Linux

🤝 Looking for Contributors!

I'm actively seeking contributors to help expand this collection. Whether you're a beginner or experienced developer, there are many ways to contribute:

🌟 How You Can Help:

Add new scripts in any supported language
Improve existing scripts with new features or optimizations
Add support for new languages (Go, Rust, PHP, etc.)
Improve documentation and add more usage examples
Report bugs or suggest improvements
Design improvements for the web interface

🚀 Getting Started:

Fork the repository
Check out our Contributing Guidelines
Browse our open issues for ideas
Submit a pull request!

We have a welcoming community and comprehensive contribution guidelines to help new contributors get started quickly.

📝 Current Focus Areas:

Database scripts (SQL utilities, migrations, etc.)
DevOps automation (CI/CD helpers, deployment scripts)
Data processing (CSV/JSON utilities, data transformation)
Security tools (auditing, scanning, hardening)
Web scraping (API clients, data extraction)

🏆 Why Contribute?

Learn new technologies and programming languages
Build your open source portfolio with meaningful contributions
Help the developer community with practical, reusable tools
Collaborate with other developers on useful projects
Recognition - All contributors are credited in our documentation

📋 Tech Stack:

Frontend: Next.js, TypeScript, Tailwind CSS
Scripts: Python, JavaScript/Node.js, PowerShell, Bash
Deployment: GitHub Pages with static export
Tools: GitHub Actions for CI/CD

The project follows modern development practices with comprehensive testing, linting, and automated builds.

🎉 Recent Updates:

Added theme-aware loading and error pages
Implemented multi-layer caching for better performance
Added semantic versioning and automated release workflow
Enhanced featured scripts section with better diversity
Improved mobile responsiveness and accessibility

Ready to contribute? Check out our repository and join our growing community of developers building useful tools together!

Tags: #automation #scripts #python #javascript #powershell #bash #opensource #tools #utilities #webdev #nextjs

Building an Automated Script Management System That Makes Open Source Contributions Effortless

Khan Areeb Khalid — Thu, 26 Jun 2025 16:29:03 +0000

Building an Automated Script Management System That Makes Open Source Contributions Effortless

Have you ever wanted to contribute to an open-source project but got overwhelmed by the complexity of updating websites, documentation, and maintaining consistency across hundreds of scripts?

What if I told you there's now a way to contribute that's as simple as writing a script and running one command?

🚀 Meet Nerva: The Future of Script Repositories

Nerva is a curated collection of practical automation scripts across multiple programming languages. But here's what makes it revolutionary: we've built an automated Script Manager that completely eliminates manual website maintenance.

🤖 The Problem We Solved

Traditional open-source script repositories suffer from:

❌ Manual website updates - Contributors need to edit HTML/React components
❌ Inconsistent documentation - No standardized format across scripts
❌ Broken builds - One wrong edit can break the entire website
❌ High barrier to entry - Need to understand the website codebase
❌ Maintenance overhead - Project maintainers spend more time on website than code

✨ Our Solution: The Magic Workflow

# 1. Write your script + README
mkdir scripts/python/my-awesome-tool
echo "# My Awesome Tool..." > scripts/python/my-awesome-tool/README.md

# 2. Run ONE command
python script_manager.py build

# 3. Your script appears on website with beautiful 3D cards! 🎨

That's it. No website knowledge required. No complex setup. No breaking things.

🛠️ How It Works: The Technical Magic

1. Smart README Parsing

Our Script Manager intelligently parses README files to extract:

Script title and description
Features list (even with emojis! 🎉)
Requirements and dependencies
Usage examples and code blocks

def extract_script_metadata(self, script_dir: Path) -> Dict[str, Any]:
    """Extract metadata from a script directory"""
    readme_path = script_dir / "README.md"

    # Parse README for features, requirements, usage
    lines = content.split('\n')
    current_section = None

    for line in lines:
        # Handle emojis in section headers like "## ✨ Features"
        if line.startswith('## '):
            section_title = re.sub(r'[^\w\s]', '', line[3:]).strip().lower()
            if 'feature' in section_title:
                current_section = 'features'
        elif current_section == 'features' and line.startswith('- '):
            metadata['features'].append(line[2:].strip())

2. Featured Scripts System

We implemented a curation system that automatically highlights the most important scripts:

# Mark important scripts as featured automatically
important_scripts = ['script-manager', 'vulnerability-scanner', 'ftp-scanner']
if metadata['name'] in important_scripts:
    metadata['featured'] = True

3. Website Integration

The Script Manager generates a scripts.json file that powers our Next.js website:

{
  "totalScripts": 9,
  "featured": [
    {
      "name": "script-manager",
      "display_name": "🤖 Script Registry Management Tool",
      "description": "An automated tool for managing and organizing scripts...",
      "features": [...],
      "language": "python"
    }
  ],
  "languages": {...}
}

🎨 The Beautiful Result

The website automatically generates 3D animated cards for each script with:

Dynamic content extracted from your README
Search and filtering capabilities
Consistent theming across all scripts
Responsive design that works everywhere

🌟 Current Script Collection

Our system already manages 9+ scripts including:

🤖 Script Manager - The heart of the system
🔒 FTP Scanner - Security testing tool
🛡️ Vulnerability Scanner - Web security analysis
📁 File Organizer - Smart file management with date/type sorting
📧 Email Automation - Automated email workflows
🔐 Password Generator - Secure password creation
📶 WiFi Monitor - Network connectivity diagnostics

🚀 What Makes This Special

For Contributors:

Zero website coding knowledge needed
Write once, appears everywhere - README becomes website content
Automatic quality assurance - Consistent formatting guaranteed
Focus on what matters - Your awesome scripts, not website maintenance

For Project Maintainers:

Self-documenting system - The Script Manager manages itself!
Scalable architecture - Handle hundreds of scripts effortlessly
Quality control - Automatic validation and error handling
Beautiful presentation - Professional website without manual work

For Users:

Curated content - Featured scripts highlight the best tools
Easy discovery - Search and filter through all scripts
Consistent documentation - Every script follows the same format
Ready-to-use - Clear usage examples and requirements

🔧 Technical Implementation Highlights

Smart Parsing Algorithm

# Handle complex README structures
elif current_section == 'requirements':
    if line_stripped.startswith('- '):
        req = line_stripped[2:].strip()
        if '`' in req:
            # Extract package names from backticks
            package_match = re.search(r'`([^`]+)`', req)
            if package_match:
                package = package_match.group(1)
                req = f"{package} - {desc_part[1]}" if desc_part else package
        metadata['requirements'].append(req)

TypeScript Integration

interface Script {
  name: string
  path: string
  description: string
  features: string[]
  requirements: string[]
  featured?: boolean
  language?: string
}

Automated Website Generation

def generate_website_data(self, registry: Dict[str, List[Dict[str, Any]]]):
    """Generate data file for website consumption"""
    website_data = {
        "totalScripts": sum(len(scripts) for scripts in registry.values()),
        "featured": [],
        "languages": {}
    }

    # Collect featured scripts automatically
    for lang, scripts in registry.items():
        for script in scripts:
            if script.get('featured', False):
                website_data["featured"].append({**script, "language": lang})

🎯 The Impact

This system has transformed how we think about open-source contribution:

Lowered the barrier to entry - Anyone can contribute now
Increased contribution quality - Standardized documentation
Eliminated maintenance overhead - Self-managing system
Enhanced user experience - Beautiful, searchable interface
Showcased important tools - Script Manager gets deserved prominence

🔮 Future Vision

This is just the beginning. Imagine:

AI-powered script discovery - Intelligent recommendations
Automatic testing integration - Scripts validated before deployment
Community ratings - Crowd-sourced script quality metrics
Cross-language templates - Unified experience across all languages
Plugin ecosystem - Extensible Script Manager architecture

🤝 Try It Yourself

Want to contribute to Nerva or implement a similar system?

Check out the repository: github.com/curiousbud/Nerva
Read the Script Manager guide: Complete beginner-friendly documentation at scripts/python/script-manager/
Contribute a script: Write a README, run the command, see the magic!

The Script Manager itself is fully documented and serves as a perfect example of the system in action.

💡 Key Takeaways

Building automated systems for open-source projects can:

Dramatically reduce contribution friction
Ensure consistent quality and presentation
Scale effortlessly as projects grow
Free maintainers to focus on what matters
Create better experiences for everyone

The future of open-source is automated, accessible, and beautiful.

What automation challenges are you facing in your projects? Have you built similar systems? Let's discuss in the comments!

Follow me for more insights on open-source automation and innovative development practices. 🚀

Tags: #OpenSource #Automation #Python #JavaScript #WebDevelopment #DevTools #ScriptManagement #Innovation

Introducing Nerva: Your Universal Script Repository

Khan Areeb Khalid — Thu, 26 Jun 2025 14:27:22 +0000

⚡ Nerva: Your Universal Script Arsenal

Tired of rewriting the same utility scripts for every project? Meet Nerva – an open-source collection of production-ready scripts for automation, security testing, networking, and more!

🌟 Why Nerva?

As developers and security professionals, we constantly rebuild solutions for common tasks. Nerva eliminates this redundancy by providing:

Multi-language arsenal (Python, JavaScript, Bash, PowerShell)
Production-ready scripts with comprehensive documentation
Security-focused tools for penetration testing and reconnaissance
Community-driven excellence
Zero setup – clone and execute immediately
Perfect for learning advanced scripting techniques

🚀 Quick Start (30 seconds)

git clone https://github.com/curiousbud/Nerva.git
cd Nerva/scripts/python/ftp-scanner
python ftp-scanner.py -t example.com

🔥 Current Script Arsenal

Category	Tool	Language	Use Case
Security	FTP Scanner	Python	Anonymous FTP detection
Security	SHADOW Scanner	Python	Web vulnerability scanning
Networking	URL Status Checker	Python	Bulk URL health monitoring
Automation	Coming Soon	JS/Bash	CI/CD & DevOps utilities

💡 Real-World Security Example

Problem: Need to quickly assess FTP security across multiple hosts?

Solution: Use Nerva's FTP Scanner:

# Multi-threaded anonymous FTP scanning
python ftp-scanner.py -f targets.txt -t 10 -o vulnerable_hosts.txt

# Sample output:
# ✓ 192.168.1.100:21 - Anonymous login SUCCESS (47 files)
# ✗ 192.168.1.101:21 - Connection timeout
# ✓ ftp.example.com:21 - Anonymous login SUCCESS (12 files)

Perfect for security assessments and network reconnaissance!

🛡️ Advanced Features You'll Love

Template-based vulnerability scanning with YAML configs
Async HTTP requests for maximum performance
Comprehensive error handling and detailed logging
Multiple output formats (JSON, CSV, text reports)
Concurrent processing for large-scale operations

🤝 Join the Nerva Community

We're building something special and need your expertise:

Add your scripts to expand our arsenal
Improve existing tools with new features
Share use cases and optimization tips
Test in real environments and report findings

# Contribution workflow:
fork https://github.com/curiousbud/Nerva.git
git checkout -b feature/your-awesome-script
git commit -m "feat: add network-discovery-tool"
git push origin feature/your-awesome-script
# Open PR and make an impact!

🌈 The Bigger Picture

"The best tools are those that empower others to build even better solutions."

Nerva isn't just about scripts – it's about:

Democratizing security tools for everyone
Accelerating incident response with ready-made utilities
Teaching advanced techniques through real-world examples
Building a knowledge base for the community

🎯 What's Next?

We're actively developing:

PowerShell modules for Windows environments
JavaScript automation tools for modern web workflows
Bash utilities for Linux system administration
Advanced payload generators for security testing

Ready to supercharge your toolkit?

⭐ Star Nerva on GitHub: https://github.com/curiousbud/Nerva

💬 What security/automation challenges do you face daily?

🛠️ Which scripts would transform your workflow?

#cybersecurity #automation #opensource #python #devtools #scripting