MetaSpidey v3.0.0

MetaSpidey v3.0.0 Release Notes

Release Date: November 21, 2024
Version: 3.0.0
Status: Stable Release

Major Changes in v3.0.0

New GUI Interface

• Complete redesign from command-line to graphical user interface
• Four main tabs: Crawling, Brute Force, Downloads, and Metadata
• Real-time progress monitoring and status updates
• User-friendly file selection dialogs

Crawling Features

• Adjustable crawling depth settings
• Configurable request delay options
• Custom file type filtering
• Improved URL discovery algorithms
• Real-time crawling status display

Brute Force Improvements

• Interactive dictionary file selection
• Progress tracking visualization
• Pause/Resume functionality
• Custom directory wordlist support

Download Management

• Bulk file download capability
• Organized output directory structure
• Download progress monitoring
• Automatic file type detection

Metadata Analysis

• Enhanced ExifTool integration
• Batch metadata extraction
• Multiple export format options (TXT/HTML)
• Detailed metadata visualization

Technical Details

System Requirements

• Python 3.8+
• Qt6
• Modern Linux distribution (Ubuntu 22.04+, Fedora 38+, or equivalent)
• 2GB RAM minimum
• 500MB free disk space

Dependencies

PyQt6
requests
beautifulsoup4
python-magic
Pillow
python-docx
PyPDF2

Known Issues

• Large PDF files (>100MB) may slow down metadata extraction
• Some HTTPS sites may require manual certificate verification
• Certain dynamic websites might not be fully crawled

Upgrade Instructions

Fresh Installation

1. Clone the repository
2. Run install_dependencies.sh
3. Launch MetaSpidey

Deprecation Notices

• Command-line interface removed
• Legacy config format deprecated
• Old metadata export format no longer supported

Future Plans

• Web interface integration
• Database storage option
• API endpoint support
• Extended file format support
• Cloud storage integration

Contributors

• pr0ff3

License

GNU General Public License v3.0

Tags

#MetaSpidey #WebCrawler #MetadataExtraction #SecurityTools #Python #GUI

v2.0 Python Version

Improved parameters, more options, better HTML export, brute force and passive functions as well as file download

Full Changelog: Releases...v2.0

1.0 Bash version

Simple bash script version

Full Changelog: https://github.com/sPROFFEs/MetaSpidey/commits/v1.0