MetaSpidey v3.0.0 Release Notes
Release Date: November 21, 2024
Version: 3.0.0
Status: Stable Release
Major Changes in v3.0.0
New GUI Interface
- Complete redesign from command-line to graphical user interface
- Four main tabs: Crawling, Brute Force, Downloads, and Metadata
- Real-time progress monitoring and status updates
- User-friendly file selection dialogs
Crawling Features
- Adjustable crawling depth settings
- Configurable request delay options
- Custom file type filtering
- Improved URL discovery algorithms
- Real-time crawling status display
Brute Force Improvements
- Interactive dictionary file selection
- Progress tracking visualization
- Pause/Resume functionality
- Custom directory wordlist support
Download Management
- Bulk file download capability
- Organized output directory structure
- Download progress monitoring
- Automatic file type detection
Metadata Analysis
- Enhanced ExifTool integration
- Batch metadata extraction
- Multiple export format options (TXT/HTML)
- Detailed metadata visualization
Technical Details
System Requirements
- Python 3.8+
- Qt6
- Modern Linux distribution (Ubuntu 22.04+, Fedora 38+, or equivalent)
- 2GB RAM minimum
- 500MB free disk space
Dependencies
PyQt6
requests
beautifulsoup4
python-magic
Pillow
python-docx
PyPDF2
Known Issues
- Large PDF files (>100MB) may slow down metadata extraction
- Some HTTPS sites may require manual certificate verification
- Certain dynamic websites might not be fully crawled
Upgrade Instructions
Fresh Installation
- Clone the repository
- Run
install_dependencies.sh - Launch MetaSpidey
Deprecation Notices
- Command-line interface removed
- Legacy config format deprecated
- Old metadata export format no longer supported
Future Plans
- Web interface integration
- Database storage option
- API endpoint support
- Extended file format support
- Cloud storage integration
Contributors
- pr0ff3
License
GNU General Public License v3.0
Tags
#MetaSpidey #WebCrawler #MetadataExtraction #SecurityTools #Python #GUI