Skip to content

A dataset of PC parts scraped from PCPartPicker

License

Notifications You must be signed in to change notification settings

burakdmir/pc-part-dataset

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PC Part Dataset

A dataset of PC parts scraped from PCPartPicker.

Part count: 45,424

Last updated: July 11, 2021

Download

All of the data is located in the data folder. If you want to download a specific category, it will be located in the data/raw directory. Otherwise, download data/all.zip if you want everything.

Running the Scraper

EXTREMELY IMPORTANT NOTE: Use a proxy/VPN when running the scraper!

  1. Copy/fork the project to your local machine
  2. If you don't have pipenv installed, run pip install pipenv
  3. cd <project location>
  4. pipenv install
  5. pipenv run python scripts/scrape.py

If you want to zip everything, run pipenv run python scripts/zip.py

Contents

  • General
    • CPUs
    • CPU Coolers
    • Motherboards
    • Memory
    • Storage
    • Video Cards
    • Cases
    • Power Supplies
    • Optical Drives
    • Operating Systems
    • Software
    • Monitors
    • External Storage
    • Laptops
  • Accessories / Other
    • Case Accessories
    • Case Fans
    • Fan Controllers
    • Thermal Compound
    • UPS Systems
  • Expansion Cards / Networking
    • Sound Cards
    • Wired Network Adapters
    • Wireless Network Adapters
  • Peripherals
    • Headphones
    • Keyboards
    • Mice
    • Speakers
    • Webcams

License

MIT

About

A dataset of PC parts scraped from PCPartPicker

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%