Archive Team

All

692 repositories

askfm-grab
Public
Archiving ASKfm.
Lua
•
The Unlicense
•0•0•0•0•Updated Nov 14, 2024Nov 14, 2024
cohost-grab
Public
Archiving cohost.org
Lua
•
Other
•1•0•0•0•Updated Nov 13, 2024Nov 13, 2024
veoh-items
Public
Managing items for veoh-grab.
Python
•0•0•0•0•Updated Nov 11, 2024Nov 11, 2024
veoh-grab
Public
Archiving veoh.com.
Lua
•
The Unlicense
•0•0•0•0•Updated Nov 10, 2024Nov 10, 2024
mangaz-grab
Public
Archiving Manga Z
Lua
•
The Unlicense
•0•0•0•0•Updated Nov 9, 2024Nov 9, 2024
terroroftinytown
Public
URLTeam's second generation of URL shortener archiving tools
Python
•
MIT License
•15•71•17•0•Updated Nov 7, 2024Nov 7, 2024
askfm-items
Public
Managing items for askfm-grab.
0•0•0•0•Updated Nov 7, 2024Nov 7, 2024
mangaz-items
Public
Managing items for mangaz-grab
0•0•0•0•Updated Nov 7, 2024Nov 7, 2024
urls-grab
Public
Archiving URLs (outlinks) from a variety of sources.
Lua
•
The Unlicense
•5•17•3•0•Updated Nov 7, 2024Nov 7, 2024
urls-sources
Public
Sources for urls-grab.
Python
•8•8•14•2•Updated Nov 3, 2024Nov 3, 2024
cohost-items
Public
Managing items for cohost-grab
1•0•0•0•Updated Nov 1, 2024Nov 1, 2024
goo-gl-items
Public
Managing items for goo-gl-grab.
0•1•0•0•Updated Oct 21, 2024Oct 21, 2024
goo-gl-grab
Public
Archiving goo.gl, the Google URL Shortener.
0•0•0•0•Updated Oct 21, 2024Oct 21, 2024
curiouscat-items
Public
Managing items for curiouscat-grab.
1•0•0•0•Updated Oct 11, 2024Oct 11, 2024
curiouscat-grab
Public
Archiving CuriousCat
Lua
•
Other
•1•0•0•0•Updated Oct 7, 2024Oct 7, 2024
ArchiveBot
Public
ArchiveBot, an IRC bot for archiving websites
javascript irc archiving haxe ruby python
Python
•
MIT License
•71•359•139•35•Updated Sep 23, 2024Sep 23, 2024
nhentai-grab
Public
Archiving nhentai
Lua
•
The Unlicense
•0•1•1•0•Updated Sep 18, 2024Sep 18, 2024
mildom-grab
Public
Archiving Mildom.
Lua
•
The Unlicense
•0•0•0•0•Updated Sep 14, 2024Sep 14, 2024
telegram-grab
Public
Archiving public telegram messages.
Lua
•
The Unlicense
•9•12•5•0•Updated Sep 14, 2024Sep 14, 2024
nhentai-items
Public
Managing items for nhentai-grab
Python
•0•0•0•0•Updated Sep 13, 2024Sep 13, 2024
warrior4-vm
Public
Warrior virtual machine appliance (version 4)
Rust
•
MIT License
•1•21•3•0•Updated Sep 7, 2024Sep 7, 2024
warrior-hq
Public
Warrior HQ API
HTML
•0•1•3•0•Updated Aug 31, 2024Aug 31, 2024
mildom-items
Public
Managing items for mildom-grab.
0•0•0•0•Updated Aug 28, 2024Aug 28, 2024
wget-lua
Public
Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.
crawler scraper downloader spider lua ftp scraping crawling archiving wget
C
•
GNU General Public License v3.0
•15•101•12•1•Updated Aug 19, 2024Aug 19, 2024
terroroftinytown-client-grab
Public
The Seesaw pipeline grab script for the URLTeam (terroroftinytown) project
Python
•
The Unlicense
•11•27•3•0•Updated Aug 14, 2024Aug 14, 2024
youtube-grab
Public
Archiving all metadata from YouTube (everything except videos themselves due to size)
Lua
•
The Unlicense
•2•23•6•2•Updated Aug 12, 2024Aug 12, 2024
ludios_wpull
Public
wpull fork with fixes and faster parsing using html5-parser; used by grab-site; should go away when wpull is similarly improved
HTML
•
GNU General Public License v3.0
•5•26•11•0•Updated Jul 7, 2024Jul 7, 2024
grab-site
Public
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
crawler spider archiving crawl warc
Python
•
Other
•135•1.4k•79•14•Updated Jul 7, 2024Jul 7, 2024
priimage-items
Public
Managing items for priimage-grab.
Python
•0•0•0•0•Updated Jun 26, 2024Jun 26, 2024
picdig-items
Public
Managing items for picdig-grab.
Python
•0•0•0•0•Updated Jun 26, 2024Jun 26, 2024