Skip to content

Latest commit

 

History

History
146 lines (101 loc) · 9.16 KB

README.md

File metadata and controls

146 lines (101 loc) · 9.16 KB

Search Engines

Cyber search engines are a beautiful set of tools that allow us to do research on specific targets as they relate to cybersecurity. Searching by IP, domain, vulnerability, etc. allows us to perform tasks ranging from passive recon as part of a penetration test, to threat intelligence research. Search.html - Your OSINT starting place.

When initiating a search on anything, the first stop is a bit of HTML whipped up by OSINT master Michael Bazzell. This handy tool allows an easy search of multiple sources with one click. I prefer this to other others as it allows me to manually parse the search page and go down rabbit holes from there.

Included Search Engines: Google, Google Date, Bing, Yahoo, Searx, Yandex, Baidu, Exalead, Duckduckgo, Startpage, Newsgroups, Blogs, FTP Servers, Indexes, Scholars, Patents, Qwant, News, Wayback, and Ahmia. Google is the most powerful and scary information gathering tool today. Beyond searching for basic keywords, adding in advanced commands can refine your results and reveal incredible amounts of information about your target.

These are by no means exhaustive, but they are a handy place to start.

{% file src="../../../.gitbook/assets/Search (1).html" %}

Google

Google is the most powerful and scary information gathering tool today. Beyond searching for basic keywords, adding in advanced commands can refine your results and reveal incredible amounts of information about your target.

Google search utility
  • Google Advanced Search - Google search with multiple special options for your search parameters
  • Keyword Tool - Tool for assisting in analyzing the efficacy of searching for certain keywords
  • Google keyword monitor - An awesome tool that can alert you on new search hits on certain keywords.
  • ISearchFrom - Tool that allows you to search google as if you are in different locations to analyze the differences in results.

{% tabs %} {% tab title="Google search commands (Dorks)" %}

{% content-ref url="google-dorking-cheatsheet.md" %} google-dorking-cheatsheet.md {% endcontent-ref %} {% endtab %}

{% tab title="Google Dorking Tools" %}

{% tab title="Pagodo" %} pagodo - pagodo (Passive Google Dork) - Automate Google Hacking Database scraping and searching

##Install
git clone https://github.com/opsdisk/pagodo.git
cd pagodo
virtualenv -p python3.7 .venv           #If using a virtual environment.
source .venv/bin/activate               #If using a virtual environment.
pip install -r requirements.txt

##Get Latest GHDB
python ghdb_scraper.py -s -j -i

##Run All Dorks
python pagodo.py -d example.com -g dorks/all_google_dorks.txt

{% endtab %} {% endtabs %}

{% embed url="https://youtu.be/cFOBUYaxdWI" %}

Utility Search Engines

Archived Page Search Engines

Sometimes the page you are trying to find is no longer available. But it still may exist in web archives or cached data. Be sure to check these when you are getting stuck.

  • https://cipher387.github.io/quickcacheandarchivesearch/ - An awesome tool that lets you search for older versions of websites via search engines and various web archive services.
    • Wayback Machine - The gold standard web archive. if you are looking for a version of a web page at a specific place and time, check this!
    • https://archive.ph - A time capsule for web pages!
    • https://www.webcitation.org (Depreciated) - WebCite is an on-demand archive site, designed to digitally preserve scientific and educationally important material on the web by making snapshots of Internet contents as they existed at the time when a blogger, or a scholar cited or quoted from it.
  • gau - Get All URLs - Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl.
Privacy Focused Search Engines
Metasearch Engines
  • https://www.faganfinder.com/ - One of the best metasearch tools there is. Allows you to search through search engines, social media, encyclopedias, libraries, news, government, documents and much more.
  • https://www.exalead.com/search/web/ - A high-end data discovery and search platform that powers search, data collection, and indexing among all technology solutions.
  • https://all-io.net/ - A metasearch engine that combines all major search engines into one. They also allow you to create, configure and customize your own engine.
Misc Search Engines and Utilities

This section contains miscellaneous search engines and utilities.

Training