Github GitHub - lc/gau: Fetch known URLs from AlienVault's Open Threat Exchange,...
source link: https://github.com/lc/gau
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
getallurls (gau)
getallurls (gau) fetches known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl for any given domain. Inspired by Tomnomnom's waybackurls.
Resources
Usage:
Examples:
$ printf example.com | gau $ cat domains.txt | gau -t 5 $ gau example.com $ gau -o example-urls.txt example.com $ gau -b png,jpg,gif example.com
To display the help for the tool use the -h
flag:
$ gau -h
-providers
providers to fetch urls from (by default, all are used)
gau -providers wayback,otx,commoncrawl example.com
-b
extensions to skip
gau -b jpg,png,gif example.com
-retries
amount of retries for http client
gau -retries 7 example.com
-subs
include subdomains of target domain
gau -subs example.com
-t
number of threads to use
gau -t 5
-p
http proxy to use
gau -p http://localhost:8080 example.com
-v
enable verbose mode (show errors)
gau -v
-o
filename to write results to
gau -o urls.txt example.com
-json
write output as json
gau -json example.com
-version
show gau version
gau -version
Installation:
From source:
$ GO111MODULE=on go get -u -v github.com/lc/gau
From binary:
You can download the pre-built binaries from the releases page and then move them into your $PATH.
From Docker:
You can build a docker image with the following command
docker build -t gau .
and then run it
docker run gau example.com
Bear in mind that piping command (echo "example.com" | gau) will not work with the docker container
$ tar xvf gau_1.1.0_linux_amd64.tar.gz $ mv gau /usr/bin/gau
ohmyzsh note:
ohmyzsh's git plugin has an alias which maps gau
to the git add --update
command. This is problematic, causing a binary conflict between this tool "gau" and the zsh plugin alias "gau" (git add --update
). There is currently a few workarounds which can be found in this Github issue.
Useful?
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK