gospider
GoSpider is a fast web crawler that parses sitemap.xml and robots.txt file. It can generate and verify link from JavaScript files, extract URLs from various sources and can detect subdomains from the response source.
- Name
- gospider
- Main Program
gospider- Programs
gospider
- Homepage
- Version
- 1.1.6
- License
- Maintainers
- Platforms
- x86_64-darwin
- aarch64-darwin
- aarch64-linux
- armv5tel-linux
- armv6l-linux
- armv7a-linux
- armv7l-linux
- i686-linux
- loongarch64-linux
- m68k-linux
- microblaze-linux
- microblazeel-linux
- mips-linux
- mips64-linux
- mips64el-linux
- mipsel-linux
- powerpc-linux
- powerpc64-linux
- powerpc64le-linux
- riscv32-linux
- riscv64-linux
- s390-linux
- s390x-linux
- x86_64-linux
- wasm64-wasi
- wasm32-wasi
- i686-freebsd
- x86_64-freebsd
- aarch64-freebsd
- Defined
- Source