SpiderFoot

Automate your OSINT investigations with more than 200 built-in data sources

200+
OSINT modules
Web GUI
Intuitive interface
Auto
Automated collection

🕷️ What is SpiderFoot?

SpiderFoot is an open source OSINT automation tool that streamlines information gathering. It automates searching for information about targets across many open sources.

200+ Sources

Built-in modules for many APIs and databases

Web interface

Intuitive GUI for configuration and visualization

Open Source

Free code and an active community

Key features

Discover SpiderFoot's advanced capabilities for your OSINT investigations

Full automation

Automatic information gathering from more than 200 sources

Intuitive web interface

A simple graphical interface to configure and manage scans

Extensible modules

More than 200 specialized modules for different data types

Advanced visualization

Graphs and reports to analyze relationships between data

Multiple exports

Export results to CSV, JSON, GraphML, PDF

Open Source

Open source code and an active community

Installation

Several installation methods to suit your environment

With apt (Kali Linux)

sudo apt install spiderfoot

Package maintained in the Kali repositories; then run spiderfoot -l 127.0.0.1:5001

Docker container

docker build -t spiderfoot . && docker run -p 5001:5001 spiderfoot

Builds the image from the repository Dockerfile, then runs it

From source

git clone https://github.com/smicallef/spiderfoot.git

For development and customization

📋 System requirements

Minimum requirements

  • • Python 3.6 or later
  • • 2 GB RAM minimum
  • • 1 GB of disk space

Recommended

  • • Python 3.9+
  • • 4 GB RAM or more
  • • SSD for better performance

Scan types

Choose the scan type that fits your investigation goals

Footprint

Infrastructure and attack surface discovery

Included modules:

DNS LookupWhois InformationSubdomain DiscoveryPort Scanning

Investigate

Search for detailed information on a target

Included modules:

Email SearchSocial MediaCompany InformationEmployee Data

Passive

Passive collection with no direct interaction

Included modules:

Public RecordsHistorical DataArchive SearchPassive DNS

Correlate

Correlate and analyze the collected data

Included modules:

Data CorrelationRelationship AnalysisPattern RecognitionAnomaly Detection

Quick start

Run your first investigation in a few simple steps

1

Launch the interface

python3 sf.py -l 127.0.0.1:5001

Then open http://127.0.0.1:5001 in your browser

2

Configure the scan

  • • Select the appropriate scan type
  • • Enter your target (domain, IP, email, etc.)
  • • Choose which modules to enable
  • • Configure advanced settings if needed
3

Analyzing the results

  • • View the data in the web interface
  • • Use filters to refine the results
  • • Export the important data
  • • Generate detailed reports

Best practices

API configuration

  • • Configure API keys to improve data quality
  • • Respect third-party API rate limits
  • • Use proxies for sensitive requests
  • • Test modules before important scans

Security and discretion

  • • Use a VPN to hide your origin
  • • Add delays between requests
  • • Avoid aggressive scans on sensitive targets
  • • Document your activity for traceability

Analysis and documentation

  • • Export your important data regularly
  • • Use several export formats for different needs
  • • Correlate the data with other sources
  • • Keep a log of your investigations

⚠️ Legal and ethical considerations

  • • Respect the terms of use of APIs and services
  • • Check that your investigations are legal in your jurisdiction
  • • Get the necessary authorization before scanning systems
  • • Protect personal data in line with GDPR
  • • Use information responsibly and ethically

Useful resources

📚 Documentation and guides

  • • Official documentation - Complete user guide
  • • Wiki GitHub - Tutorials and examples
  • • Module Development Guide - Build custom modules
  • • API Reference - Technical documentation

🌐 Community and support

  • • GitHub Repository - Source code and issues
  • • Discord OSINT - User community
  • • Twitter @spiderfoot - News and updates
  • • Reddit r/OSINT - Discussions and shared experience

Ready to automate your investigations?

Install SpiderFoot and start collecting OSINT information automatically and efficiently.

CyberXTEL
100% Free

Ready to put it into practice?

CyberXTEL is our free platform to train hands-on: certifications, CTFs and a dedicated cyber awareness space.

Discover CyberXTEL