This project is a Python script to download a website to a local directory. It utilizes Tor for anonymous browsing and focuses on downloading specific file types and updating local links.
- Downloads various file types including
.svg,.jpg,.jpeg,.png,.gif,.ico,.css,.js,.html,.php,.json,.ttf,.otf,.woff2,.woff,.eot,.mp4, and.ogg. - Scans specific file types for additional links to download.
- Uses Tor for anonymous browsing.
- Maintains a global URL map to correctly resolve relative paths in downloaded files.
- Python 3.x
requestslibrarytor(Tor must be running on your machine)socks5hproxy
-
Clone the repository:
git clone https://github.com/yourusername/website-cloner.git cd website-cloner -
Install the required Python libraries:
pip install requests
-
Ensure that Tor is running on your machine:
tor
To clone a website to a local directory, run:
python main.py <URL> <LOCAL_DIRECTORY>