.github | ||
assets | ||
plugins | ||
.gitignore | ||
ca.crt | ||
ca.key | ||
caterpillar.service | ||
cert.key | ||
LICENSE | ||
README.md | ||
requirements.txt | ||
server.py |
gnh1201/caterpillar
Caterpillar - The simple and parasitic web proxy with spam filter (formerly, php-httpproxy)
How it works
Basic structure
You <-> Proxy client (Python) <-> Parasitized proxy server (Optional, PHP) <-> On the Web
For example, build a simple web debugging proxy on the shared servers.
This project supports two modes of connection. The default is stateless. You can use the stateful mode to avoid being constrained by transfer capacity limits (e.g., max_upload_size
).
Spam filtering strategy
- K-Anonymity test - Estimating whether the characters has been arranged by humans. (use Have I Been Pwned)
- Not CAPTCHA - Image spam containing characters that look very similar to CAPTCHA. (use TrueCaptcha)
- VowelRatio10 - In characters arranged by humans, there is a high frequency of vowels (aeiou) and semivowels (wy) and vowel-ending patterns included in strings that are 10 characters.
- Palindrome4 - Detect palindromes composed of 4 or more characters
- KnownWords4 - Detect well-known words composed of 4 or more characters
- SearchEngine3 - In public search engine, the given string yields more than 2 results. (use LibreY)
- RepeatedNumber3 - Detect a repeated numbers 3 times or more.
- SSL decryption (MITM) when relaying to federated servers.
The strategies were implemented to respond to the Fediverse Spam Attacks which started on the 15th of February.
(Optional) Before to use
If you have an will be parasitize server that you want to proxy, you can install the index.php
(assets/php/index.php) file.
How to use
- Write a file
.env
(Linux) orsettings.ini
(Windows). Like this:
[settings]
PORT=5555
SERVER_URL=http://example.org
SERVER_CONNECTION_TYPE=stateless
CA_KEY=ca.key
CA_CERT=ca.crt
CERT_KEY=cert.key
CERT_DIR=certs/
OPENSSL_BINPATH=openssl
CLIENT_ENCODING=utf-8
LOCAL_DOMAIN=example.org
PROXY_PASS=http://127.0.0.1:3000
MASTODON_SERVER=
MASTODON_USER_TOKEN=
TRUECAPTCHA_USERID=
TRUECAPTCHA_APIKEY=
LIBREY_APIURL=
- (Optional) Install RootCA for SSL decryption (Download CA Certificate)
sudo apt-get install -y ca-certificates
sudo cp ca.crt /usr/local/share/ca-certificates/caterpillar-ca.crt
sudo update-ca-certificates
-
Run
python3 server.py
and set HTTP(S) proxy in your web browser (e.g. Firefox) -
Test 100MB/SSL, 1GB/SSL, 10GB/SSL download and check the speed (e.g. https://speed.hetzner.de/1GB.bin)
-
Enjoy it
-
(Optional) With Cloudflare, we can expect to accelerate the 4x speed and reduce the network stuck.
(Optional) For Mastodon users
In [Caterpillar installed directory]/settings.ini or .env
- set
SERVER_URL
variable tolocalhost
in.env
(e.g.SERVER_URL=localhost
) - set
PROXY_PASS
variable to Mastodon backend URI (e.g.http://127.0.0.1:3000
) - if you want use notification, set
MASTODON_SERVER
(server domain) andMASTODON_USER_TOKEN
(access token) variables
In [Mastodon installed directory]/env.production
- set
http_proxy
variable tohttp://localhost:5555
(e.g.http_proxy=http://localhost:5555
)
In NGINX configuration
- Check your port number of Caterpillar (default: 5555)
- In NGINX configuration (e.g.
/etc/nginx/conf.d/mastodon.conf
), edit theproxy_pass
like aproxy_pass http://localhost:5555
References
Thanks to
Pan Art by @yeohangdang@i.peacht.art
Contact
- ActivityPub @gnh1201@catswords.social
- abuse@catswords.net