gnh1201/caterpillar

Caterpillar - The simple and parasitic web proxy with spam filter (formerly, php-httpproxy)

How it works

Basic structure

You <-> Proxy client (Python) <-> Parasitized proxy server (Optional, PHP) <-> On the Web

For example, build a simple web debugging proxy on the shared servers.

Spam filtering strategy

K-Anonymity test - Estimating whether the characters has been arranged by humans. (use Have I Been Pwned)
Not CAPTCHA - Image spam containing characters that look very similar to CAPTCHA. (use TrueCaptcha)
VowelRatio10 - In characters arranged by humans, there is a high frequency of vowels (aeiou) and semivowels (wy) and vowel-ending patterns included in strings that are 10 characters.
Palindrome4 - Detect palindromes composed of 4 or more characters
KnownWords4 - Detect well-known words composed of 4 or more characters
SearchEngine3 - In public search engine, the given string yields more than 2 results. (use LibreY)
RepeatedNumber3 - Detect a repeated numbers 3 times or more.
SSL decryption (MITM) when relaying to federated servers.

The strategies were implemented to respond to the Fediverse Spam Attacks which started on the 15th of February.

(Optional) Before to use

If you have an will be parasitize server that you want to proxy, you can install the index.php file.

How to use

Write a file .env(Linux) or settings.ini(Windows). Like this:

[settings]
PORT=5555
SERVER_URL=http://example.org
SERVER_CONNECTION_TYPE=stateful
CA_KEY=ca.key
CA_CERT=ca.crt
CERT_KEY=cert.key
CERT_DIR=certs/
OPENSSL_BINPATH=openssl
CLIENT_ENCODING=utf-8
LOCAL_DOMAIN=example.org
PROXY_PASS=http://127.0.0.1:3000
MASTODON_SERVER=
MASTODON_USER_TOKEN=
TRUECAPTCHA_USERID=
TRUECAPTCHA_APIKEY=
LIBREY_APIURL=

(Optional) Install RootCA for SSL decryption (Download CA Certificate)

sudo apt-get install -y ca-certificates
sudo cp ca.crt /usr/local/share/ca-certificates/caterpillar-ca.crt
sudo update-ca-certificates

Run python3 server.py and set HTTP(S) proxy in your web browser (e.g. Firefox)
Test 100MB/SSL, 1GB/SSL, 10GB/SSL download and check the speed (e.g. https://speed.hetzner.de/1GB.bin)
Enjoy it
(Optional) With Cloudflare, we can expect to accelerate the 4x speed and reduce the network stuck.

(Optional) For Mastodon users

In [Caterpillar installed directory]/settings.ini or .env

set SERVER_URL variable to localhost in .env (e.g. SERVER_URL=localhost)
set PROXY_PASS variable to Mastodon backend URI (e.g. http://127.0.0.1:3000)
if you want use notification, set MASTODON_SERVER(server domain) and MASTODON_USER_TOKEN(access token) variables

In [Mastodon installed directory]/env.production

set http_proxy variable to http://localhost:5555 (e.g. http_proxy=http://localhost:5555)

In NGINX configuration

Check your port number of Caterpillar (default: 5555)
In NGINX configuration (e.g. /etc/nginx/conf.d/mastodon.conf), edit the proxy_pass like a proxy_pass http://localhost:5555

References

Contact

ActivityPub @gnh1201@catswords.social
abuse@catswords.net

3.9 KiB Raw Blame History