openproxyherder

A Python webapp that "herds" a list of open proxies, with an API for external programs to add and update entries.

This is only the webapp, openproxyherder-extras has some example Python scripts that might be useful to you.

Setup

This is tested with Python 3.8 and 3.9, but should work with Python 3.5 and above.

You'll need a postgresql database available via TCP, with the following table:

create table proxies (
    id int primary key, 
    ip inet,
    port int,
    exit_ip inet,
    status text,
    last_seen timestamp,
    last_checked timestamp,
    submitted_at timestamp,
    comment text,
    num_failures int,
    recheck bool
);

Copy config.example.yaml to config.yaml, edit config.yaml as needed.

Install the packages in requirements.txt (probably a good idea to create a venv).

Run python openproxyherder.py