FreeProxy

By default, freeproxy validates format and de-duplicates results. To enforce specific requirements for geography, anonymity, or speed, pass a filter_rule dictionary to the session constructor.

Supported filter_rule keys:

• country_code: A list of country codes, e.g., ['CN'] or ['US'].
• anonymity: A string or list of anonymity levels: elite, anonymous, or transparent.
• protocol: A string or list of protocols: http, https, socks4, or socks5.
• max_tcp_ms: Maximum allowed TCP connect latency in milliseconds.
• max_http_ms: Maximum allowed HTTP request latency to the test_url in milliseconds.

Note on performance: Using max_tcp_ms or max_http_ms will slow down the scraping process because every proxy must be actively tested against the latency constraints.

from freeproxy.modules.proxies import SpysoneProxiedSession

# Example: US-based elite proxies
sess = SpysoneProxiedSession(filter_rule={"anonymity": ["elite"], "country_code": ["US"]})
sess.refreshproxies()
print(sess.getrandomproxy(proxy_format="freeproxy"))

You can use BuildProxiedSession to create a session for a specific source and call refreshproxies() to retrieve a list of ProxyInfo objects. To manage multiple sources, iterate through a list of source names, build a session for each, and collect the results. The ProxyInfo objects can be converted to dictionaries using .todict() for easy JSON serialization.

import json
from freeproxy.modules import BuildProxiedSession

SOURCES = ["ProxiflyProxiedSession", "KuaidailiProxiedSession"]

def scrape(src: str):
    try:
        # Build session with configuration
        sess = BuildProxiedSession({"max_pages": 1, "type": src, "disable_print": False})
        return sess.refreshproxies()
    except Exception:
        return []

free_proxies = {}
for src in SOURCES:
    proxies = scrape(src)
    # Convert ProxyInfo objects to dicts for JSON saving
    free_proxies[src] = [p.todict() for p in proxies]

with open("free_proxies.json", "w") as f:
    json.dump(free_proxies, f, indent=2)

You can use BuildProxiedSession to scrape proxies from various sources. By specifying a type (the source name) and configuration like max_pages, you can retrieve a list of ProxyInfo objects. This allows you to aggregate proxies from multiple providers, summarize their statistics (protocol distribution, anonymity, etc.), and save them to a JSON file using the todict() method on each proxy object.

import json
from freeproxy.modules import BuildProxiedSession

# Example: Scrape from a specific source
# 'type' corresponds to the registered module name
sess = BuildProxiedSession({"max_pages": 1, "type": "ProxiflyProxiedSession", "disable_print": False})
proxies = sess.refreshproxies()

# Save to JSON
free_proxies = {src: [p.todict() for p in proxies] for src in ["ProxiflyProxiedSession"]}
with open("free_proxies.json", "w") as f:
    json.dump(free_proxies, f, indent=2)