FUDforum: comp.lang.php » Proxy Probe, an asynchronous proxy checker script

Home » Imported messages » comp.lang.php » Proxy Probe, an asynchronous proxy checker script

Show: Today's Messages :: Polls :: Message Navigator

Proxy Probe, an asynchronous proxy checker script [message #175676]

Tue, 18 October 2011 06:30

Eric Muyser
Messages: 2
Registered: October 2011

Karma:

Junior Member

Link: https://github.com/ericmuyser/php-proxyprobe

Proxy Probe is a suite of proxy scripts started in Python, that have
been partially converted (proxy checker) to PHP. (Note: this was
created few years ago, but felt like open sourcing it now).

Features
------------
- Identifies different types of proxies: http (transparent, anonymous,
elite), socks (socks4, socks5).
- Validate many proxies in parallel.
- Performance optimized code. CPU: 0-4% average / 10% peak on dual-
core (1000 parallel). Memory: base + ~15MB allocated (1000 parallel).
- Database of proxies. (Currently more than 99% of the 200,000 are
invalid or dead.)

Requirements
------------
PHP 5.3+

Getting Started
------------
- Clone the repo: git clone git(at)github(dot)com:ericmuyser/php-
proxyprobe.git
- Restore the db/proxies.sql file to MySQL to database: proxies.
- Set your database configuration in the src/proxy_checker.php file.
- Run the script by navigating to the src directory in your terminal,
and running: php proxy_checker.php.

Roadmap
------------
- Identify different states: CoDeen, agency, etc.
- Improve invalid handling: cannot connect, 0 transfer time, odd
responses.
- Remove dead proxies and restart with a fresh set.

Notes
------------
On Linux/Mac OS X you need to increase your file descriptor/socket
limit. In the same terminal tab before you run the script, run this
command: ulimit -n 1024

Report message to a moderator

[Message index]

		Proxy Probe, an asynchronous proxy checker script By: Eric Muyser on Tue, 18 October 2011 06:30
		Re: Proxy Probe, an asynchronous proxy checker script By: Jerry Stuckle on Tue, 18 October 2011 11:13
		Re: Proxy Probe, an asynchronous proxy checker script By: Eric Muyser on Sun, 06 November 2011 22:09
		Re: Proxy Probe, an asynchronous proxy checker script By: Jerry Stuckle on Sun, 06 November 2011 23:29

Previous Topic:	by get this format my explode file name like this through php
Next Topic:	Stats comp.lang.php (last 7 days)

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Sun Dec 22 08:08:12 GMT 2024

Total time taken to generate the page: 0.04256 seconds