Return to Snippet

Revision: 46114
at May 13, 2011 01:13 by level09


Initial Code
$userAgent = 'Googlebot/2.1 (http://www.googlebot.com/bot.html)';
        $curl = curl_init($url);
        curl_setopt($curl, CURLOPT_USERAGENT, $userAgent);
        curl_setopt($curl, CURLOPT_AUTOREFERER, true);
        curl_setopt($curl, CURLOPT_FOLLOWLOCATION, true);
        curl_setopt($curl, CURLOPT_RETURNTRANSFER, 1 );
        curl_setopt($curl, CURLOPT_TIMEOUT, 2 );                
        $html = curl_exec( $curl );
	    curl_close( $curl);

Initial URL


Initial Description


Initial Title
byPAss curl / file_get_contents blocking for scrapping

Initial Tags
curl, php

Initial Language
PHP