Comments on: Google/Blogspot blocking proxy access http://taranjordan.wordpress.com/2006/05/17/googleblogspot-blocking-proxy-access/ For those of us who want real freedom on our own terms. By Taran Jordan. Wed, 04 Mar 2009 19:31:43 +0000 http://wordpress.com/ hourly 1 By: David http://taranjordan.wordpress.com/2006/05/17/googleblogspot-blocking-proxy-access/#comment-6975 David Thu, 24 Jan 2008 20:17:11 +0000 https://taranjordan.wordpress.com/2006/05/17/googleblogspot-blocking-proxy-access/#comment-6975 Also just as a side note remember it is extremely important to do a proper robots.txt for your proxy if you don't then your proxy will crawl the web and google will index other peoples websites under your domain. This seems great but its pretty unethical if you ask me and causes a lot more problems then the benefits of fresh content. Here is the proper format for PHProxy 5 User-agent: * Disallow : /index.php? Just put that in your robots.txt file and upload it to the root of your server. There are other ones for cgi proxy and glype. If your worried you can't do well in the Search Engines without stealing content check out my site at http://www.proxybolt.com and I guarantee you I am doing very well in the SE's and have a ton of visitors without having to steal. This is not how to block a proxy rather how proxy owners can stop indexing sites. Also just as a side note remember it is extremely important to do a proper robots.txt for your proxy if you don’t then your proxy will crawl the web and google will index other peoples websites under your domain. This seems great but its pretty unethical if you ask me and causes a lot more problems then the benefits of fresh content.

Here is the proper format for PHProxy 5

User-agent: *
Disallow : /index.php?

Just put that in your robots.txt file and upload it to the root of your server.

There are other ones for cgi proxy and glype.

If your worried you can’t do well in the Search Engines without stealing content check out my site at http://www.proxybolt.com and I guarantee you I am doing very well in the SE’s and have a ton of visitors without having to steal.

This is not how to block a proxy rather how proxy owners can stop indexing sites.

]]> By: David http://taranjordan.wordpress.com/2006/05/17/googleblogspot-blocking-proxy-access/#comment-56 David Fri, 19 May 2006 22:09:00 +0000 https://taranjordan.wordpress.com/2006/05/17/googleblogspot-blocking-proxy-access/#comment-56 Make sure to update the link in your blogroll. The new link is... http://jeffersoniantoo.wordpress.com/ Thanks! :) Make sure to update the link in your blogroll.

The new link is…

http://jeffersoniantoo.wordpress.com/

Thanks! :)

]]>