FUDforum: FUDforum Suggestions » Detecting search engine bots

Home » FUDforum » FUDforum Suggestions » Detecting search engine bots

Mon, 28 July 2003 19:39

jrobbio

Messages: 32
Registered: June 2003

Karma:

Member

JamesS wrote on Mon, 28 July 2003 19:13

You would probably be better off denying bots access to the forum directory any way. It causes undue stress and slows things down (even if marginal)

`echo "Disallow: /forum" >> /webroot/robots.txt`

Your obviously not into people actually finding content on your forums then.

Rob

		Detecting search engine bots By: jrobbio on Mon, 28 July 2003 16:38
		Re: Detecting search engine bots By: Ilia on Mon, 28 July 2003 16:55
		Re: Detecting search engine bots By: jrobbio on Mon, 28 July 2003 17:05
		Re: Detecting search engine bots By: Ilia on Mon, 28 July 2003 17:12
		Re: Detecting search engine bots By: jrobbio on Mon, 28 July 2003 17:42
		Re: Detecting search engine bots By: Ilia on Mon, 28 July 2003 17:56
		Re: Detecting search engine bots By: JamesS on Mon, 28 July 2003 18:13
		Re: Detecting search engine bots By: Ilia on Mon, 28 July 2003 18:20
		Re: Detecting search engine bots By: jrobbio on Mon, 28 July 2003 19:39
		Re: Detecting search engine bots By: Ilia on Mon, 28 July 2003 19:55
		Re: Detecting search engine bots By: jrobbio on Tue, 29 July 2003 02:34

Previous Topic:	Members list
Next Topic:	french community for FUDforum

Goto Forum:

]

Current Time: Wed Nov 27 11:17:01 GMT 2024

Total time taken to generate the page: 0.04679 seconds