Robots-txt-generator 1.01

Publisher:	Robots txt	Date Added:	2009-04-16
Rating:		Downloads:	36
File Size:	0.05MB	Price:	$0 USD
License:	Freeware	Screenshot:	Screenshot

Free Trial

robots-txt generator

The spiders that visit your site consumes much of your bandwidth?

If you want to control the robots or spiders that visit your site, robots-txt generator is the solution.

It is very common that the webmaster of each site spends a lot of money paying for bandwidth and it is unfair that a significant portion of that bandwidth is consumed spiders.
Robots txt generator, you can stop or control the bots.

Some robots or spiders saturate your server making countless queries per minute?

With Robots txt generator, you can limit how many requests can make any robot or spider per hour or per minute.
In addition, the program has a database of more than 300 bots, allowing you to search on the database the source and owner of any bot you have found in your logs.
You can even specify different restrictions for different bots. Per example, you can allow google bot, but disallow google-image-bot. You can specify a different restriction level for each one of the 300 bots in the database or can specify some restrition to the "general" bots, plus some specific for some specifi bots. Like giving a ban to some specific bot.
Best of all, is that the software is free!

HOT TAG: robots txt generator, txt generator, robots txt, some specific, 300 bots, robots, bots, txt, some, per, spiders,

---

Relate Software Downloads

JavaScript Image Rotator - JavaScript-producing design tool to create rotating images on Web pages.

Free Speedy 3GP Video Converter - Free 3GP and 3G2 movies converter

Jewels of Karnak - White Chapel and Red - Jewels of Karnak - White Chapel and Red Chapel Screensaver contains 40 images.

TimeLive free time tracking software - Free Time tracking software, expense management, time billing, attendance

Recover Deleted SMS Tool - Sim card Data Recovery Software Recover deleted text sms messages restore SMS

Impressionism Screensaver 800 Paintings - Impressionism Art Screensaver - Over 800 Paintings by more than 60 Artists.

MB Sabian Symbols - Sabian Symbols are 360 symbolic messages known as 360 Degrees of Wisdom.

JN0-562 Free Pass Sure Exam - Certified Internet Associate (JNCIA-SSL) 562

HP0-J23 Free Pass Sure Exam - Implementing MSA Storage Solutions

1Z0-020 Free Pass Sure Exam - Oracle8i: New Features for Administrators