Robots.txt 2.0

Publisher:	NetPromoter	Date Added:	2005-08-19
Rating:		Downloads:	138
File Size:	2.80MB	Price:	$99.90 USD
License:	Shareware	Screenshot:	Screenshot

Free Trial

Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with

HOT TAG: robotstxt files, web site, spider visits, search engine, made searchable, robotstxt, files, web, spiders, site, visits,

---

Relate Software Downloads

101Inventory Organizer Deluxe - 101Inventory Organizer Deluxe is a Windows software that allows business an...

1st MP3 Tag Editor (Personal License) - Got a bunch of MP3 files with missing tags? Get 1st MP3 Tag Editor and get ...

7art Cheerful Clock ScreenSaver - Get 14 cheerful Clock at your desktop in one single clock screensaver !

Abee Mp3 Duplicates Finder - The purpose of this program is to find all mp3 duplicates on your computer ...

Advanced Encryption Package 2005 - Typically you encrypt files because you don t want others to see them, but...

Alarm Timer - Alarm Timer is an alarm clock on PC.

Amazing Auto Dialer - Amazing Auto Dialer, the most feature-rich and user-friendly dialing softwa...

Aone Photo Screensaver Maker - Make your own slide-show screensavers with photos, music and text captures.

Art Forms in Nature by Ernst Haeckel - Ernst Haeckel s dazzling artwork of nature s symmetrical forms. 45 pictures.

AudioAlien - AudioAlien allows you to quickly and easily find and play any song, album, ...