Great Circle Associates Firewalls
(June 1997)

Indexed By Date: [Previous] [Next] Indexed By Thread: [Previous] [Next]

Subject: Re: nt web server log
From: James Proffer <james @ mail . state . mo . us>
Date: Fri, 6 Jun 1997 11:21:19 -0500 (CDT)
To: "k. frisco" <kfrisco @ shrike . depaul . edu>
Cc: firewalls @ GreatCircle . COM
In-reply-to: <Pine . GSO . 3 . 95 . 970606103118 . 17074A-100000 @ shrike . depaul . edu>

The file robots.txt holds any robot exclusion rules you might care to
write for your web server.  Most (but not all) web spiders look for
/robots.txt and obey its exclusions. 

On Fri, 6 Jun 1997, k. frisco wrote:

> Withh all the talk about hacking webservers, I was wondering if anyone
> knows anything about a weird log msg that we got on our nt webserver?  it
> was a get to robots.txt
> There is no file or image that is related to this file name on our web
> page.  Could not even find it on the server anywhere.  Am I unduly
> concerned?

Missouri State Data Center     <*> James Proffer: UNIX sysadm
Missouri Government Information |  mailto:james @
 mail .
 state .
 mo .
for the citizens of Missouri    |
and the citizens of the world   |  (573) 751-1544  Fax: (573) 751-3299

Indexed By Date Previous: Re: nt web server log
From: Ken Hardy <ken @ mailhost . bridge . com>
Next: Re: nt web server log
From: Brian Hatch <bri @ ifokr . org>
Indexed By Thread Previous: nt web server log
From: "k. frisco" <kfrisco @ shrike . depaul . edu>
Next: Re: nt web server log
From: Brian Hatch <bri @ ifokr . org>

Search Internet Search