Autor: Lech Borkowski (lbs_at_phys.ufl.edu)
Data: Wed 09 Nov 1994 - 16:39:36 MET
Byc moze niektorym z was sie przyda archiwum
w Los Alamos. A jak nie wam, to moze waszym
kolegom i kolezankom:
Some other e-print archives running the same software:
alg-geom_at_publications.math.duke.edu (algebraic geometry)
astro-ph_at_babbage.sissa.it (astrophysics)
cond-mat_at_babbage.sissa.it (condensed matter)
e-mail_at_xxx.lanl.gov (e-mail address database)
funct-an_at_babbage.sissa.it (functional analysis)
gr-qc_at_xxx.lanl.gov (general relativity / quantum cosmology)
hep-lat_at_ftp.scri.fsu.edu (computational and lattice physics)
hep-ph_at_xxx.lanl.gov (high energy physics phenomenological)
hep-th_at_xxx.lanl.gov (high energy physics formal)
hep-ex_at_xxx.lanl.gov (high energy physics experimental)
nucl-th_at_xxx.lanl.gov (nuclear theory)
nucl-ex_at_xxx.lanl.gov (nuclear experiment)
cmp-lg_at_xxx.lanl.gov (computation and language)
chem-ph_at_xxx.lanl.gov (chemical physics)
nlin-sys_at_xyz.lanl.gov (non-linear systems)
acc-ph_at_xxx.lanl.gov (accelerator physics)
mtrl-th_at_xxx.lanl.gov (materials theory)
supr-con_at_xxx.lanl.gov (superconductivity)
auto-fms_at_msri.org (automorphic forms)
cd-hg_at_msri.org (complex dynamics & hyperbolic geometry)
dg-ga_at_msri.org (differential geometry & global analysis)
W ponizszym tekscie zaciekawila mnie pewna uwaga:
WWW server for automated e-print archives on xxx
11/94: note physics job/conference announcements forum.
ROBOTS BEWARE: indiscriminate automated downloads from this site are not permitted. (Read
this.)
Zaintrygowany zajrzalem do ostrzezenia adresowanego
do robotow:
Robots Beware
over 100,000 distinct URL's
This www server has been under all-too-frequent attack
from "intelligent agents" (a.k.a. "robots") that mindlessly
download every link encountered, ultimately trying
to access the entire database through the listings links.
In most cases, these processes are run by well-intentioned but
thoughtless neophytes, ignorant of common sense guidelines.
(Very few of these same robotrunners would ever dream
of downloading entire databases via anonymous ftp,
but for some reason conceptualize www sites as somehow
associated only to small and limited databases.
This mentality must change --- large databases such
as this one [which has over 100,000 distinct URL's that
lead to gigabytes of data] are likely to grow ever
more commonly exported via www.)
Following a proposed standard for robot exclusion, this site
maintains a file /robots.txt that specifies those URL's
that are off-limits to robots (note that the title/author
listings for all archives remain available for remote indexing).
[When all users have access to form-compliant clients,
then the majority of the database can as well be hidden behind
a POST or two.]
This server is configured to monitor activity and deny access
to sites that violate the above guidelines. Continued rapid-fire
requests from any site after access has been denied will be
interpreted as a network attack, and the automated reponse
will be decidedly unfriendly. (Click here to initiate automated
"seek-and-destroy" against your site.)
[...]
Komentarze? Czy ten problem dotyczy rowniez Polski?
Lech Borkowski
To archiwum zostało wygenerowane przez hypermail 2.1.7 : Wed 19 May 2004 - 15:46:56 MET DST