Search facility for the list archives?
Igor.Nekrestyanov at Sun.COM
Fri Aug 24 18:19:28 UTC 2007
Can we also remove https://openjdk.dev.java.net/robots.txt?
So sources will be searchable too.
Mark Reinhold wrote:
>> Date: Wed, 15 Aug 2007 14:04:58 -0700
>> From: david.herron at sun.com
>> It seems to me that going to google and entering:
>> site:mail.openjdk.java.net search string
>> would be a very good way to handle this. But there's a robot.txt saying
>> wget http://mail.openjdk.java.net/robots.txt
>> User-agent: *
>> Disallow: /
>> There must be a reason for this to which I'm not privy. To me it makes
>> absolute perfect sense to index this stuff because it's the search
>> engines that draw the most traffic to a web site.
> You're completely right.
> There used to be a reason for that robots.txt. The new openjdk.java.net
> domains were actually online a few days before the launch at JavaOne, and
> we (obviously) didn't want search engines to index the site prior to the
> launch. We removed the robots.txt files from openjdk.java.net but forgot
> to removing the one on mail.o.j.n.
> I've now removed it. Give Google a couple of days, and you should be all
> - Mark
More information about the discuss