These files are maintained strictly for historical reference, research, and recordkeeping purposes, and the content has not been altered or updated since archiving. Content on this site may not meet current digital accessibility standards. If you require an alternative, accessible format of any information found on this site, please contact Bruce Jones, bjones@ucsd.edu to request an accommodation.
These files are maintained strictly for historical reference, research, and recordkeeping purposes, and the content has not been altered or updated since archiving. Content on this site may not meet current digital accessibility standards. If you require an alternative, accessible format of any information found on this site, please contact Bruce Jones, bjones@ucsd.edu to request an accommodation.
>From huw.softdesigns@gmail.com Fri Oct 28 09:58:40 2011 > >Website pages can be marked as _not_ for 'spider bots' that accumulate >pages for google and the like, I believe. So checking the relevant >lchc pages would be a start. This is the "robots.txt" file that tells the search engines which of your pages to index. If you don't allow the search engines to index your pages then their contents won't show up the search listings. __________________________________________ _____ xmca mailing list xmca@weber.ucsd.edu http://dss.ucsd.edu/mailman/listinfo/xmca