Bandwidth

3 thoughts on “Bandwidth”

1. Somehow, I ate up 1081 mgs (is that the correct term?) of bandwidth in less than a month. Thankfully my webhost adjusted my limit within ten minutes……

   Can anyone tell me how to block the bots so that I don’t eat up so much bandwidth? It’s those pesky search terms that kill me every single time. At least, that’s what my webhost said.

   Reply

2. Per Google’s page on the subject:

   If you wish to exclude your entire website or a specific section (directory) of your server from Google’s index, you can place a file at the root of your server called robots.txt.
   To prevent Google and other search engines from crawling your site, place the following robots.txt file in your server root:
   User-agent: *
   Disallow: /
   This is the standard protocol that most web crawlers observe for excluding a web server or directory from an index. More information on robots.txt is available here: http://www.robotstxt.org/wc/norobots.html.

   To remove individual pages:

   If you want to prevent all robots from indexing individual pages on your site, then you can place the following meta tag element into the page’s HTML code:
   <META NAME=”ROBOTS” CONTENT=”NOINDEX, NOFOLLOW”>
   If you want to allow other robots to index individual pages on your site, preventing only Google’s robots from indexing the pages, use the following tag:
   <META NAME=”GOOGLEBOT” CONTENT=”NOINDEX, NOFOLLOW”>
   More information on this standard meta tag element is available here: http://www.robotstxt.org/wc/exclusion.html#meta.

   Hope that helps.

   Reply

3. Google’s page on the subject, btw, is here.

   Reply