Links
Recently Bookmarked
- Meta String: A 37.5% space efficient string encoding than UTF-8 - Apache Fury
- How macOS opens a file in the correct app - The Eclectic Light Company
- A reasonable configuration language (RCL) - Ruud van Asseldonk
- Moire, a simple markup language - Sergey Vartanov
- Decoding UTF8 with Parallel Extract - NRK
- Remnants of a Legendary Typeface Have Been Rescued From the River Thames - Artnet
- The LaserDisc - Bradford Morgan White, Abort Retry Fail
- List of JSON tools for command line – Ilya's blog
- You can't just assume UTF-8 - csvbase
- RAR bytecode virtual machine - Tavis Ormandy
- apache php
- appengine gae ant
- aspell
- awk
- bash
- browsers
- cdrom
- charset
- crawler
- csv
- cups
- cups-pdf
- curl
- dd
- debian
- dell
- etch
- eth0
- eth1 eth2
- favicon
- find
- firefox
- floppy
- ftp
- gedit
- grep
- hardware
- hwclock
- ico
- iconv
- ie6
- ie7
- ImageMagick
- img
- iptables
- iso
- java
- jcharset
- jetty
- linus
- linux
- mac
- mdb
- msaccess
- msnbot
- msoffice
- mysql
- png
- png2ico
- port 80
- port80
- printing
- rawread
- robot
- scanner
- search engines
- sort
- start
- subversion
- svn
- tabs
- tabsize
- tabstops
- text processing
- thumbnail
- tomcat
- vi
- vim
- vmware
- vmware ntp clock time
- wordlist
- words
- xsane
- zip
Archive
- January 2014 (1)
- December 2013 (1)
- August 2012 (2)
- March 2012 (1)
- June 2011 (1)
- October 2010 (1)
- July 2010 (2)
- April 2010 (1)
- March 2010 (1)
- February 2010 (1)
- November 2009 (2)
- September 2009 (1)
- July 2009 (2)
- January 2008 (1)
- December 2007 (2)
- November 2007 (3)
- October 2007 (3)
- September 2007 (2)
- August 2007 (3)
- June 2007 (1)
- May 2007 (5)
- April 2007 (2)
- March 2007 (7)
- February 2007 (1)
- January 2007 (1)
Admin
Monthly Archives: February 2007
Traffic from search engine robots
I monitor how often I get visited by the major search engine robots. GoogleBot and Yahoo Slurp regularly visit and scan thousands of pages every day. MSNBot never scans more than a couple of hundred pages in a day. Almost … Continue reading
Posted in Uncategorized
Tagged crawler, msnbot, robot, search engines
Comments Off on Traffic from search engine robots