webstats.py
AccessSummary.SPIDER_STRINGS
Access records are considered spider accesses if their .accessor field contains any of these strings.
.accessor
SPIDER_STRINGS = ("crawl", "msnbot-", "monitor.nmt.edu")