Browse Source

Explain findBots.sh a little more

master
Matt Baer 6 years ago
parent
commit
ca03ff920a
1 changed files with 4 additions and 1 deletions
  1. +4
    -1
      bots/findBots.sh

+ 4
- 1
bots/findBots.sh View File

@@ -1,7 +1,10 @@
#!/bin/bash

#
# Generates a Go map containing all bots that have accessed Write.as
# Generates a Go map containing all bots that have accessed Write.as from the
# application logs stored in /var/log/
#
# usage: findBots.sh application.log
#

cat /var/log/$1 | grep -i 'bot\|spider\|crawl\|scraper\|indexer\|voltron' | awk -F\" '{print $4}' | sort | uniq > bots.txt


Loading…
Cancel
Save