18 Commits

Author	SHA1	Message	Date
Matt Baer	2bd12efc2d	Merge branch 'master' of github.com:writeas/web-core	2018-02-05 02:19:57 -05:00
Matt Baer	c0e4c95cfb	Prevent findBots.sh running when no arg given	2018-01-25 17:30:41 -05:00
Matt Baer	ca03ff920a	Explain findBots.sh a little more	2018-01-25 17:29:58 -05:00
Matt Baer	5c3827dc76	Mark empty User-Agent strings as bots	2017-09-28 17:20:32 -04:00
Matt Baer	e082f1e402	Mark PHP clients as bots	2017-09-28 17:19:51 -04:00
Matt Baer	b80eea5454	Add bots test	2017-09-23 14:04:43 -04:00
Matt Baer	47655b3e66	Mark Mastodon clients as bot	2017-09-23 14:04:00 -04:00
Matt Baer	ba5dc7067e	Add recent bots	2016-06-25 11:20:58 -04:00
Matt Baer	da1d3d898c	Add spiders, scrapers, indexers; update bots	2015-08-17 15:21:43 -04:00
Matt Baer	a4eeea7469	Add new Mail.RU_Bot, OpsBot, Wotbox	2015-07-29 15:09:57 -04:00
Matt Baer	cf23d08df8	Add new TelegramBot and Domain Re-Animator Bot	2015-07-17 10:41:44 -04:00
Matt Baer	5ad0664e7e	Add woriobot and zitebot	2015-07-07 20:02:39 -04:00
Matt Baer	b9838662f8	Merge branch 'master' of https://github.com/writeas/web-core	2015-07-07 19:57:56 -04:00
Matt Baer	ba872dc59f	Add bots package README	2015-07-07 02:37:00 -04:00
Matt Baer	d01e265587	Add bots documentation	2015-07-07 02:35:17 -04:00
Matt Baer	5ce4115c4f	Add more crawlers, bots, and voltron to bots map	2015-07-01 17:08:43 -04:00
Matt Baer	91771fc838	Add "crawler" and "voltron" to bot UA search	2015-07-01 17:07:59 -04:00
Matt Baer	d2454e8900	Add bots component ... Include generation script for extracting bots from server logs	2015-06-28 18:22:40 -04:00