Fail2ban和Nginx防火墙 搜索引擎白名单分享涵盖 Google/Bing/Baidu主流搜索引擎

我是这样写的，最近NewVFX启用Fail2ban后防护效果非常强大，系统级的的拦截不消耗资源，当前前提是开启Nginx日志。我选取了最主流的流的，当然其他的不设置也能正常索引，因为这些大搜索引擎的爬虫量非常巨大，容易被封，当然duckduckgo，是唯一一个API免费的，出于个人尊重我肯定要加的：

针对Fail2ban的白名单

127.0.0.1/8
66.249.0.0/16
64.233.160.0/19
72.14.192.0/18
203.208.32.0/19
74.125.0.0/16
216.239.32.0/19
13.66.0.0/16
13.67.0.0/16
13.68.0.0/16
13.69.0.0/16
20.36.0.0/14
20.40.0.0/13
20.60.0.0/14
40.76.0.0/14
40.80.144.0/20
40.90.0.0/15
52.128.0.0/14
111.13.0.0/16
111.206.0.0/16
123.125.64.0/18
180.76.0.0/16
220.181.0.0/16
40.88.21.235/32
20.191.45.0/24
20.191.47.0/24

Nginx防火墙的白名单写法不一样，这里也将NewVFX的配置分享给大家：

20.191.47.0-20.191.47.255
20.191.45.0-20.191.45.255
220.181.0.0-220.181.255.255
180.76.0.0-180.76.255.255
123.125.0.0-123.125.63.255
111.206.0.0-111.206.255.255
111.13.0.0-111.13.255.255
52.0.0.0-52.3.255.255
40.0.0.0-40.1.255.255
40.80.0.0-40.80.15.255
40.0.0.0-40.3.255.255
20.0.0.0-20.7.255.255
20.0.0.0-20.3.255.255
13.69.0.0-13.69.255.255
13.68.0.0-13.68.255.255
13.67.0.0-13.67.255.255
13.66.0.0-13.66.255.255
216.239.0.0-216.239.31.255
74.125.0.0-74.125.255.255
203.208.0.0-203.208.31.255
72.14.0.0-72.14.63.255
64.233.0.0-64.233.31.255
66.249.0.0-66.249.255.255
43.143.133.170-43.143.133.170