Stavo dando un'occhiata ai log del mio server linux e ho trovato una sfilza di righe simili a queste (chiaramente www.miositooo.com è un nome fittizio che ho usato io):
[Tue May 20 05:36:20 2008] [error] [client 67.195.51.221] ModSecurity: Warning. Pattern match "\\\\byahoo(?:-(?:mmcrawler|blogs)|! slurp)\\\\b" at REQUEST_HEADERS:User-Agent. [id "10007"] [msg "Yahoo robot activity"] [severity "ALERT"] [hostname "www.miositooo.com"] [uri "/benvenuto-in.html"] [unique_id "LvqZEsPhqyUAAFFfy0IAAAAD"]
[Tue May 20 05:37:12 2008] [error] [client 67.195.54.40] ModSecurity: Warning. Pattern match "\\\\byahoo(?:-(?:mmcrawler|blogs)|! slurp)\\\\b" at REQUEST_HEADERS:User-Agent. [id "10007"] [msg "Yahoo robot activity"] [severity "ALERT"] [hostname "www.miositooo.com"] [uri "/gallery/index.php"] [unique_id "MhL3D8PhqyUAAHP9C5UAAAAI"]
[Tue May 20 07:36:09 2008] [error] [client 74.6.18.250] ModSecurity: Warning. Pattern match "\\\\byahoo(?:-(?:mmcrawler|blogs)|! slurp)\\\\b" at REQUEST_HEADERS:User-Agent. [id "10007"] [msg "Yahoo robot activity"] [severity "ALERT"] [hostname "www.miositooo.com"] [uri "/robots.txt"] [unique_id "24O7PsPhqyUAAETJgeIAAAAF"]
[Tue May 20 07:36:10 2008] [error] [client 74.6.18.250] ModSecurity: Warning. Pattern match "\\\\byahoo(?:-(?:mmcrawler|blogs)|! slurp)\\\\b" at REQUEST_HEADERS:User-Agent. [id "10007"] [msg "Yahoo robot activity"] [severity "ALERT"] [hostname "www.miositooo.com"] [uri "/index2.php?option=com_content&do_pdf=1&id=14"] [unique_id "24p4xMPhqyUAAFHDrOgAAAAL"]
[Tue May 20 08:46:17 2008] [error] [client 74.6.19.243] ModSecurity: Warning. Pattern match "\\\\byahoo(?:-(?:mmcrawler|blogs)|! slurp)\\\\b" at REQUEST_HEADERS:User-Agent. [id "10007"] [msg "Yahoo robot activity"] [severity "ALERT"] [hostname "www.miositooo.com"] [uri "/robots.txt"] [unique_id "1klAQsPhqyUAABlzFqQAAAAJ"]
[Tue May 20 08:46:17 2008] [error] [client 67.195.52.97] ModSecurity: Warning. Pattern match "\\\\byahoo(?:-(?:mmcrawler|blogs)|! slurp)\\\\b" at REQUEST_HEADERS:User-Agent. [id "10007"] [msg "Yahoo robot activity"] [severity "ALERT"] [hostname "www.miositooo.com"] [uri "/cerca.html"] [unique_id "1lKbRcPhqyUAACABYnUAAAAH"]
[Tue May 20 08:58:54 2008] [error] [client 74.6.22.176] ModSecurity: Warning. Pattern match "\\\\byahoo(?:-(?:mmcrawler|blogs)|! slurp)\\\\b" at REQUEST_HEADERS:User-Agent. [id "10007"] [msg "Yahoo robot activity"] [severity "ALERT"] [hostname "www.miositooo.com"] [uri "/robots.txt"] [unique_id "A29ly8PhqyUAAC4DdaMAAAAL"]
[Tue May 20 08:58:54 2008] [error] [client 74.6.18.177] ModSecurity: Warning. Pattern match "\\\\byahoo(?:-(?:mmcrawler|blogs)|! slurp)\\\\b" at REQUEST_HEADERS:User-Agent. [id "10007"] [msg "Yahoo robot activity"] [severity "ALERT"] [hostname "www.miositooo.com"] [uri "/chi-siamo.html"] [unique_id "A3eS3cPhqyUAAC4fe18AAAAP"]
[Tue May 20 09:18:19 2008] [error] [client 66.249.67.150] ModSecurity: Warning. Pattern match "\\\\b(?:google(?:-sitemaps|bot)|mediapartners-google)\\\\b" at REQUEST_HEADERS:User-Agent. [id "10006"] [msg "Google robot activity"] [severity "ALERT"] [hostname "www.miositooo.com"] [uri "/datsogallery/39.html"] [unique_id "SOMvgsPhqyUAAEkxV4YAAAAB"]
[Tue May 20 10:05:31 2008] [error] [client 66.249.67.150] ModSecurity: Warning. Pattern match "\\\\b(?:google(?:-sitemaps|bot)|mediapartners-google)\\\\b" at REQUEST_HEADERS:User-Agent. [id "10006"] [msg "Google robot activity"] [severity "ALERT"] [hostname "www.miositooo.com"] [uri "/robots.txt"] [unique_id "8a9BgMPhqyUAAA9lA14AAAAO"]
[Tue May 20 10:05:32 2008] [error] [client 66.249.67.150] ModSecurity: Warning. Pattern match "\\\\b(?:google(?:-sitemaps|bot)|mediapartners-google)\\\\b" at REQUEST_HEADERS:User-Agent. [id "10006"] [msg "Google robot activity"] [severity "ALERT"] [hostname "www.miositooo.com"] [uri "/contatti/xxsda.html"] [unique_id "8bb028PhqyUAABEHIvcAAAAR"]
Mi viene il dubbio che il mod_security stia bloccando i robots dei motori di ricerca. Qualcuno da darmene conferma leggendo queste righe di esempio?
Grazie in anticipo.
Simone

Rispondi quotando