nanog mailing list archives
Re: Intermittent incorrect DNS resolution?
From: "Erik Levinson" <erik.levinson () uberflip com>
Date: Thu, 17 Jan 2013 20:42:58 -0500 (EST)
Thanks Damian. I see four requests with Google UAs from actual Google IPs, 66.249.73.45 and 66.249.73.17 (PTR and rwhois seem yours for both), in a period of 30 minutes (compared to over 80 per minute on the new IPs). This is pretty low, so I'm not too worried. Baidu is the main culprit now; there's little other traffic. In fact, we're getting no traffic from Baidu on the new IPs, only to the old ones. I've already e-mailed their spider help e-mail, but it's fallen on deaf ears. Erik -----Original Message----- From: "Damian Menscher" <damian () google com> Sent: Thursday, January 17, 2013 1:58pm To: "Erik Levinson" <erik.levinson () uberflip com> Cc: "NANOG mailing list" <nanog () nanog org> Subject: Re: Intermittent incorrect DNS resolution? On Wed, Jan 16, 2013 at 8:09 PM, Erik Levinson <erik.levinson () uberflip com>wrote:
To give an idea of the scale of the problem right now, I'm getting thousands of requests per minute to a new IP vs. about two requests per minute on the equivalent old IP, with over 60% of the latter being Baidu, but also a bit of Googlebot and other random bot and non-bot UAs.
It's common for malware to spoof the Googlebot user-agent since they know most webmasters won't block it. You might want to check whether the IPs you're seeing it from are really allocated to us -- if so, I'd be interested in tracking down why we're crawling your old IP. Damian
Current thread:
- Re: Intermittent incorrect DNS resolution?, (continued)
- Re: Intermittent incorrect DNS resolution? George Herbert (Jan 16)
- Re: Intermittent incorrect DNS resolution? RijilV (Jan 16)
- Re: Intermittent incorrect DNS resolution? Erik Levinson (Jan 16)
- Re: Intermittent incorrect DNS resolution? RijilV (Jan 16)
- Re: Intermittent incorrect DNS resolution? Christopher Morrow (Jan 16)
- Re: Intermittent incorrect DNS resolution? Erik Levinson (Jan 16)
- Re: Intermittent incorrect DNS resolution? Christopher Morrow (Jan 16)
- Re: Intermittent incorrect DNS resolution? Erik Levinson (Jan 16)
- Re: Intermittent incorrect DNS resolution? Joe Abley (Jan 16)
- Re: Intermittent incorrect DNS resolution? Erik Levinson (Jan 16)
- Re: Intermittent incorrect DNS resolution? Damian Menscher (Jan 17)
- Re: Intermittent incorrect DNS resolution? Erik Levinson (Jan 17)
- Re: Intermittent incorrect DNS resolution? Erik Levinson (Jan 17)
- Re: Intermittent incorrect DNS resolution? Erik Levinson (Jan 16)
- Re: Intermittent incorrect DNS resolution? George Herbert (Jan 16)
- Re: Intermittent incorrect DNS resolution? Robert Bonomi (Jan 16)
- Re: Intermittent incorrect DNS resolution? Vinny Abello (Jan 18)
- RE: Intermittent incorrect DNS resolution? Keith Medcalf (Jan 19)
- Re: Intermittent incorrect DNS resolution? Vinny Abello (Jan 20)
- Re: Intermittent incorrect DNS resolution? Jay Ashworth (Jan 18)