next »

this range of ip's belonging to named below shows up in high usage in terms of bandwidth on all my domains, is these types of hits helpful or hurtful?
?  !  $Whois Record
OrgName:    Amazon.com, Inc.
OrgID:      AMAZO-4
Address:    Amazon Web Services, Elastic Compute Cloud, EC2
Address:    1200 12th Avenue South
                 Seattle  WA  98144

NetRange:   67.202.0.0 - 67.202.63.255
CIDR:       67.202.0.0/18
NetName:    AMAZON-EC2-3
NetHandle:  NET-67-202-0-0-1
Parent:     NET-67-0-0-0-0
NetType:    Direct Assignment
NameServer: PDNS1.ULTRADNS.NET
NameServer: PDNS2.ULTRADNS.NET
NameServer: PDNS3.ULTRADNS.ORG

Do you have a lot of Amazon widgets or links/ I do not know of a Amazon spider.

 

No not really only a few and not on all domains.
There is many I'm finding through lookups that belong to data gathering organizations.
I'm sure this is traffic that eBay is serving up and not seeing any return on.
Here is another:
OrgName:    Abovenet Communications, Inc
OrgID:      ABVE
Address:    360 Hamilton Ave, White Plains, NY 10601
Country:    US

NetRange:   209.249.0.0 - 209.249.255.255

These people show up in every domain stat.
Should we be blocking these daily visitor that show up every month in excess?

I noticed on some of the expired domain names I had purchased - a lot of bandwidth was being eaten up by unknown spiders - you maybe be able to modify your robot file to tell those excessive spiders to not spiders your site. What would happen, especially with the mega sites, is the spider would try and find a page that was not there and get into a loop generating pages.

Secondly, you maybe be able to contact the spider owner and ask them not ot spider your site anymore.

KG

good idea