Lolz. I checked the admin site of my pet AppEngine project awhile ago, to discover that I was at 50% of quota on frontend instance hours for the 24-hour period ending in another 4 hours.
Since the app is far from finished, and I haven't published about it, I was wondering who on Earth was using it... and why so much. As it turns out, the GoogleBot was indexing the pdf file that I had uploaded... repeatedly. I don't know if there is something wrong with how I've linked to the indicated file, or whether it's simply too big for the bot to digest, or what, but I've finally found the motivation to update my robots.txt file!
No comments:
Post a Comment