Not sure when this got added, but you can now see the ip’s most accessing your app, and hopefully you can block someone from using up your quota.

http://code.google.com/appengine/kb/general.html#blacklists