Although not totally what you are looking for as it wont test custom applications, Nikto <http://www.cirt.net/code/nikto.shtml> has a decent arsenal of _generic_ test. And knowing that at least someone on the Internet may run it against your site, it might as well be you. ;-) Flavio