Is there a performance penalty in using bounding capsules over boxes?
Only performance penalty will be that Capsules aren't complete. 
In all seriousness, once Capsules are finished, they should be faster than boxes. Capsules are defined by two points and a radius. Most calculations for interesection are very similar in speed to Sphere.