I was playing with TestDebugGameState a bit (toggled lighting, etc) and could not see any difference in the scene when I pressed 'b' to toggle bounds. Is this supposed to give a view like that when debugging jme physics?

Normally yes

but the TestDebugGameState has no bounds applied to the box so you won't see any.