You can’t. The CartoonEdgeFilter works on the entire scene, period.
You’ll have to use something different if you want to apply the effect on only one object.
@thetoucher made a RimLight shader http://hub.jmonkeyengine.org/groups/user-code-projects/forum/topic/wip-video-very-early-rim-light-shader/
Maybe you could use this.