Is anyone else having trouble with thier Seidio Skin picking up lint/dust/fibers from the felt inlay of the Seidio holster?

Is this inherant to all rubber skins? Am I wrong to see this as a downside?