I don't know - either is better than nothing.
I have an iPod Touch and love how sleek it is-- slides in and out of the pocket quite easily. I have been enjoying going caseless, though I do have an invisible shield installed.
After an unfortunate accident at Panera bread that sent my Touch sliding neatly under the nearly inaccesible space beneath the soda dispensers, I've re-thought the "no case" thing. A black silicone case will be here tomorrow.
The iPod's fine, but did require employee assistance to retrieve.
I'd go for silicone or leather if you're worried about lint. I've never seen the point of a rigid case for a phone/iPod unless I'm trying to protect against crushing.