It may be superficial to reject someone because of physical imperfections, but I wouldn't call it wrong unless the old "I want a guy with personality" cliche gets trotted out. Lets be honest here: We're a superficial society. Human's are inherently superficial. It's not necessarily a bad thing, just unfortunate at times. Everyobdy's superficial. We all make initial judgements of people based upon what they look like without even thinking about it.
While I couldn't come up with any sort of data to back this up, because it's impossible, I'd say most people are almost always intially drawn to someone because of looks, and this is just a fact of nature. But rejecting someone because of looks isn't any sort of spiteful act (although the example X-Man brought up did seem rather spiteful), it's just a reaction. People try to idealize their life, and if they don't find someone attractive they're not probably not going to date them. Physical attraction is a major part of a relationship. The way I see it, there are three parts to a relationship: a physical attraction, an emotional attraction, and an intellectual attraction. If one of the three is missing, it's going to be tough to maintain that relationship (although I think emotional is the most important of the three: mutual emotional attraction can supersede an intellectual or physical lacking).
Post a response to this discussion thread