Gourmet_DAO In my style of storytelling, the world reflects the characters, and the characters reflect the world.
Take for instance Billy, and how we introduce him. We use no description of his character, just descriptions of his surroundings. He visits a run-down store, filled with fatigued people, and barely says a word as he pays for a sub-standard soda. We can say a lot of things about Billy that give context to a broader story, and because we create these ideas in the reader's head, we don't create confusion later, when Billy is mugged. Why was Billy mugged? He was clearly not in a great part of town.
We can use physical traits, like being handsome, to play into or against certain expectations. Readers might first think a character has an easy life, because they're handsome. They might think they're sociable, or affluent. By setting up those expectations with a simple word like 'handsome' we can do our own twists. He was handsome, but airheaded. He was handsome, but unlikable. Details like those help create robust characters that either stick in the mind for their uniqueness, or add color to the world our protagonist travels: "Being handsome was considered a curse, it troubled him greatly," etc.
And I'll mention that prejudices based on appearances, such as clothing, skin color, hair color, eye color, etc have existed for thousands of years. The way someone looks does have, and should have, an effect on any story where humans are being sociable. By addressing these things and including them in our stories, we create worlds that are relatable to things actual people go through every day. Some fantasies try to get as far from that as possible. I approach it and explore it.
I agree with you, 'write to the fool, write easier' is a good saying. I also believe in 'write whatever you want, and your work will find its audience.'