General Chicken answers a question from Quora.

Read John Dee's answer to What does robot.txt look like in WordPress? on Quora