What was I scared of?

The narrator is frightened by a pair of pale green pants with no one inside that seems to be following him, until the two meet and discover that they have nothing to fear.