When the encounter starts, your character's placement relevant to others there is based on a Perception check. So the lower your PE, the closer you'll likely be to critters when the encounter begins.