Collect wall points into walls and place them in a wall grid