Compact polarization-based all-optical interconnection systems with growth capability