Localization from Semantic Observations via the Matrix Permanent