Grounding Language Models for Compositional and Spatial Reasoning