FoREST: Frame of Reference Evaluation in Spatial Reasoning Tasks
Published in Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing (EMNLP 2025 Main), 2025
We introduce FoREST, a benchmark designed to evaluate Frame-of-Reference (FoR) comprehension in spatial reasoning tasks. Results show major gaps in FoR understanding across LLMs and text-to-image systems, and our Spatial-Guided prompting method improves their spatial reasoning performance.🏆 SAC Highlight Award.
Recommended citation: T. Premsri, P. Kordjamshidi. "FoREST: Frame of Reference Evaluation in Spatial Reasoning Tasks." In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.
Download Paper
