In this extended abstract, we present initial work on intelligent object stacking by household robots using a symbolic approach grounded in image schema research. Image schemas represent spatiotemporal relationships that capture objects’ affordances and dispositions. Therefore, they offer the first step to ground semantic information in symbolic descriptions. We hypothesise that for a robot to successfully stack objects of different dispositions, these relationships can be used to more intelligently identify both task constraints and relevant event segments.