The aim of our contribution is to extend existing knowledge about differences in problem solving between students of different grades in a particular task which requires state space search. Benefits and limitations of developed methodological tool which allows automatic collection of data are also presented.