This paper proposes an extension of the sequential scene analysis system presented by Hager and Wegbreit. In contrast to the original system, which was limited to scenes consisting of geometric primitives, such as spheres, cuboids and cylinders computed from range data, the extended system is capable of dealing with arbitrarily shaped objects. An object model consisting of triangulated geometry and intensity-based SURF features is introduced. The integration of prior object models into the sequential scene parsing framework is described. The extended system is evaluated with respect to pose estimation and its ability to handle complex scene sequences. It is shown that the new object models enable accurate pose estimation and reliable recognition even in highly cluttered scenes.