In this article I consider how the problem of social (intersubjective) cognition relates to time-consciousness. In the first part, I briefly introduce Husserl's account of intersubjective cognition. I discuss the concept of empathy (Einfühlung) and its relation with time-consciousness. I argue that empathy is based on pre-reflective awareness of the other's harmony of behaviour. In the second part, I distinguish pre-reflective (passive) and reflective (active) empathy and consider recent empirical research in the field of social cognition. I argue that these levels of empathy are related with different levels of intersubjective temporality. By the intersubjective temporality I do not understand being in the same moment of objective time (so called clock time) but rather the shared experience of time and sharing temporal structure of actions. In the final part, I gather my considerations together and propose a general three-level framework of intersubjective temporality.