It is because they are accompanied by emotions, and they're taking us with them. When a memory can be seen from the position of an objective observer, it is neither heavy nor light; it just is something that once happened. :)