Totally agree that we view stories, especially novels, with fresh eyes on re-reading. I don't think it's just what we take from the reading. As we grow as writers we see more of the handling of technical detail by the author.
However... "someone who annotates their books heavily..." Argh!