How to Build Memories