The memory-robbing illness has long been believed to be caused by a build-up of amyloid and tau in the brain. These clump together and form plaques. The memory-robbing illness has long been believed to be caused by a build-up of amyloid and tau in the brain. These clump together and form plaques.