"Let's make things interesting then. Come find me in the waking world and see what happens. Unless you plan to take this memory from me as well—coward that you are." In the background he is constructing internal wards, barriers made of whatever metaphysical material he governs in this realm, to keep her out. In case that doesn't work, he takes his memories of her and all he knows about her and shoves them as deep into his mind as possible, where even the finest dream cultivator could not access them.