The dark night of the soul refers to an extended period of acute purification that a spiritual practitioner undergoes immediately before making the final transition to deep spiritual awakening. It emphasizes purification and the act of letting go of what no longer serves after many lesser trials have been navigated.
The whole thing boils down to giving ourselves in prayer a chance to realize that we have what we seek. We don't have to rush after it. It was there all the time, and if we give it time, it will make itself known to us. There is in all this a sense of the unfolding of mystery in time, a reverence for gradual growth.