Opening Vim in $PWD without a file name (think scratch pad) will open
.swp, which is not matched by *.swp