The seasonably cool conditions will stick around through the weekend