Yes.. it will improve over time... your body is adjusting to it... and you could be sweating out all kinds of crap
Remember when you offset the "current" balance of your skin - your chances of breaking out greatly increase.
To help with this... I ALWAYS wash off in the shower, cleanse my face and use a stringent pad on it..