Are you washing your hands before testing? Sometimes if you have something on your hand like food particles or sweat, it can really affect the test. You can get alcohol swabs to use if you're testing somewhere that you don't have access to soap and water...I carry those if I'm going on a very long bike ride and planning to test my sugar at some point during the ride.
As far as higher readings first thing in the morning, that can be significant. You might be experiencing higher numbers because of dawn phenomenon.
Dawn Phenomenon: American Diabetes Association® Basically, your body raises your blood sugar to tell you to wake up, which happens to everyone, not just diabetics, but our bodies don't deal with it as well on their own as a non-diabetic. Some people find that eating a snack with protein and no more than 15g carbs just before bed can help. Others might need to switch to an extended-release version of their meds (usually metformin). If it keeps happening, talk to your doctor.
For higher numbers after exercise, you should test an hour after exercise, because it will usually rise during exercise and then decrease afterwards. It depends on the exercise too...personally I find that cardio raises my BG a bit and I don't see any immediate change when I lift weights, but then my fasting BG is lower the next morning.