It could just be because you're not used to it. Something like that happened to me not too long ago. For most of my life, I stayed inside, but once I started going out again, I got sick!

I was told it happened because I wasn't used to being outside and around other people, so I was more sensitive to sickness. Maybe something like that is happening with you?