Absolutely a scam. No matter what the caller or your Caller ID said, there is no government agency making unsolicited calls to people to give them money.
If you still have the phone number you can look them up at
www.whocalled.us. good chance that other people have already reported on the caller.