It can be very difficult to deal with someone with full blown OCD, as I know from experience. The standards are one thing, and it's more an argument within themselves as opposed to the actual project, which can be a nightmare when it's a DIY issue.
Now, you need not go without your plants growing in the house, especially if it gives you joy. You can purchase an indoor plant cart with grow lights that's pretty compact. It's compact enough that I know someone who has one in a Manhattan kitchen for her herb garden. Hers is a chrome four-shelf affair with integral lights and actually is pretty stylish. There's a website called urbangardensolutions.com that has a few models of ready-made plant starter carts and shelves, such that I think you might be able to find one that would allow you to have the joy of gardening while allowing for your husband's design aesthetic with respect to the standards in your home.
Good luck with the project, and I hope you can find a solution that works for the two of you.