TTC with a Husband on Clomid?

We are currently trying for a child. We each have a child from our previous relationships...his daughter is 18 and my son is 10, but we would love to have children together. We have been married since April 2009 and ttc since Dec. 2008. My husband recently was put on Clomid for low testerone levels...evidently it has the reverse affect on men than it does on women. He was always tired, had no libido what so ever, and becoming very impatient with everyone. WE have seen improvements since he has been on it, but still no baby. We are lucky if we TTC once a month, and when we do it's usually around "O" time. The doc has also put him on cialis, but with all of this, still no baby. I am always willing to have sex, being that I have the libido and he doesn't....So, how do we go about ttc with all of these problems? When i talk to my doc about it, he seems to blow me off about, give it time he says....I'm 29, I don't want to wait to much longer. HELP!!!