H4 Visa Confusion

[ramainside]

I am priya from Chennai. I am going to get married on Jan2006 and my wouldbe will be leaving to US(H1B visa) on Apr 2006 and this is the first time he is going abroad. Will it be possible to take me along with him? His H1B visa interview is on Feb 2006. So once he got his visa confirmed, shall I start applying for H4 visa. Is it possible for me to accompony him? Or else first he have to go there and then only I will be able to file my H4 visa for joining him?
Kindly help me in getting my doubts cleared.