Can I travel on H4 when I have a approved H1B

[deepaknemo]

My Organization has filed H1 B Visa and it got approved. I have not got the H1 B visa stamped yet. Soon I will be applying for a H1B amendment since I will be travelling for a different location.
My spouse is in USA on H1B visa. I am planning to visit her on H4 visa since am not sure when I will be travelling on H1B.
My question is, can I travel on H4 visa when my H1B amendment is in process.
I want be sure that travelling on H4 does not affect my H1B.