Adjustment of Status - I-485

Hi guys I really need help I filed asylum back in 2014 and the Immigration Judge denied it and put me on Deportation than Appel with BIA And they also denied it so I got married to my long time girl who's is USA Citizen and we filed i130 iI-485 ,I 765 in August 29,2016 then I got my EAD. 5 December 2016. then we went for first interview 29 June 2017 the Officer didn't approved it he says we will hear from them 120 days on the paper after 60 days on waiting we got letter saying we should come for second interview on 13 spetemeber And I contact my lawyer who flied for me and he told me I should have file only the i130 first since I was put on Deportation by immigration Judge and if I'm not lucky this time if I go for the interview they might arrest me and deport me to Ghana I will like to know if anyone has this issue before and whats the best solution for me I am scared now help me guys