Adjustment of Status - I-485

So my husband is my petitioner and he works for the cannabis industry here in Colorado . We had our green card interview on September 25th where he forced me to admit my single (!) use of weed which happened while I was still an aupair 9 months ago . I went through a testimony for that single use and he made me sign on that . Since then we received an RFE for a joint sponsor form since they don’t recognize his job and his income as legal federally wise.
  We booked our trip to my homecountry and we are supposed to leave in a month. Some lawyers advise me to cancel that because ,EVEN WITH THE ADVANCE PAROLE/EAD , they said the testimony is in my file now and I may have trouble re-entering the country . It is urgent to go home and I have zero convictions or anything in my record . Could the customs at the Denver international airport stop me and send me home ? Is anyone here familiar with this ? Any advice is very welcome . The situation is very special and I am scared to leave the country even though my green card application is pending and I have the advance parole .
Thank you