Did i do the right thing today?

me and my gf went to walmart this morning to do our shopping... anyways we were leaving the store and noticed these two wanna be thug guys walkin and staring and i looked at one and he started talking all kinds of trash about where hes from and how hed f me up and then by that time my girl grabs me by the arm and we go back to the car...did i do the right thing about walking away? or should i have knocked his teeth in?