I pierced my nose with a piercing kit from Hot Rags...?

You should of went to a piercing place to get your nose done.. i had mine professionally done and its all healed up nicely and whatnot.. I dont think there is much you can do if the stud you have in doesnt have a back on it.. it would have like a thicker end to the stud so it doesn't fall out.. You can try to put a bandaid on it when your out running, but if you do that make sure you take it off when you get home and you don't pull the stud out.