Is Mount Airy safe for solo female travelers?

I live downtown which is a very safe area during the day. The closer you get to downtown I’d say the safer it is at night, but drugs are not uncommon around here in any part of town. I have seen and heard people walking around yelling to themselves, which is scary because they are unpredictable. They don’t usually even seem to see you but still scary. The people that live here are typically nice people, but there is not a lot of night life, so the streets are pretty sparse by 8pm.