According to a police report filed by the Calhoun Police Department, Norwood Smith Burnes, 51, undressed in the women's restroom on Sunday in front of several children.
A witness told police Burnes also ordered women out of the restroom as they tried to enter it.
READ: Police Report
Calhoun Police said when they arrived at the store, Burnes was wearing a dark woman's suit, black high heals, red nail polish, green eye shadow and women's jewelry.
The police report said a witness also watched Burnes "show off his white girdle and dark thong underwear" in the women's section of the store.
He was charged with public indecency, disorderly conduct and criminal trespass.
Burnes has been released on bond from Gordon County Jail and a hearing for him is pending in Gordon County Superior Court, police said.