The Georgia Bureau of Investigation arrested James Tohal Tuesday after investigators were tipped off to the relationship when the woman reported that Tohal assaulted her with a knife at her home in Franklin, Ga.
GBI agents then went to the Newnan probation office to look into the attack.
GBI agents said when they went to interview Tohal, he grabbed his grabbed his gun and fled out of the office.
Police searched for Tohal all over the state. Finally, investigators said they were notified Tohal had been spotted in Meridian, Miss.
The local police department there took Tohal into custody and is awaiting extradition back to Georgia. He has been charged with violation of oath of office and aggravated assault.