An Alabama high school teacher was arrested Thursday morning after he was allegedly found holding a gun inside the school and allegedly setting part of the school building on fire, police said.

Investigators said school officials found LaGregory Thomas, a staff member at Saks High School in Anniston, Alabama, holding a gun inside the school just before 8 a.m. Behind him smoke could be seen coming from a wrestling room, which police believe was set on fire by Thomas.

The school’s principal confronted Taylor and took his gun away without a struggle.

What led to Thomas allegedly setting the building on fire was not immediately clear.

Police said Thomas was charged with arson and criminal mischief.