Dividing by m yields: (m-1)!=m^2-1

Dividing by m-1 yields: (m-2)!=m+1

Dividing by m-2 yields: (m-3)!=1+3/(m-2)

3/(m-2) must be an integer>3, so m=5.