> Don't integers, then, denote direction in addition to magnitude.

No. The minus sign is an operator, the number is the magnitude.
The + sign is forward, the - sign is backward, BY CONVENTION.
Thus the vector (3, -5) is (3 * +1,  5 *-1) where the vectors are
+1 and -1 and the scalars are 3 and 5.