32 bit was big because, for the personal computers, it brought true memory protection and allowed much more complex and stable computing. 64 bit was mainly just more memory, which is certainly useful but not a game changer.

The real difference between a GPU and a CPU is the access to the rest of the hardware. You could do logical operations on both, but a GPU can’t address your hardware so it wouldn’t be overall very useful as the only processing unit.