There was a period, two-and-a-bit years ago, when it seemed as if James Graham were on a one-man mission to take over