I guess I had been pronouncing it correctly all along,
but I never knew the story behind it.

There is a right way and a wrong way to pronounce Oklahoma.
 

The proper way is: Okla . . . Homa 
(There's a pause between the 'a' and the 'h'.) 
 

See the reason below.
.
.
.
.
.
.