When Ogden was six years old, his family moved to Indiana. He began studying music in local singing schools at age 8, and could read church music fairly well by age 10. A little later, he could write a melody by hearing it sung or played. When he was 18, he became a chorister in his home church.

At the outbreak of the American Civil War, Ogden enlisted in the 30th Indiana Volunteer Infantry. During the war he organized a male choir, which became well known throughout the Army of the Cumberland.

After the war, Ogden returned home and resumed his musical studies. Among his teachers were Lowell Mason, Thomas Hastings, E. E. Baily, and B. F. Baker, president of the Boston Music School. As his skills developed, Ogden issued his first song book, Silver Song, in 1870; it became immensely popular, selling 500,000 copies. He went on to publish numerous other song books.

In addition to composing, Ogden taught at many schools in in the United States and Canada. In 1887, he became superintendent of music in the public schools of Toledo, Ohio.