After graduating from high school, Francis Rauber served for two years in the Pennsylvania National Guard before enlisting in the Marine Corps in 1921. on September 1, 1959 he was assigned the billet of Sergeant Major of the Marine Corps, the second person to hold that newly-created highest enlisted position in the Marine Corps, and served in that position until his retirement on June 28, 1962.