In his younger days, James Miller was a War of 1812 officer, known as the Hero of Lundy's Lane.
Included in this article:
"...he [Hawthorne] tells how the gallant old general would slowly and painfully ascend the Custom House steps and with a toilsome progress across the floor--for the step was palsied now that had been foremost in the charge--attain his customary chair beside the fireplace.
"...[in] the private office of the present chief executive [of the Custom House], the genial Collector Waters-- a portrait of the hero of Lundy's Lane now looks down from the wall upon the visitor; but no picture of Hawthorne is to be found in the edifice. [Source]
Between those two careers, James Miller was Governor of the Arkansas Territory. He died in 1851.