Desperate Remedies by Thomas Hardy — Read

Eight years later, feeling lonely and depressed -- a man without relatives, with many acquaintances but no friends -- Ambrose Graye met a young lady of a different kind, fairly endowed with money and good gifts. As to caring very deeply for another woman after the loss of Cytherea, it was an absolute impossibility with him. With all, the beautiful things of the earth become more dear as they elude pursuit; but with some natures utter elusion is the one special event which will make a passing love permanent for ever.

This second young lady and Graye were married. That he did not, first or last, love his wife as he should have done, was known to all; but few knew that his unmanageable heart could never be weaned from useless repining at the loss of its first idol.