The first album was released in 1964 (5 years prior to the official opening of the Haunted Mansion attraction). It became so popular that Disney re-released it in 1973 and again in 1976. I don't have a copy of the 1964 version, [It's easy enough to find on eBay, but I try to limit some of my collector's tendencies by allowing things to 'find me' and stumbling across them in thrift stores is a great thrill!] but I do now have copies of the 1973 and 1979 printings!
The 1973 version has an orange cover and my particular version does not have the yellow sunburst on the left corner pointing out the 'spooky party hints'. This was a slight change from the original pressing which has a white cover. The album in it's entirety is posted as a free download here, in MP3 files.
The 1979 cover was entirely new. It features a scene from the graveyard with a skeleton who is working his way out of the coffin and a crow standing sentry from the tree limb. This, of course, is very similar to scenes from the Haunted Mansion attraction. You can download a free MP3 version of this album here, courtesy of Brooklyn Vegan.
For everything you'd ever want to know about the Haunted Mansion, check out Doombuggies.com, where I found their history of these various "Chilling, Thrilling" recordings. *It's worth noting that Doombuggies.com cites the release of the final album as 1979, however wikipedia says it was 1976.