Certainly not! Now, this is a bit tricky so it is hard to be succinct.
The denotative meaning of a curse is a word or expression that is used to wish some misfortune on another. So the word "hell" may be included within a curse (I wish you would go to to hell), but it is not in itself a curse word. In its primary meaning, it is a noun that names a place or state of punishment for the wicked once they end their lives here on earth. Any unabridged dictionary (for example, Random House Websters) will give another twenty or more meanings for the word, all of which present it as an interjectory word (expletive) within a phrase or clause
Because the word is an expletive, some individuals assume it is also a form of vulgarity, as other four letter expletives may be. But not all expletives are vulgar. In semantics, the word "expletive" simply means "interjectory" or "exclamation".
So, the word "hell" is neither a curse word nor a vulgar expletive but rather an interjectory expletive in very common use.