In the "real world", height is usually a measurement of vertical distance.
In mathematics, it generally applies to three dimensional figures such as prisms and pyramids. In mathematics, height does not necessarily have to be vertical.
The height of a prism is the distance between the bases.