HTML stands for HyperText Markup Language. Hypertext expresses the idea that you can click on what you are reading to jump to something else which is related. This is the same hyper in hyperspace that the characters in your favorite science-fiction story are always jumping through. The idea is to go immediately to a distant place. In the case of documents, you are going to a place which may be far away in whatever scheme is normally used to order the documents.
HTML is a way of expressing hypertext, but the idea is older. The first mention is probably Vannevar Bush's description of Memex in 1945. The term was coined by Ted Nelson in 1965, and was popularly embodied in the HyperCard application shipped with the original Apple Macintosh (from Fact-Index.com).
Links in HTML can be absolute, as is the one above, or this one about John Von Neumann. Links can be relative, such as to the previous demo page which is in the same directory (folder). You can also make relative links to lower directories starting from where you are like this. You can also use the .. convention to make a relative link up, such as this one which goes back to Chapter 4.