Riemann's paper "On the hypotheses that lie at the foundations of geometry' is one of the fundamental papers in the creation of modern geometry. We analyse its content, look at the influence the work of Gauss and Herbart exercised on Riemann, and discuss other of Riemann's papers that shed light on his ideas, in particular on his appreciation of the concept of curvature.