The first part of this paper consists of an exposition of the views expressed by Pierre Duhem in his Aim and Structure of Physical Theory concerning the philosophy and historiography of mathematics. The second part provides a critique of these views, pointing to the conclusion that they are in need of reformulation. In the concluding third part, it is suggested that a number of the most important claims made by Duhem concerning physical theory, e.g., those relating to the ‘Newtonian method’, the limited falsifiability of theories, and the restricted role of logic, can be meaningfully applied to mathematics.