The Yang-Mills theory of gauge interactions is a prime example of interdisciplinary mathematics and advanced physics. Its historical development is a fascinating window into the ongoing struggle of mankind to understand nature. The discovery of gauge fields and their properties is the most formidable landmark of modern physics. The expression of the gauge field strength as the curvature associated to a given connection, places quantum field theory in the same geometrical footing as the gravitational field of general relativity which is naturally written in geometrical terms. The understanding of such geometrical property may help one day to write a unified field theory starting from symmetry principles. Of course, there are remarkable differences between the standard gauge fields and the gravitational field, which must be understood by mathematicians and physicists before attempting such unification. In particular, it is important to understand why gravitation is not a standard gauge field. This book presents an account of the geometrical properties of gauge field theory, while trying to keep the equilibrium between mathematics and physics. At the end we will introduce a similar approach to the gravitational field.