Small momentary push buttons can be difficult to understand, however if we look inside we can easily gain an understanding of their operation.
AS you can clearly see the black button portion pushes down on the thin disk. The center of the disk deforms and makes contact between the two contact strips. The disk also provides the spring return action and makes the clicking noise.