Atomic operations: under the hood

How do atomic operations work, under the hood?

Are atomic operations so-called "wait-free"?

I'm seeking for a description of the "least common divisor" of atomic operations. What do all atomic operations share?