Calcium, magnesium, phosphorous, iron are the good metals, serving many valuable functions in the body.
The problem with heavy metals like lead, mercury and others is that they can replace the good metals in the body.
Cadmium can replace zinc, and lead displaces calcium, these are just two examples.