JAB, the material does not have to be ferrous. Aluminium, Titanium, Copper, ect. will all have a charge induced and will kick away from the coil.
Take a piece of aluminium and put it near the coil, it will shoot away from it.
This doesn't apply to a stationary field, which will not induce back EMF's.
So a permanant magnet will not induce a back EMF unless the field is moving.
It will attract ferro-magnetic materials however.
I worked designing magnetizers for a while, 6000v ones.
Always our problem was when a magnetic assembly had aluminium in it, it had to be anchored down with massive force to prevent it from shooting like a bullet.