The magnet is just a small piece of the whole picture.
The importance is the field, 'Flux Lines' - and they never cross, they are aligned in parallel. Thus, in the bigger picture, there is no contradiction....
The nature of paramagnetism is that only in theory is there separate N & S fields. Even subatomic particles consist of pairs - they've never found a 'Unipole', at least on Earth...