Here's a great link on the topic.
http://www.vet.cornell.edu/fhc/brochures/ZoonoticDisease.html
The bottom line is that it's probably safe for you, and it would be best to have older cats (not kittens) that are indoor-only cats and eat processed food
A lot depends on your history of infection frequency though too - if you are already displaying more frequent infections or not. If you are fairly average in infection frequency, then chances are good that you would be safe with some cats.
If you could have hubby clean litter box(es) then that would be even safer but it's quite safe to do it yourself too.
http://www.vet.cornell.edu/fhc/brochures/ZoonoticDisease.html
The bottom line is that it's probably safe for you, and it would be best to have older cats (not kittens) that are indoor-only cats and eat processed food
If you could have hubby clean litter box(es) then that would be even safer but it's quite safe to do it yourself too.