The number just says how many manual castes you have set for a specific family, as the tool allows you to do much more than what we are talking about here, like apply several manual castes at the same time (then the number would be 2). The caste you set for inactives is whatever you call it, for example ROTATIONS in my case. For your active family, there shouldn't be any number showing at all. If you set all the options for that caste (ROTATIONS in my case) correctly, like in igazor's and Sarah's examples I linked in the first answer, your sims won't be pushed into a job, because that option is set to "false".
There are other mods that have the potential to push your sims into roles if you set them accordingly, but I excluded this possibility, because you probably don't use other mods.