Allow your cat to become comfortable with you before you try to scruff him.