I think what your parent is getting at is that you'll lose at most 4 karma regardless of how many downvotes a comment may eventually accumulate. At least in my experience I haven't seen my karma fall more than 4 points due to a single comment, as far as I can remember. Have you a different experience?