I don't think the ratings should be displayed against the posts at all. Each post should be viewed and judged entirely on its own merit and not pre-judged according to how the highly or lowly the member has previously been rated.
I can't see any purpose in displaying a member's rating against each post unless the intention is to create a prejudice. (Maybe there was no purpose, it was just something that evolved on the site!)
Maybe you should just be able to view a member's rating against their profile and not on the actual forums.
™ Version 4.2