If it's rated at 5000 lbs, that's the rating. You put a winch rated at 8000 lbs you're exceeding the capacity. Yes, you may not be using the winch to capacity, but do you know what your winch is pulling at any time, most likely not.
Now all that being said, 5000 lbs rating... there...