It could be both. I'd take the bolt out, and pull that top piece off (might need to wack it with a piece of wood). Then take a look at both pieces to see if they're worn, chances are if one is...so is the other. Good luck.
1997 XLT SP 600

1997 XLT SP 600