2009 kx250f head issue

so im in the process of rebuilding everything in the top end of my bike... (in the put it all back together stage) and there seems to be like a little burr/slice in the left side exhaust area (like where you put the springs and all that in. its on a "finished" part of the head, kinda where the bucket slides down on top of the retainer. anyways it makes the sliding down of the bucket kinda rough when going past it...like it grabs just a tad and the bucket doesnt come back up very easy either.

my question is would there be a way to fix it? or should i just leave it be, the bucket sits right below it so when the lobes come around the bucket can only go downwards. just wondering if its gonna be a major issue...

thanks!
brandon