From the pic, I doubt it's worth sleeving. Looks pretty normal. You can also clean it with scotch brite.
As said, if you can't catch it with your fingernail, and it's totally free of burrs that could tear up the new seal, u should be good.
Fordum had a good suggestion about driving the other seal a little shallow so that it rides in a different spot. This should work if you're concerned about it. I would add that if you're not driving the seal in fully, be sure to put a little RTV between the OD of the seal and the housing to keep oil from leaking. I do this anyway, but especially if shallow-seating.
Edit: As for de-burring, I usually go at it with scotch brite and steel wool. Seal needs a smooth finish. One trick is to rub a used dryer sheet around it. If it pulls the dryer sheet apart, keep polishing.