Just dealt with something along these lines. Back in the day purchased some of the "cheap" lifetime warranty brake pads. Due to improper bleeding, I wore one side down to almost nothing since it was doing all the work.
Got new pads, installed them, bled properly, tested, all seemed good. Can't remember what drove me to remove the calipers again, but I had to. Pulled the calipers and noticed the anti squeak (?) pads had come apart. They look something like this:
But two of those pieces (steel) per pad. They aren't bonded, they are just a "press" fit, and are not spring steel. So they fall off once you take the caliper off the rotor.
ANYWAY, I noticed after putting the pads back together and forcing them onto the rotor (caliper piston was fully compressed) that there was noticeable drag when attempting to rotate the tires. Noticeable as in you couldn't spin the tire. You could rotate it, but it took quite a bit of effort. Took everything back apart, took one of those pads off each side, reassembled, and while there is still drag, it is slight and the wheel can gently move.
My highway mileage went down 3MPG (one reason I check each time I fill up), that seems to have coincided with the brake pad change, so I'm hoping that the amount of drag was significant. I'm going to watch mileage next time I drive it.