If they are still in specs (enough meat left to turn them )- but you'll end up with some of a groove after turning them to the limits,it "might" not be enough of a groove to cause braking issues ,although at first it'll take awhile for the linings to wear into the groove and "bed in"....or,it might end up leading to problems with the brakes locking too easily or grabby,in that case replacing the drums is best..once they are turned to the maximum diameter they are more prone to warping and cracking..
In the past when I worked at parts stores and had access to a brake lathe,I turned many of my drums down until the grooves were gone,and despite going a bit beyond the "discard" limits,I didn't have any trouble with warpage or cracking...rear drums dont usually do as much braking as the front ones and run a bit cooler..
I never towed anything though..