Speakers don't have a real ground, the wires just go to a coil of wire that wraps around a magnet (well, very close to the magnet but not touching it so it's able to move). The only reason they have positive and negative markings on the speaker is so that all the speaker cones move in the same direction. Otherwise if you had some cones moving in while others were moving out then they'd be out of phase and sound kinda funny, i.e. some of the sound waves would get cancelled out.
You can use an ohm meter to check which two wires on either speaker have 0 ohms. Just connect one probe from the meter on one of the left speaker wires and the other probe to one of the right speaker wires until you find two wires that read 0 ohms. That would determine the 'negative' or common wire. Or the 'negative' wire will have a black stripe or some other identifying mark to let you know they are the same.