Swapping caps would never have solved this as the caps are designed to vent to atmosphere, not prevent vacuum. Pre-EVAP they were, but you can't get those caps anywhere I've ever seen. I made my non-vented cap vented, and promptly realized filling the truck to full and getting it nose up meant I was dumping fuel, which amazingly is worse for gas mileage than burning it.
The only way the tank is collapsing is that it's not able to draw air as it should, which would be through the EVAP system.
Now that your cap is no longer functional, doing something simple like unplugging the EVAP canister after driving wont tell you anything. If unplugging the tank to EVAP line vented the tank, you'd know the canister isn't "breathing" properly.