I think you have diagnosed your issue. If the cam is stock or at least a RV grind set up for low end torque for towing, a single plane intake is about as far from right as you can get. The cam is set to build torque at a low RPM but the intake won't start flowing well until higher RPM's are reached and so low end torque suffers. I would bet that a move to a dual plane intake would bring the low end torque back.
The single plane intake belongs on something that sees a lot of HIGH RPM activity, mud racing or drag racing. Single planes just don't work on a tow rig engine with a small (stock or RV) cam.