To be honest, I've got the same issue (well, many issues, this is one of them lol) so I'm not going to be much help. I know my setup is all wrong because the engine is so far from stock, and I've got marginal injectors, so this will be one of the last problems I tackle, IF solving the other issues doesn't fix it.
First things first, have you done a good visual inspection of the engine bay? Making sure no wires are out of place, disconnected, frayed, so on?
Do you have a scantool? I'm wondering if this is more or less prevalent based on outside temperature? If the engine thinks it's warmer than it is, it may be trying to go closed loop or simply bumping the idle down before the engine is really warmed up. This would likely be evident moreso in cold weather than warm. But I'd confirm it with a scantool instead of replacing.