You could make some unexpected changes by removing stuff. The easiest thing is to keep everything that works and make sure you don't have any vacuum leaks. If you're jetted for EGR and you remove EGR, then you have to make carb mods, for example.
If you really want to remove it, do it step by step so you know what is causing any changes you see.
Smog devices get a lot of blame for hurting performance, but most of the stuff under the hood you can yank off won't gain you much. What you really need is good exhaust, some headers or good manifolds (anything is better than the log-style A.I.R. ones) and a good air intake. After that, the thing that is making your engine feel like a "smogged" engine is the crappy heads. It wasn't EGR and A.I.R. that brought performance down, it was lower compression and restrictive heads. A.I.R robs about 2hp max I'm told. You can gain more than by changing fans, or even putting in new spark plugs, for that matter.