When I used to do AI work using Neural Networks, there was a technique where you would selectivly prune connections between neurons in the network and retest your trial data set to see of performance improved.
This technique was called "Optimal Brain Damage"