Personally I feel that masturbation is the greater evil. If you sit down and look at pornography, you are being tempted. If you walk away, you have achieve victory over that temptaiton. But to go to the next step is to give in to that temptation, which is where the real damage takes place.
It's also a form of idolatry, because the sexual image becomes a thing of worship and desire.