Optimization techniques play vital role in many problems. Many optimization algorithms have been proposed in past decades. In this paper various optimization techniques like Particle Swarm Optimization, Modified Particle Swarm Optimization, Artificial Bee Colony Algorithm, Fish School Search Algorithm and Gravitational Search Algorithm are compared and tested in an IEEE-14 Bus power system. By using these five optimization techniques, the power losses like active power and reactive power are reduced drastically. By reducing the losses, the voltage profile improvement and voltage stability enhancement can be maintained. Also this paper shows the better optimization technique which suits the power system to maintain stability by reducing power losses. The results are tabulated to show how much losses have been reduced from the determined actual losses in the power system.