Technological advancement, environmental concerns, and social factors have made plug-in electric vehicles (PEVs) popular and attractive vehicles. Such a trend has caused major impacts to electrical distribution systems in terms of efficiency, stability, and reliability. Moreover, excessive power loss, severe voltage deviation, transformer overload, and system blackouts will happen if PEV charging activities are not coordinated well. This paper presents an optimal charging coordination method for a random arrival of PEVs in a residential distribution network with minimum power loss and voltage deviation. The method also incorporates capacitor switching and on-load tap changer adjustment for further improvement of the voltage profile. The meta-heuristic methods, binary particle swarm optimization (BPSO) and binary grey wolf optimization (BGWO), are employed in this paper. The proposed method considers a time-of-use (ToU) electricity tariff such that PEV users will get more benefits. The random PEV arrival is considered based on the driving pattern of four different regions. To demonstrate the effectiveness of the proposed method, comprehensive analysis is conducted using a modified of IEEE 31 bus system with three different PEV penetrations. The results indicate a promising outcome in terms of cost and the distribution system stress minimization.