Orderly power utilization (OPU) is an important measure to alleviate contradiction between supply and demand in a power system peak load period. As a load management system becomes smarter, it is necessary to fully explore the interactive ability among users and make schemes for OPU more applicable. Therefore, an intelligent multi-agent apanage management system that includes a mutual aid mechanism (MAM) is proposed. In the decision-making scheme, users’ participation patterns and the potential of peak shifting and willingness are considered, as well as the interests of both power consumers and power grid are comprehensively considered. For residential users, the charging time for their electric vehicles (EVs) is managed to consume the locally distributed power generation. To fully exploit user response potential, the algorithm for improved clustering by fast search and find of density peaks (I-CFSFDP), i.e., clusters the power load curve, is proposed. To conduct electrical mutual aid among users and adjust the schemes reasonably, a multi-objective optimization model (M2OM) is established based on the cluster load curves. The objectives include the OPU control cost, the user’s electricity cost, and the consumption of distributed photovoltaic (PV). Our results of a case study show that the above method is effective and economical for improving interactive ability among users. Agents can coordinate their apanage power resources optimally. Experiments and examples verify the practicability and effectiveness of the improved algorithm proposed in this study.