High-performance perovskite solar cells have attracted increased attention for photovoltaic applications and potentially replacing the predecessor generations. Nevertheless, the stability issues and the lead content has always been among the major concerns that barriers perovskite solar cells from commercialization. This review presents the discussion towards the inherent instability of perovskite solar cells and the development towards replacing lead with discussion towards their performance and challenges. The degradation of perovskite active layer would release toxic substance into the environment. The development towards low-toxic, lead-free and efficient perovskite solar cells is the key for a sustainable solar energy generation with the application of perovskite solar cells.