The aim of this study was to explore the possible mechanisms of Ficus carica leaf (FCL) extract in suppressing hepatic gluconeogenesis in diabetic mice. Diabetic mice (streptozotocin-induced) received 1 g/kg of FCL extract twice a day for 6 weeks. Fasting blood glucose levels were measured and a 2-h oral glucose tolerance test was conducted. AMP-activated protein kinase (AMPK), phosphoenolpyruvate carboxykinase (PEPCK), glucose-6-phosphatase (G6Pase), and peroxisome proliferator activated receptor-γ coactivator-1α (PGC-1α) expression was examined. HepG2 hepatocytes were treated with FCL extract and an AMPK inhibitor (compound C) or agonist (AICAR), and PEPCK, G6pase, PGC-1α, AMPK, forkhead transcription factor O1 (FOXO1), and hepatic nuclear factor 4α (HNF4α) expression was determined. The results showed that FCL extract inhibited the expression of PEPCK and G6Pase in the liver of diabetic mice and HepG2 hepatocytes. FCL extract activated AMPK and decreased PGC-1α, HNF4α, and FOXO1 expression. The AMPK inhibitor attenuated those effects through inhibiting gluconeogenesis, while the AMPK agonist partially enhanced gluconeogenesis. In conclusion, FCL extract inhibits hepatic gluconeogenesis via activation of AMPK and down-regulation of gluconeogenic enzymes.