Inflammatory fibroid polyp (IFP) is a rare benign tumor originating from the submucosa of the gastrointestinal tract. Most are found in the stomach, with only one previous case reported in the rectum. IFPs are typically larger than 1 cm in diameter and present symptoms. Colonoscopic examination of an asymptomatic 66-year-old man revealed a small submucosal tumor, 3 mm in diameter, in the rectum. The lesion was completely resected by endoscopic submucosal dissection (ESD) and was histopathologically diagnosed as IFP. We report herein a very rare rectal IFP that could be treated and diagnosed with ESD.