The increasing use of abdominal imaging has led to a growing incidence of traditionally uncommon pancreatic tumors. These rare tumors have specific imaging features whose knowledge may heighten confidence in characterization and may avoid unnecessary surgical procedures when imaging findings suggest a benign condition. Computed tomography (CT) is the modality with which rare pancreatic tumors are incidentally detected in the majority of cases. Magnetic resonance imaging (MRI) is often performed as a second line examination for further characterization. This review provides an update on CT and MRI findings of rare tumors of the pancreas.