The gunmen came in during noon prayers at the small Sunni mosque in the Diyala province, waving AK-47 machine guns.