Under the banner "Not in my name," hundreds gathered in a square in the centre of the Italian capital where they held a minute's silence for the victims of jihadist violence.
Rome, like many European capitals, has ramped up security since the Nov. 13 attacks that killed 130 people in Paris.
There have been isolated episodes of violence towards immigrants around Italy and right-wing politicians have called on the country's Muslims to show their rejection of militancy.
MUST READ: The mystery of missing Paris attacker Salah Abdeslam
MUST READ: Tapped phone led Paris attack leader to his death
"These terrorist groups are only creating hate between peoples and between religions," said Mustapha Hajraoui, president of the Italian Islamic Confederation.
MUST READ: Muslims who fight for the West
"We are here to say 'no' because our religion is not a religion of terrorism, it is not a religion of war but of peace and coexistence."Marchers chanted "no to terrorism", held placards saying "terrorism is a cancer" and "we are not the enemy", and listened to a message of support from Italian President Sergio Mattarella.
MUST READ: Two men kept from boarding US plane after speaking Arabic
Numerous Italian politicians attended the event, including Khalid Chaouki, a deputy of Moroccan origin from the governing Democratic Party, who has been put under police protection due to repeated threats against him since the Paris attacks.
Similar rallies were held in Milan and Genoa.