Rahman called on the Bangladesh government to "kick out" the French ambassador while another leader, Hasan Jamal, said activists would "tear down every brick of that building" if the envoy was not ordered out.
"France is the enemy of Muslims. Those who represent them are also our enemies," said Nesar Uddin, a young leader of the group.
Even after the rally was halted, demonstrators marched down other streets chanting "Boycott France" and "Macron will pay a high price".
Last Wednesday, Macron said he will not prevent the publishing of the cartoons under the pretext of freedom of speech sparking outrage among the Muslim world.
French Muslims have accused him of trying to repress their religion and legitimizing Islamophobia.
Several Arab countries as well as Turkey and Pakistan have also condemned Macron's attitude toward Muslims and Islam, with Turkish President Recep Tayyip Erdoğan saying the French leader needs a "mental health check."
