"Macron is one of the few leaders who worship Satan," Ataur Rahman, a senior Islami Andolon figure told the rally at the Baitul Mukarram national mosque.
Rahman called on the Bangladesh government to "kick out" the French ambassador while another leader, Hasan Jamal, said activists would "tear down every brick of that building" if the envoy was not ordered out.
"France is the enemy of Muslims. Those who represent them are also our enemies," said Nesar Uddin, a young leader of the group.
Even after the rally was halted, demonstrators marched down other streets chanting "Boycott France" and "Macron will pay a high price".