Most Sepharadim won't give muslims the time of day because they are fully aware of their Sephardic heritage. Look, being a dhimmi is not a bad gig in the Muslim world, if the other option are pogroms in the Christian world. But it is not something most Jews would be interested in if given the choice.

There is an anecdote particular to my own heritage where the King of Morrocco in World Word Two refused to hand over "his Jews" to the Germans to be sent to death camps (unlike what happened in Tunisia). That is very nice, but until after WWII most Jews had few, if any civil rights in Morrocco. It is only really the older generation of Sephardim who suffered the many dislocations after WWII that look back at the supposed tolerance they enjoyed in the Muslim world with rose-colored glasses. Most of us know better.