Speaking at a meeting of the right wing Bow Group, Mr Portillo said Tim Brighouse believed 'parental preference to be insidious'.
He mocked Professor Brighouse for not using the word teaching but referring instead to teachers providing 'expertly organised learning experiences'.
The former MP added: 'The goobledygook of academia can be dangerous.'
'I'm totally in favour of parental choice but the fact is that parents have been misled into believing they have choice when all they have is parental preference.'
About trying not to use the expression teaching, Mr Brighouse said: 'I was trying to say that children do not only have lessons, they also have residential courses, they take part in dramatic activities, games and a set of experiences in school including taught lessons.'
Mr Brighouse said former education secretary John Patten had attacked him before and had to apologise and pay damages for his comments.