The problem is that there’s no existing law that would effect this on its own. To my knowledge, no country in the world has a law on the books specifically dealing with AI models trained on CSAM. So the question, under existing laws, would turn on whether the data stored within the model itself would constitute CSAM.
CSAM laws are already overreaching in dimensions that are rife with abuse. It’s rare to have a law where owning a picture of something is highly illegal. It’s the only law I know of where somebody can just send you a picture on your phone, and suddenly, you’re breaking the law. You could be arrested and thrown in prison for even admitting that somebody else sent you the picture.
Police use CSAM as an excuse all the time to search without a warrant. Remember the duress passcode case? Police claimed he had CSAM on his phone, when everybody knew they were targeting his activist work.
And what should we really care about? The CSA. Go after the CSA. Focus on the abuse. The Epstein files are right over there.