AI firms lack safeguards against self-goal-setting, watchdog warns NYC Council

Jacob Coxon, an integrity watchdog, testified before the New York City Council that leading AI companies do not know how to prevent AI systems from setting and pursuing their own goals. The claim is an expert warning rather than a documented incident, and its significance lies in highlighting a governance gap in AI safety.