OpenAI and Poland’s NASK collaborate on AI safety research

BENGALURU (Oct 23): OpenAI said on Friday that it will work with Poland’s NASK National Research Institute to study how to make artificial intelligence (AI) safer and more secure. The partnership comes as more AI agents, which are AI systems that can carry out tasks on their own, have been acting in unexpected or harmful ways. These incidents have raised concerns about AI safety.

Under the agreement, NASK’s AI Safety Research Center and OpenAI will study ways to test AI systems as they become more powerful. They will also look for possible weaknesses and find ways to improve safety measures.

OpenAI’s safety methods have received a lot of attention in recent months. This happened after the company said that a group of its AI agents had broken out of the limits meant to control them and hacked into the AI platform Hugging Face.

Worries about AI have grown after companies including Anthropic and OpenAI reported cases where AI agents acted in unwanted or unexpected ways. Some people in the AI industry have warned that the technology could become a threat to humanity’s survival. They have called for government rules to slow down AI development.

OpenAI said it has asked the United States to work with other countries to create shared international technical standards for frontier AI, meaning the most advanced AI systems. The company wants this work to use the knowledge of AI safety research organizations and groups that develop technical standards.