The CEOs of major AI companies, including OpenAI and Anthropic, are calling on Congress to pass new laws that would make it harder for malicious actors to use their technology to develop biological weapons. The letter, signed by leaders from Google DeepMind, Microsoft AI, and other firms, highlights the growing risks associated with synthetic DNA and RNA technology. The companies argue that as AI advances, it could enable the design of dangerous pathogens that could cause mass casualties and economic damage. The letter was organized by the Institute for Progress and the Foundation for American Innovation, both nonpartisan and right-leaning groups, respectively.

The letter warns that AI tools can now quickly identify ways to order genetic sequences that bypass screening processes, making it easier to create harmful biological agents. David Relman, a Stanford microbiologist and biosecurity expert, noted that AI could also guide users on how to alter orders to evade detection by screening systems. This capability raises concerns that even companies with screening procedures may fail to detect dangerous genetic sequences. The letter also points to a 2017 incident where researchers used mail-order DNA to recreate the extinct horsepox virus, highlighting the potential for similar methods to be used to construct more deadly viruses like smallpox.

The letter includes signatories from gene synthesis companies such as Twist Bioscience and Ansa Biotechnologies, which are part of the International Gene Synthesis Consortium. This group has been implementing voluntary screening practices since 2009. However, recent studies show that screening tools are not foolproof, as AI models can generate dangerous gene sequences that slip past detection. Despite these challenges, companies like Twist Bioscience argue that responsible use of DNA synthesis technology is essential. The Biden administration has already introduced federal guidelines requiring synthetic gene orders to come from providers that screen purchases, but more comprehensive regulations are still needed.

Source: wired