AI-designed viruses expose gaps in oversight of synthetic biology

The suc­cess­ful cre­ation of func­tion­al new-to-nature virus­es designed by arti­fi­cial intel­li­gence has prompt­ed renewed calls for stronger over­sight of syn­thet­ic biol­o­gy and AI-enabled genome design. In the EU, mean­while, dis­cus­sions are focussed on pre­vent­ing the mali­cious mis­use of biotech­nol­o­gy, while pay­ing lit­tle atten­tion to the biosafe­ty ques­tions raised by increas­ing­ly capa­ble AI genome design tools.

AI model designs new-to-nature viruses

In a new study pub­lished in Sci­ence, researchers from Stan­ford Uni­ver­si­ty and the Arc Insti­tute used arti­fi­cial intel­li­gence (AI) to gen­er­ate virus­es that do not exist in nature. They used a genom­ic lan­guage mod­el called Evo 2 to gen­er­ate com­plete genomes of bac­te­rio­phages – virus­es that infect bac­te­ria. Evo 2 has been released as an open-source mod­el, mak­ing its genome design capa­bil­i­ties freely avail­able to researchers and oth­er users.

After syn­the­sis­ing and test­ing hun­dreds of AI-gen­er­at­ed genome designs, the researchers found that six­teen pro­duced viable virus­es capa­ble of infect­ing Escherichia coli. Some per­formed as well as, or bet­ter than, the nat­u­ral­ly occur­ring virus that served as the start­ing point for the study.

The work marks a sig­nif­i­cant mile­stone in syn­thet­ic biol­o­gy because it demon­strates that gen­er­a­tive AI can design com­plete func­tion­al viral genomes rather than indi­vid­ual genes or pro­teins. Pre­vi­ous AI appli­ca­tions have large­ly focused on pre­dict­ing pro­tein struc­tures or design­ing short­er DNA sequences.

The researchers empha­sise that the work was delib­er­ate­ly restrict­ed to bac­te­rio­phages, which infect bac­te­ria rather than humans, ani­mals or plants. They exclud­ed virus­es capa­ble of infect­ing more com­plex organ­isms from the mod­el’s train­ing data. The stat­ed objec­tive was to explore whether AI could accel­er­ate the devel­op­ment of phage ther­a­py, an approach that uses virus­es instead of antibi­otics to com­bat bac­te­r­i­al infec­tions.

Although bac­te­rio­phage genomes are rel­a­tive­ly small and com­par­a­tive­ly easy to engi­neer, project leader Bri­an Hie said the same approach could even­tu­al­ly be extend­ed to bac­te­ria and pro­gres­sive­ly more com­plex organ­isms.

Scientific milestone raises governance questions

The study has inten­si­fied debate about the gov­er­nance of AI-enabled genome design. In a com­men­tary pub­lished along­side the research, Thomas Ingles­by and Moritz Han­ke of the Johns Hop­kins Cen­ter for Health Secu­ri­ty argue that the work rais­es “urgent biosafe­ty and biose­cu­ri­ty ques­tions”. Although they com­mend the researchers for incor­po­rat­ing safe­ty mea­sures into the project, they believe exist­ing gov­er­nance frame­works are insuf­fi­cient for over­see­ing this type of project. The chal­lenge, they write, is no longer whether AI will be able to design func­tion­al viral genomes, but whether gov­er­nance can evolve quick­ly enough to ensure that these capa­bil­i­ties are used safe­ly.

Oth­er experts have expressed sim­i­lar con­cerns, argu­ing that over­sight mech­a­nisms have not kept pace with advances in AI-assist­ed bio­log­i­cal design and call­ing for stronger safe­guards cov­er­ing AI mod­els, DNA syn­the­sis, lab­o­ra­to­ry biosafe­ty and inter­na­tion­al gov­er­nance.

The research shows how advances in genet­ic engi­neer­ing are increas­ing­ly inter­twined with advances in AI. Ensur­ing that inno­va­tion is accom­pa­nied by robust over­sight, trans­paren­cy and effec­tive biosafe­ty mea­sures will become an increas­ing­ly impor­tant chal­lenge for pol­i­cy­mak­ers world­wide.

EU addresses some biosecurity concerns

In the Euro­pean Union, a recent leg­isla­tive pro­pos­al on biotech­nol­o­gy, termed “Biotech Act I”, aims to encour­age the uptake of AI in biotech­nol­o­gy. It also seeks to ensure that Europe’s biotech­nol­o­gy expan­sion does not increase risks of delib­er­ate mis­use of “biotech­nol­o­gy prod­ucts of con­cern”. One pro­posed mea­sure is a har­monised EU frame­work for screen­ing syn­thet­ic DNA orders to ensure mali­cious actors can­not cre­ate dan­ger­ous pathogens or tox­ins.

How­ev­er, while the pro­pos­al recog­nis­es AI as an impor­tant enabler of biotech­nol­o­gy and intro­duces stronger con­trols over DNA syn­the­sis, it leaves many ques­tions about how AI-enabled genome design should be gov­erned – nor does it address the broad­er biosafe­ty issues raised by this type of research.

Indeed, in a sep­a­rate pro­pos­al accom­pa­ny­ing the Biotech Act, the Euro­pean Com­mis­sion pro­pos­es changes that would reduce the reg­u­la­to­ry over­sight of genet­i­cal­ly mod­i­fied microor­gan­isms, includ­ing bac­te­ria, fun­gi and virus­es, poten­tial­ly weak­en­ing pro­tec­tions against health and envi­ron­men­tal risks asso­ci­at­ed with their release.

to top