How Good is Opus 5 at Biology?
AI Summary: The results of Opus 5, a new AI model, have been published on benchmarks.bio, showing improvements in biosecurity, therapeutics, and -omics benchmarks. Specifically, Opus 5 outperformed previous models, including Sol 5.6, on tasks such as variant discovery and interpretation, small-molecule preclinical pharmacology, and genomic surveillance. However, Opus 5 regressed on epigenomics analysis tasks and performed poorly on long-horizon spatial biology tasks. The model's performance was evaluated across 4,674 trajectories, providing insights into its strengths and weaknesses.