The first public release for Ankh models.
It contains the source code and model weights release of Ankh Protein Language Models.
It is the first general-purpose protein language model trained on Google’s TPU v4 that surpasses the performance of protein language modeling (PLM) state-of-the-art (SoA) with less than 10% of the parameters for the pre-training, 7% for the inference, and 30% of the embedding dimension.