Google Converts Gemma 2 Into Encoder-Decoder Models With T5Gemma

Google's T5Gemma converts pretrained decoder-only Gemma 2 models into encoder-decoder LLMs, beating Gemma 2 on GSM8K, DROP and MMLU at similar latency, with checkpoints now released.