Skip to content

Use more parallelism in attention block in prefill mode.#177

Merged
copybara-service[bot] merged 3 commits intogoogle:devfrom
szabadka:gemma2
May 3, 2024
Merged

Use more parallelism in attention block in prefill mode.#177
copybara-service[bot] merged 3 commits intogoogle:devfrom
szabadka:gemma2

Commits

Commits on May 3, 2024