Implementation of the attention and transformer from "Building Blocks for a Complex-Valued Transformer Architecture"
artificial-intelligence complex-numbers attention attention-mechanism fourier-transform attention-is-all-you-need dotproduct complex-signals
-
Updated
Mar 11, 2024 - Python