The evolution of neural network architectures for sequence modeling has witnessed substantial advancements over the past few decades. Recurrent Neural Networks (RNNs), introduced by 1, established ...