Skip To Main Content
Ebrahim Abdulla Mattar on Muck Rack

Ebrahim Abdulla Mattar

As seen in: Nature
Is this you? As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work. Claim your profile

Get in touch with Ebrahim Abdulla

Contact Ebrahim Abdulla, search articles and posts on X, monitor coverage, and track replies from one place.

Learn more about Muck Rack

Actions

Share this page

Is this you?

As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work.
Claim your profile

Articles

Quantum-inspired quadratic attention with fourier-domain rank control in transformer architectures

|
By Saptarshi Banerjee, Pronaya Bhattacharya, Sujan Pal, Avnish Kumar, Jon Turdiev, Himadri Saha, Amlan Chakrabarti, Tausif Mallick, Ebrahim Abdulla Mattar
| Nature Verified
Abstract Quadratic attention enhances interaction capacity in Transformer models but leads to rapid growth in computational demands as attention rank increases. This paper presents a bounded-rank quadratic attention mechanism where fixed-dimensional feature encodings determine the interaction space and enforce a strict upper bound on attention rank.
Open in Who Shared Issue with article?
See all 1 articles