Skip To Main Content
Babak Ehteshami on Muck Rack

Babak Ehteshami

As seen in: arXiv
Is this you? As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work. Claim your profile

Get in touch with Babak

Contact Babak, search articles and posts on X, monitor coverage, and track replies from one place.

Learn more about Muck Rack

Actions

Share this page

Is this you?

As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work.
Claim your profile

Articles

Computer Science > Machine Learning

|
By Babak Ehteshami
| arXiv
The quadratic cost of causal self-attention severely bottlenecks long-context transformer inference. While numerous post hoc linearization pipelines exist, it is difficult to identify which components preserve model quality. This work isolates the effect of state update design in a strict frozen-backbone regime.
Open in Who Shared Issue with article?

[2412.00099] Mixture of Cache-Conditional Experts for Efficient Mobile Device Inference

|
By van Rozendaal, Van Baalen, Babak Ehteshami
| arXiv
Thank you to everyone who makes arXiv possible. Give to arXiv today and help keep science open.
Open in Who Shared View Duplicates (395) Issue with article?

Read-ME: Refactorizing LLMs as Router-Decoupled Mixture of Experts with System Co-Design

|
By Babak Ehteshami
| arXiv
Open in Who Shared Issue with article?
See all 6 articles