Skip To Main Content
Shichao Weng on Muck Rack

Shichao Weng

As seen in: arXiv
Is this you? As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work. Claim your profile

Get in touch with Shichao

Contact Shichao, search articles and posts on X, monitor coverage, and track replies from one place.

Learn more about Muck Rack

Actions

Share this page

Is this you?

As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work.
Claim your profile

Articles

Computer Science > Computation and Language

|
By Shichao Weng, Zhiqiang Wang, Xinyu Liu
| arXiv
Mixture-of-Experts (MoE) models route each token to a subset of expert networks, increasing capacity while keeping per-token computation sparse. In many deployed MoEs, the number of active experts is fixed across layers and tasks, although layer roles and expert redundancy vary with depth and demand varies with difficulty.
Open in Who Shared Issue with article?

AutoMixQ: Self-Adjusting Quantization for High Performance Memory-Efficient Fine-Tuning

|
By Shiyang Zhang, Yuhua Zhou, Zekai Liu, Shichao Weng
| arXiv
Open in Who Shared Issue with article?

RankAdaptor: Hierarchical Dynamic Low-Rank Adaptation for Structural Pruned LLMs

|
By Shijie Han, Shiyang Zhang, Zekai Liu, Shichao Weng
| arXiv
Open in Who Shared Issue with article?
See all 3 articles