Skip To Main Content
Duong Tung on Muck Rack

Duong Tung

As seen in: Royal Society of Chemistry, IT Supply Chain

Get in touch with Duong

Contact Duong, search articles and posts on X, monitor coverage, and track replies from one place.

Learn more about Muck Rack

Actions

Share this page

Articles

Computer Science > Networking and Internet Architecture

|
By Duong The, Duong Tung
| arxiv.org
KV cache memory is a primary bottleneck in modern LLM serving systems deployed on GPU clusters. A fundamental challenge is that the KV cache must be reserved upon request arrival, while the output token length remains unknown until generation completes.
Open in Who Shared Issue with article?

Electrical Engineering and Systems Science > Systems and Control

|
By Duong Tung
| arxiv.org
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Open in Who Shared View Duplicates (666) Issue with article?

Electrical Engineering and Systems Science > Systems and Control

|
By Duong Tung
| arxiv.org
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Open in Who Shared View Duplicates (502) Issue with article?
See all 15 articles