Skip To Main Content
Harshvardhan Singh on Muck Rack

Harshvardhan Singh

Noida
As seen in: Medium, The Times of India, PLOS ONE, ACS Publications, Moneycontrol, DEV Community, DZone, Amar Ujala, TechCircle, Industrial Safety & Hygiene News and

Get in touch with Harshvardhan

Contact Harshvardhan, search articles and posts on X, monitor coverage, and track replies from one place.

Learn more about Muck Rack

Actions

Share this page

Articles

Build a Semantic Cache for Your LLM App in 40 Lines of Python (And Cut Costs by Half)

|
By Harshvardhan Singh
| DEV Community
If you're calling an LLM API for every single user request, you're almost certainly paying for the same question more than once. Not because your users are dumb because human beings ask the same thing in a dozen different ways, and a normal cache only matches exact strings. "how do I reset my password" and "reset password help pls" are, to a dict or a Redis GET, completely unrelated. To your users, they're the same request. Every mismatch is a full-price model call you didn't need to make.
Open in Who Shared Issue with article?

Safe Handling of Explosives in Underground Mining

|
By Harshvardhan Singh
| Safe Secure Verified
India's Premier Fire Safety & Security Publication India's Premier Fire Safety & Security Publication India's Premier Fire Safety & Security Publication India's Premier Fire Safety & Security Publication India's Premier Fire Safety & Security Publication Expert Talks Harshvardhan Singh works as an Assistant Manager (Equipment Service) at a global mining utility vehicle manufacturer. He is positioned at Zawar Mines, Udaipur, India. Harshvardhan Singh Assistant Manager July 16, 20264 min read Share:
Open in Who Shared Issue with article?

Computer Science > Software Engineering

|
By Harshvardhan Singh, Vyzantinos Repantis, Lucy Moys
| arXiv
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Open in Who Shared View Duplicates (309) Issue with article?
See all 40 articles