Muhammad Numair Mansur

Complex itemized bills from services such as cloud computing, healthcare, or telecommunications can be difficult to understand because the pricing terms that determine what a customer pays are straightforward, but the eligibility rules that determine whether a given line item, a single charge for a product and quantity, qualifies for a given price are scattered across user guides, service terms, and fine print.

Large Language Models (LLMs) are increasingly integrated into software systems as automated decision-making components. These systems rely on instruction prompts written in natural language to encode complex workflows. However, debugging these prompts when LLMs produce undesired outputs remains challenging due to their black-box nature and the impracticality of manually inspecting large, complex inputs.

From cloud databases and anomaly detection on graphs to recession prediction and Amazon's new Nova foundation models, these are the most viewed publications authored by Amazon scientists and collaborators in 2024. Large language models remained a hot topic, but posts about cryptography and automated reasoning also drew readers. Amazon Research Awards team Awardees, who represent 10 universities, have access to Amazon public datasets, along with AWS AI/ML services and tools.