Soda Lo

Data perspectivism goes beyond majority vote label aggregation by recognizing various perspectives as legitimate ground truths. However, current evaluation practices remain fragmented, making it difficult to compare perspectivist approaches and analyze their impact on differ-ent users and demographic subgroups. To ad-dress this gap, we introduce PersEval, the first unified framework for evaluating perspectivist models in NLP.

Recently, several scholars have contributed to the growth of a new theoretical framework in NLP called perspectivism. This approach aims to leverage data annotated by different individuals to model diverse perspectives that affect their opinions on subjective phenomena such as irony. In this context, we propose MultiPICo, a multilingual perspectivist corpus of ironic short conversations in different languages and linguistic varieties extracted from Twitter and Reddit.

Africa China Civil Society Conflict Crisis Management International Organizations Peacekeeping and Peacebuilding Politics & Diplomacy Resilience & Society Security & Defense United Nations The future of multilateral peacebuilding and conflict prevention Introduction Definitions, institutions, and norms Trends and uncertainties Scenarios Sahel regional analysis Questions for policymakers The multilateral system, defined as the set of rules, norms, and institutions that together constitute the...