Is this you? As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work.
Claim your profile
Articles by Yennie Jun
Are we offloading too much of our thinking to AI?
My notes for this essay, written on a plane with no internet and no AI :D I have been observing, in myself and in those around me, a tendency to increasingly offload our thinking to AI. From trivial decisions to complex thinking, it is easy, convenient, and in some cases, encouraged, to use AI for researching, reasoning, and answering our every query. I recently read “The Perfect Match” by Ken Liu, a 2012 short story which describes this phenomenon with unexpected accuracy.
LLM vs LLM: Codenames Tournament
A mini multi-agent competition among 3 different LLM agents This article was originally posted on Art Fish Intelligence. LLMs are good at many things, and one of those things is playing games. People have used LLMs to play all sorts of games such as Minecraft, Chess, murder mystery games, Werewolf, and the NYT Connections puzzle. (For a more comprehensive list, you can refer to this survey.) Most of the examples above show LLMs playing games either against themselves or against humans.
Evaluating Long Context Large Language Models
The context window of language models have been growing at an exponential rate in the last few years. Figure created by the author. This article was originally published on Art Fish Intelligence. The context window of large language models - the amount of text they can process at once - has been increasing at an exponential rate. In 2018, language models like BERT, T5, and GPT-1 could take up to 512 tokens as input.
Dealing with Cognitive Dissonance, the AI Way
Given contradictory instructions in the system message, the prompt, and examples, which instructions will an LLM follow in its response? Created by the author. How do language models handle conflicting instructions in a prompt? Cognitive dissonance is a psychological term describing the mental discomfort experienced by an individual holding two or more contradictory beliefs.
A Brief Overview of Gender Bias in AI
AI models reflect, and often exaggerate, existing gender biases from the real world. It is important to quantify such biases present in models in order to properly address and mitigate them. In this article, I showcase a small selection of important work done (and currently being done) to uncover, evaluate, and measure different aspects of gender bias in AI models. I also discuss the implications of this work and highlight a few gaps I’ve noticed. But What Even Is Bias?
Gender Bias in AI (International Women’s Day Edition)
A brief overview and discussion on gender bias in AI For International Women’s Day, I wanted to write a short article about gender bias in AI. AI models reflect, and often exaggerate, existing gender biases from the real world. It is important to quantify such biases present in models in order to properly address and mitigate them.
Gender Bias in AI (International Women’s Day Edition)
Gender Bias in AI (International Women’s Day Edition) A brief overview and discussion on gender bias in AI Created using Midjourney This article was originally published on art fish intelligence Introduction For International Women’s Day, I wanted to write a short article about gender bias in AI.
Measuring AI’s Creativity with Visual Word Puzzles
How well can AI models solve (and create) rebus puzzles? What does it mean for an AI to be creative? Last year, I wrote an article about measuring creativity in Large Language Models (LLMs) using several word-based creativity tests. Since then, AI has developed rapidly and is capable of processing and creating both text and image.
Measuring AI’s Creativity with Visual Word Puzzles
How well can AI models solve (and create) rebus puzzles? this article was originally published on Art Fish Intelligence What does it mean for an AI to be creative? Last year, I wrote an article about measuring creativity in Large Language Models (LLMs) using several word-based creativity tests. Since then, AI has developed rapidly and is capable of processing and creating both text and image.
2023 Wrapped: A Year of Sickness and Health
Analyzing my own data to better understand my patterns of wellness This article was originally published on Art Fish Intelligence. At the beginning of every year, I do a data analysis of the previous year to reflect on everything that happened. Last year, in 2022, I did an in-depth investigation of my crying patterns. This year, for 2023, I analyzed my patterns of sickness and health.
Lost in DALL-E 3 Translation
This article was originally published on artfish intelligence OpenAI recently launched DALL-E 3, the latest in their line of AI image generation models. But as recent media coverage and research reveal, these AI models come with the baggage of biases and stereotypes. For example, AI image generation models such as Stable Diffusion and Midjourney tend to amplify existing stereotypes about race, gender, and national identity.
Who Does What Job? Occupational Roles in the Eyes of AI
How GPT models’ view on occupations evolved over time Back in December of 2020, I began writing a paper investigating biases in generative language models with a group at the University of Oxford. We ran experiments to understand the occupational and gender biases exhibited by the hottest language model at the time, GPT-2 (this is before the term “large language models” was popularized) [1].
Lost in DALL-E 3 Translation
Images generated using DALL-E 3 in the six languages for the prompt "an image of a person". Figure created by the author. This article was originally published on artfish intelligence OpenAI recently launched DALL-E 3, the latest in their line of AI image generation models. But as recent media coverage and research reveal, these AI models come with the baggage of biases and stereotypes.
Lost in DALL-E 3 Translation
Generating AI images in multiple languages leads to different results OpenAI recently launched DALL-E 3, the latest in their line of AI image generation models. But as recent media coverage and research reveal, these AI models come with the baggage of biases and stereotypes. For example, AI image generation models such as Stable Diffusion and Midjourney tend to amplify existing stereotypes about race, gender, and national identity.
How Astoria’s one and only bookstore came to be
When Lexi Beach opened Astoria Bookshop in August of 2013, all she had was a website URL, a Twitter handle, and an empty storefront. The moment she plugged in her landline, she was bombarded with people calling to ask about the bookstore’s location and hours. “We didn’t have hours,” Beach said.
GPT-4 Can Solve Math Problems - But Not in All Languages
A few experiments making GPT-4 solve math problems in 16 different languages It is said that mathematics is a universal language — mathematical concepts, theorems, and definitions can be expressed as symbols that are understandable regardless of language. In this article, I test the mathematical capabilities of GPT-4 in sixteen different languages. Early experiments showed GPT-4 scoring highly on the SAT Math and AP Calculus tests and on undergraduate-level mathematics.
Where Are All the Women?
A few of the top historical figures mentioned the most often by the GPT-4 and Claude. Individual images sourced from Wikipedia. Collage created by the author. (This article was originally posted on my personal blog) Large language models (LLMs) such as ChatGPT are being increasingly used in educational and professional settings. It is important to understand and study the many biases present in such models before integrating them into existing applications and our daily lives.
Where Are All the Women?
Exploring large language models’ biases in historical knowledge (This article was originally posted on my personal blog) Large language models (LLMs) such as ChatGPT are being increasingly used in educational and professional settings. It is important to understand and study the many biases present in such models before integrating them into existing applications and our daily lives. One of the biases I studied in my previous article was regarding historical events.
World History Through the Lens of AI
Advancements in artificial intelligence, particularly large language models, open up exciting possibilities for and education. However, it is important to scrutinize the ways these models interpret and recall the past. Do they reflect any inherent biases in their understanding of history? I am well aware of the subjectivity of history (I majored in history in my undergrad!).
World History Through the Lens of AI
What historical knowledge do language models encode? This article was originally published on my blog Advancements in artificial intelligence, particularly large language models, open up exciting possibilities for and education. However, it is important to scrutinize the ways these models interpret and recall the past. Do they reflect any inherent biases in their understanding of history? I am well aware of the subjectivity of history (I majored in history in my undergrad!).
All Languages Are NOT Created (Tokenized) Equal
This article was originally published on the author’s blog and re-published to TOPBOTS with permission from the author. Large language models such as ChatGPT process and generate text sequences by first splitting the text into smaller units called tokens. In the image below, each colored block represents a unique token.
All languages are NOT created (tokenized) equal
Large language models such as ChatGPT process and generate text sequences by first splitting the text into smaller units called tokens. In the image below, each colored block represents a unique token. Short or common words such as âyouâ, âsayâ, âloudâ, and âalwaysâ are its own token, whereas longer or less common words such as âatrociousâ, âprecociousâ, and âsupercalifragilisticexpialidociousâ are broken into smaller subwords.
All Languages Are NOT Created (Tokenized) Equal
Language models cost much more in some languages than others Original article was posted on my blog. Large language models such as ChatGPT process and generate text sequences by first splitting the text into smaller units called tokens. In the image below, each colored block represents a unique token.
All Languages Are NOT Created (Tokenized) Equal
Large language models such as ChatGPT process and generate text sequences by first splitting the text into smaller units called tokens. In the image below, each colored block represents a unique token. Short or common words such as "you", "say", "loud", and "always" are its own token, whereas longer or less common words such as "atrocious", "precocious", and "supercalifragilisticexpialidocious" are broken into smaller subwords.
Exploring Creativity in Large Language Models: From GPT-2 to GPT-4
Creativity as envisioned by Midjourney. Generated by the author This article was originally published on the author’s blog and re-published to TOPBOTS with permission from the author. In recent weeks, people have used large language models (LLMs) to generate a variety of creative content, such as books, flash fiction, rap battles, and music chords. But is it possible to measure the level of creative process more broadly in these models?
Exploring Creativity in Large Language Models: From GPT-2 to GPT-4
Teachers thought a 5-year-old who collapsed during recess was 'playing dead'. They left him for 8 minutes with the delay costing his life, new lawsuit says
Exploring Creativity in Large Language Models: From GPT-2 to GPT-4
Analyzing the evolution of creative processes in large language models through creativity tests This blog was originally posted at https://blog.yenniejun.com/p/exploring-creativity-in-large-language In recent weeks, people have used large language models (LLMs) to generate a variety of creative content, such as books, flash fiction, rap battles, and music chords. But is it possible to measure the level of creative process more broadly in these models?
From GPT-2 to GPT-4
This blog was originally posted at https://blog.yenniejun.com/p/exploring-creativity-in-large-language In recent weeks, people have used large language models (LLMs) to generate a variety of creative content, such as books, flash fiction, rap battles, and music chords. But is it possible to measure the level of creative process more broadly in these models? Human creativity has long fascinated psychologists and researchers.
Does AI Have Political Opinions?
This article was originally published on the author’s blog and re-published to TOPBOTS with permission from the author. There’s a quote about how in polite society, you should never talk about three things: politics, religion, and money. In this article, I break polite conventions to determine how an AI would respond to all three of those topics.
The Forbidden Pages: A Data Analysis of Book Bans in the US
On books, bans, censorship, and a little bit of AI Reposted from original article on my blog: 🎨 art fish intelligence 🐡 In the last few years, an increasing number of books have been banned in states across the United States — with projections of the trend accelerating in 2023. Recent book bans in Texas, Utah, and Florida have resulted in hundreds of books being pulled off classroom and library shelves.
A Data Analysis of Book Bans in the US
In the last few years, an increasing number of books have been banned in states across the United States - with projections of the trend accelerating in 2023. Recent book bans in Texas, Utah, and Florida have resulted in hundreds of books being pulled off classroom and library shelves. Many of these books, labeled "sensitive materials", are disproportionately books by or about LGBTQ+ people and people of color.
Does AI Have Political Opinions?
Measuring GPT-3’s political ideology on economic and social scales There’s a quote about how in polite society, you should never talk about three things: politics, religion, and money. In this article, I break polite conventions to determine how an AI would respond to all three of those topics.
Does AI Have Political Opinions?
Measuring GPT-3’s political ideology on economic and social scales There’s a quote about how in polite society, you should never talk about three things: politics, religion, and money. In this article, I break polite conventions to determine how an AI would respond to all three of those topics.
How I Cried in 2022: An Analysis of 365 Days of Personal Data
An investigation into my crying patterns using data I collected on myself I am obsessed with collecting data on myself. Every day of 2022, I filled out a Google Form I made to collect data on myself, tracking items such as whether I cried, exercised, drank coffee, or washed my hair. I also collected data from Apple Health and Google Location History to get a more complete picture of my patterns and behaviors throughout the year.
Using AI to improve AI-generated content
As generative AI technologies improve, it becomes more important to be able to detect AI-generated content. This is necessary for a myriad of reasons, such as preventing academic dishonesty (e.g. writing essays), detecting fake product reviews, identifying toxic messages, and combating the spread of disinformation and fake news. Detecting AI-generated text, however, is not straightforward. One method of doing so is using machine learning algorithms to identify patterns common in AI-generated text.
A New Spin to Ethical AI: Trolley Problems with GPT-3
Would GPT-3 sacrifice many to save a few? You may have heard of trolley problems, a philosophical thought experiment regarding the ethics of sacrificing one person to save a larger number of people. How would GPT-3, a generative text AI created by OpenAI, answer these ethical dilemmas? In this article, I prompt GPT-3 with increasingly absurd trolley problem scenarios from Absurd Trolley Problems (I recommend you try these yourself if you haven’t yet!).
Trolley Problems with GPT-3
Would GPT-3 sacrifice many to save a few? A pensive robot sitting on railroad tracks pondering the meaning of trolley problems and other existential questions. Generated by author using DALL-E 2 You may have heard of trolley problems, a philosophical thought experiment regarding the ethics of sacrificing one person to save a larger number of people. How would GPT-3, a generative text AI created by OpenAI, answer these ethical dilemmas?
Creative Writing with GPT-3: from Emoji to Flash Fiction
Enhancing the creative writing process with AI As a creative fiction writer, I wanted to know if I could get AI to help me write stories. AI has been used to create fiction, such as a children’s book, a book of poetry, and an academic article about itself. AI-enabled writing tools, such as Google’s Wordcraft, have also augmented the process of planning, writing, and editing stories.
from Emoji to Flash Fiction
A robot tasked with writing a story! Image generated by author using DALL-E 2. As a creative fiction writer, I wanted to know if I could get AI to help me write stories. AI has been used to create fiction, such as a children's book, a book of poetry, and an academic article about itself. AI-enabled writing tools, such as Google's Wordcraft, have also augmented the process of planning, writing, and editing stories.
Does GPT-3 have a personality?
AI + MBTI = ? The Myers–Briggs Type Indicator, or MBTI, is a common personality test that aims to categorize people into 16 personality types based on four categories: introversion or extraversion, sensing or intuition, thinking or feeling, and judging or perceiving. While MBTI has been criticized for being a pseudoscience, perhaps not any more different from horoscopes, it is still a fun exercise to take the test and compare your personality type with others.
Prompt Engineering GPT-3 to solve Project Euler problems
Using AI to solve math problems so you don’t have to How good is GPT-3 at solving math and programming problems? Specifically, how good is GPT-3 at solving problems from Project Euler? Project Euler (named after the famous mathematician) is a website with hundreds of mathematical and computer programming problems ranging in difficulty.
Prompt Engineering GPT-3 to solve Project Euler problems
Cute neon robot doing math! Generated using Stable Diffusion (by author) How good is GPT-3 at solving math and programming problems? Specifically, how good is GPT-3 at solving problems from Project Euler? Project Euler (named after the famous mathematician) is a website with hundreds of mathematical and computer programming problems ranging in difficulty.
Measuring Semantic Changes Using Temporal Word Embedding
Thoughts and Theory A guide to how temporal word embeddings can be used to measure word evolution and some considerations regarding stability of embedding methods Dictionaries aim to capture word meaning, but can we use NLP to capture word meaning over time? Photo by Aaron Burden on Unsplash What if I want to know how words have changed over time?
Did government type have an effect on restrictive COVID-19 measures?
It’s been over a year since the first outbreak of the COVID-19 pandemic. Since then, we have seen countries dealing with the pandemic in vastly different ways, and many people have pondered the indicators that could be used to predict countries’ varying responses and experiences.
Now Is the Time to Make Online Schools Available to Everyone
Toward an inclusive remote education system Photo: Petri Oeschger/Getty Images The spread of coronavirus in the United States has prompted thousands of schools and universities to shut down and move online, leading us to rethink the future of our education systems.
Show More
loading
Actions
Is this you?
As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work.Get in touch with Yennie
Contact Yennie, search articles and posts on X, monitor coverage, and track replies from one place.
Learn more about Muck Rack