3.526 cups
flour
0.394 tsp
baking powder
1.139 tsp
salt
1.370 tsp
baking soda
1.133 cups
butter
1.025 cups
sugar
1.194 cups
light brown sugar
0.125 cups
dark brown sugar
2.980 tsp
vanilla
2.855 whole
eggs
1.833 cups
semisweet chocolate chips
0.291 cups
milk chocolate chips
0.112 cups
dark chocolate chips
0.049 cups
white chocolate chips
0.354 cups
bittersweet chocolate chips
0.014 tsp
almond extract
0.011 cups
almonds
0.002 cups
applesauce
0.019 tbsp
bourbon
0.098 cups
bread flour
0.006 cups
brown rice flour
0.082 cups
cake flour
0.378 oz
cake mix
0.019 cups
chocolate covered raisins
0.028 tsp
cinnamon
0.006 cups
coconut
0.019 tsp
coconut extract
0.128 cups
cookie mix
0.001 tsp
coriander
0.057 tbsp
corn syrup
0.137 tsp
cornstarch
0.006 tsp
cream
0.009 cups
crispy rice
0.1019 tsp
espresso powder
0.002 cups
graham cracker crumbs
0.003 cups
honey
0.006 tsp
lemon juice
0.096 tsp
liquer
0.005 cups
macadamia nuts
0.032 tbsp
maple syrup
0.050 cups
margarine
0.538 tbsp
milk
0.005 tbsp
molasses
0.002 cups
Nesquick mix
0.002 tsp
nutmeg
0.055 cups
nuts
0.227 cups
oats
0.006 cups
peanut butter
0.002 cups
peanut butter chips
0.062 cups
pecans
0.038 oz
pudding mix
0.006 cups
raisins
0.160 cups
shortening
0.088 tbsp
sour cream
0.027 tsp
cream of tartar
0.022 cups
toffee
0.020 cups
vegetable oil
0.019 tsp
vinegar
0.326 cups
walnuts
0.010 cups
water
0.048 cups
wheat flour
0.005 tsp
white pepper
0.003 tsp
xanthan gum
0.010 cup
zucchini
Bake 350°F for 8 - 10 min
4.0 cups
butter flavored shortening
3.333 cups
packed brown sugar
? cups
white sugar
4.0 cups
all purpose flour
1.143 tsp
baking soda
0.738 tsp
baking powder
1.0 whole
egg
1.0 whole
egg yolk
2.0 cups
semisweet chocolate chips
0.8 tbsp
vanilla extract
Bake 350°F for 7 minutes
4.0 cups
all purpose flour
2.0 tsp
baking soda
1.0 tsp
salt
1.0 cups
white sugar
4.0 whole
eggs
2.0 tsp
vanilla
1.0 cup
semisweet chocolate chips
? cup
walnuts
0.5 cups
white sugar
0.75 cups
granulated sugar
0.8 cups
white sugar
1.218 cups
packed brown sugar
0.5 cups
white sugar
1.0 cup
white sugar
1.2 cups
packed brown sugar
1.0 cup
white sugar
2.0 tsp
baking soda
Bake for 10-12 min
Bake for 10-12 min (again)
pause
Baking the Most Average Chocolate Chip Cookie
Cookie recipes written by computers.
What could go wrong?
It’s hard to mess up a chocolate chip cookie. In the 80 years since the treat’s invention, thousands of recipe variations have been written to make the treat more gooey, crispy, chewy and generally tastier than its predecessors. Yet, it’s possible that this go-to dessert’s tastiness can be pushed even further.
We wondered if there was a way to leverage computers and hundreds of pre-existing recipes to create the most average chocolate chip cookie. Would it be bland and unremarkable? Or, perhaps like averaging human facial features, the results would be even better than each of its individual parts. Maybe an average cookie would be the most delicious of them all.
But what is an average cookie? We decided to interpret this idea using three different methods: a mathematical average, predictive text algorithms, and neural networks. After feeding each algorithm over 200 chocolate chip cookie recipes, they each generated something new. And, yes, we actually baked them.
The Mathematical Average Cookie
“Chewy and very chocolatey, no one would suspect these cookies were made with everything in your pantry.”
For our first attempt, we threw our recipe-creation back to grade school and just straight up averaged the amount of every ingredient in our set of recipes. That means we calculated the average amount of flour, and the average amount of butter, and so on. Of course, that leads to some unusual complications like non-integer quantities (how do you measure 2.85 eggs?) and ingredients that appear sparingly in the data set, like molasses or black pepper, get seriously watered down in the average. We could pretend they’re not there, since who can taste 0.002 cups of applesauce in a batch of 48 cookies? But for science, we decided to keep all 60 ingredients.
Averaging numbers, like the amounts of everything in our recipes, is relatively straightforward, but things get more complicated when we think about how to average the recipe instructions. Afterall, we need to know what to do with all of our ingredients. It turns out that using a tool called word vectors we can effectively treat words as numbers. Here’s how it works:
Creating the Recipe
Step 1
Collect words used in the chocolate chip cookie recipes.
Step 2
Group words together that are used similarly in the recipes.
Step 3
If these words were grouped on a graph, we could assign a numeric value to each word based on where it falls on the graph. This number is called a “word vector”.
Step 4
Then we can use these word vectors to find the average value for an entire sentence. This is called a “sentence vector”.
Step 5
If we look at all of the sentences from our recipes, we’ll find that many have slightly different meanings, but very similar sentence vectors because they contain similar words.
Step 6
Now, if we group all of the sentences with similar sentence vectors together on a graph, we’ll end up with groups of similar sentences.
Step 7
Last, we find the sentence that is closest to the center of each group and use those sentences for our recipe instructions.
Using this method, we found about 9 distinct clusters of sentences and by picking the sentence closest to the center of each one, we ended up with recipe instructions that actually work pretty well. Although, we did have to decide when to add the 50+ ingredients that didn’t end up in our sentence vectors.
Watch Us Bake
3.526 cups
flour
0.394 tsp
baking powder
1.139 tsp
salt
1.370 tsp
baking soda
1.133 cups
butter
1.025 cups
sugar
1.194 cups
light brown sugar
0.125 cups
dark brown sugar
2.980 tsp
vanilla
2.855 whole
eggs
1.833 cups
semisweet chocolate chips
0.291 cups
milk chocolate chips
0.112 cups
dark chocolate chips
0.049 cups
white chocolate chips
0.354 cups
bittersweet chocolate chips
0.014 tsp
almond extract
0.011 cups
almonds
0.002 cups
applesauce
0.019 tbsp
bourbon
0.098 cups
bread flour
0.006 cups
brown rice flour
0.082 cups
cake flour
0.378 oz
cake mix
0.019 cups
chocolate covered raisins
0.028 tsp
cinnamon
0.006 cups
coconut
0.019 tsp
coconut extract
0.128 cups
cookie mix
0.001 tsp
coriander
0.057 tbsp
corn syrup
0.137 tsp
cornstarch
0.006 tsp
cream
0.009 cups
crispy rice
0.1019 tsp
espresso powder
0.002 cups
graham cracker crumbs
0.003 cups
honey
0.006 tsp
lemon juice
0.096 tsp
liquer
0.005 cups
macadamia nuts
0.032 tbsp
maple syrup
0.050 cups
margarine
0.538 tbsp
milk
0.005 tbsp
molasses
0.002 cups
Nesquick mix
0.002 tsp
nutmeg
0.055 cups
nuts
0.227 cups
oats
0.006 cups
peanut butter
0.002 cups
peanut butter chips
0.062 cups
pecans
0.038 oz
pudding mix
0.006 cups
raisins
0.160 cups
shortening
0.088 tbsp
sour cream
0.027 tsp
cream of tartar
0.022 cups
toffee
0.020 cups
vegetable oil
0.019 tsp
vinegar
0.326 cups
walnuts
0.010 cups
water
0.048 cups
wheat flour
0.005 tsp
white pepper
0.003 tsp
xanthan gum
0.010 cup
zucchini
Bake 350°F for 8 - 10 min
pause
The Predictive Text Cookie
“Big and flat, these cookies deliver a whopping taste of shortening and brown sugar.”
Next, we decided to try something a bit more complicated called predictive text. Essentially, predictive text is like the autosuggest feature in a messenger app: you start with one word, and it gives you suggestions for the words that might follow. The suggestions you receive on your phone most likely come from a pre-loaded program that “learns” based on your texting habits. What if predictive text only knew about the word usage in chocolate chip cookie recipes? That’s the question behind this experimental cookie.
Using our chocolate chip cookie recipe dataset, we created a big list of 4-grams: sets of 4 words or punctuation marks that appear together. Such as
We can count how often each 4-gram appears in the text and determine how likely it is that a specific 4-gram will appear instead of another. Here’s how it works:
Creating the Recipe
Step 1
Select three words that appear in the recipe text in order.
Step 2
Find which 4-grams from our dictionary contain those 3 words, in that order.
Step 3
Imagine that we chose the first option, “combine the flour,”. Now we need to find 4-grams that overlap with our choice.
Step 4
If we choose the 3rd option, “the flour, salt” we now have added two words to our original string (technically, a word and a punctuation mark).
Step 5
To speed this up, we automate the process, but the computer needs to know which 4-gram to pick. We used a process guided by probability - so 4-grams that occur often are more likely to be chosen than 4-grams that occur only once.
Beware of never-ending loops!
Using predictive text generated a pretty follow-able recipe, but it can have some issues. If we chose the single most common 4-gram every single time, we can find ourselves stuck in an endless loop. Look what happened when our computer ran into one very unusual ingredient - cannelini beans.
...sifted 2.4 cup canned white cannelini beans, and the baking soda and 1 teaspoon salt in a large microwave safe mixing bowl...sift flour, cocoa powder, sifted 2.4 cup canned white cannelini beans, and the baking soda and 1 teaspoon salt in a large microwave safe mixing bowl...
To save our recipe from endlessly looping (and to save our tastebuds from whoever is putting beans in cookies!), we removed the cannelini-filled recipe from our dataset.
Watch Us Bake
4.0 cups
butter flavored shortening
3.333 cups
packed brown sugar
? cups
white sugar
4.0 cups
all purpose flour
1.143 tsp
baking soda
0.738 tsp
baking powder
1.0 whole
egg
1.0 whole
egg yolk
2.0 cups
semisweet chocolate chips
0.8 tbsp
vanilla extract
Bake 350°F for 7 minutes
pause
The Neural Network Cookie
“Like caramelized cookie brittle. It’s not terrible but it’s not a cookie.”
Our last recipe was created using deep learning, one of the most compelling recent advances in artificial intelligence. An algorithm called a neural network has changed the game in facial recognition, speech recognition, and image processing in the last few years. Neural networks train on a set of data, like a set of pictures, text documents, or cookie recipes, and can learn the patterns inherent in its input without very much guidance, if any, from humans.
Trained neural networks can even create their own works of art. So if we trained a neural network on a set of chocolate chip cookie recipes, we could ask it to generate its own rendition of the recipe. That’s the idea behind our neural network cookie. Here’s how it works:
Creating the Recipe
Step 1
Collect the ingredients and directions from lots of chocolate chip cookie recipes.
Step 2
The neural network needs to find patterns in these words, so it breaks up all of the words into individual letters.
Step 3
The algorithm looks for patterns in how a single letter is used and what other letters typically come before or after it. This is called training.
Step 4
After the neural network has trained on enough recipes, it can begin to guess how a recipe would be written. So, if you give it a randomly assigned letter, it can try to guess which letters might come next. It continues letter by letter until an entire recipe emerges.
Watch out for made-up words!
Because neural networks piece together language letter by letter, it doesn’t have any understanding of the meaning of words in recipes and so sometimes, it makes up new words.
...And repeated or missing ingredients!
Neural networks are great at learning the format of a typical recipe, but they’re not so excellent at understanding which ingredients go together. It may not realize that it already added a cup of sugar and will then suggest that you add another cup of sugar to your ingredients...and another...and another.
It also may not notice that some ingredients, like eggs, are important, so they may be left out completely.
Watch Us Bake
4.0 cups
all purpose flour
2.0 tsp
baking soda
1.0 tsp
salt
1.0 cups
white sugar
4.0 whole
eggs
2.0 tsp
vanilla
1.0 cup
semisweet chocolate chips
? cup
walnuts
0.5 cups
white sugar
0.75 cups
granulated sugar
0.8 cups
white sugar
1.218 cups
packed brown sugar
0.5 cups
white sugar
1.0 cup
white sugar
1.2 cups
packed brown sugar
1.0 cup
white sugar
2.0 tsp
baking soda
Bake for 10-12 min
Bake for 10-12 min (again)
pause
Our Leftovers
Our computer gave it a valiant effort and did create three brand-new recipes! Whether or not we can qualify their creations as true chocolate chip cookies is still to be decided.
If you wanted to give these cookies a try, feel free to save the recipes, bake them yourself, and then let us know what you think! Oh, and if you don’t want hundreds of cookies (created from our recipes or your favorites), spread the love and that cookie-goodness with friends, family, or co-workers, have a bake sale to raise funds for hungry kids, or donate them. After all, it’s hard to go wrong with chocolate chip cookies.
Our Methods
We searched the internet, including recipe databases AllRecipes and Epicurious, for chocolate chip cookie recipes. Our search returned 915 recipes. We removed any recipes that were not representative of traditional chocolate chip cookies using several criteria: the title could not contain another dessert (e.g., “Chocolate chip cookie ice cream sandwiches” or “Chocolate chip cookie cake”), a flavor could not be mentioned in the title (e.g. “Peanut butter chocolate chip cookies” or “Banana chocolate chip cookies”), and the title could not identify the recipe as an alternative formulation of the cookie (“Vegan” or “Gluten free”). This brought our sample of traditional chocolate chip cookie recipes down to 221. Before any of the text processing or averaging methods were applied, recipes were scaled to make 48 servings.
Note that our text processing methods (specifically, the neural network and predictive text) produced instructions that were not always physically possible to complete. For example, ingredients are listed but not used in the instructions, and instructions sometimes reference ingredients that were never listed. As we attempted to make these recipes, we sought to adhere as closely to the recipe as possible, but making guesses as required.
Many thanks to Jan Diehm for design assistance on this story and for the header photograph.
Hungry for more computer-generated recipes?
We weren’t the first ones to use computers to generate new recipes and (we hope) we won’t be the last! Check out these recipes for pie, cake and much more. If you’re more of a cooking-show fan, you may enjoy watching Elle make a Thanksgiving dinner, a Valentine’s Day dessert, and a mystery meal all generated by various algorithms.
Ingredients
- 3.526 cups all purpose flour
- 0.014 tsp almond extract
- 0.011 cups almonds
- 0.002 cups applesauce
- 0.394 tsp baking powder
- 1.370 tsp baking soda
- 0.354 cups bittersweet chocolate chips
- 0.019 tbs bourbon
- 0.098 cups bread flour
- 0.006 cups brown rice flour
- 1.133 cups butter
- 0.082 cups cake flour
- 0.378 oz cake mix
- 0.019 cups chocolate raisins
- 0.028 tsp cinnamon
- 0.006 cups coconut
- 0.019 tsp coconut extract
- 0.128 cups cookie mix
- 0.001 tsp coriander
- 0.057 tbs corn syrup
- 0.137 tsp cornstarch
- 0.006 tsp cream
- 0.009 cups crispy rice
- 0.125 cups dark brown sugar
- 0.112 cups dark chocolate chips
- 2.855 eggs
- 0.019 tsp espresso
- 0.011 cups flour
- 0.002 cups graham cracker
- 0.003 cups honey
- 0.029 tsp instant coffee
- 0.006 tsp lemon juice
- 1.194 cups light brown sugar
- 0.096 tsp liquer
- 0.005 cups macadamia
- 0.032 tbs maple
- 0.050 cups margarine
- 0.010 cups marshmallows
- 0.538 tbs milk
- 0.291 cups milk chocolate chips
- 0.005 tbs molasses
- 0.002 cups nestle
- 0.002 tsp nutmeg
- 0.055 cups nuts
- 0.227 cups oats
- 0.006 cups peanut butter
- 0.002 cups peanut butter chips
- 0.062 cups pecan
- 0.038 oz pudding mix
- 0.006 cups raisins
- 1.139 tsp salt
- 1.833 cups semisweet chocolate chips
- 0.160 cups shortening
- 0.088 tbs sour cream
- 1.025 cups sugar
- 0.027 tsp tartar
- 0.022 cups toffee
- 2.979 tsp vanilla
- 0.020 cups vegetable oil
- 0.019 tsp vinegar
- 0.326 cups walnut
- 0.010 cups water
- 0.002 cups wheat
- 0.048 cups wheat flour
- 0.49 cups white chocolate chip
- 0.005 tsp white pepper
- 0.003 tsp xanthum gum
- 0.010 cup zucchini
Directions
- Preheat the oven to 350 degrees F (175 degrees C).
- Sift together the flour, baking powder, baking soda and salt into a medium bowl and set aside.
- In another bowl, using a handheld mixer on medium-high speed, beat together the butter and the granulated and brown sugars until the mixture is light in texture, about 3 minutes.
- Add the vanilla and the egg; beat on low speed until just incorporated 10-15 seconds or so (if you beat the egg for too long, the cookies will be stiff). Stir in the chocolate chips.
- Spoon rounded tablespoonfuls of cookie dough onto 2 parchment paper-lined baking sheets, spacing 1" apart. Working with 1 large tablespoons of dough at a time, roll them into balls and place them on a cookie sheet (lined with parchment paper or a baking mat) about 2 inches apart.
- Bake for 8 to 10 minutes in the preheated oven, or until edges are golden. Let the cookies cool on the baking sheet for 2 minutes then transfer to a wire rack to cool completely.
Ingredients
- 4.0 cup butter flavored shortening
- 3.333 cups packed brown sugar
- 1.0 egg
- 1.0 tablespoon milk
- 4.0 cups all purpose flour
- 0.738 tsp baking powder
- 1.143 tsp baking soda
- 0.571 cups shortening
- 0.571 cups packed brown sugar
- 0.8 tablespoon vanilla extract
- 2.0 cups semisweet chocolate chips
Directions
- Preheat oven to 350 degrees .
- In a medium-sized mixing bowl , beat butter , brown sugar and white sugar until smooth . ( no mixer needed just use a wooden spoon , stir in walnuts if desired .
- Refrigerate cookie dough for two hours or until firm .
- preheat oven to 350 degrees F.
- Line a baking sheet lined with parchment paper .
- Whisk flour , baking powder , and salt in a small bowl . using an electric mixer until fluffy , 3 to 4 minutes . add egg and egg yolk until light and creamy . beat in the eggs one at a time , then the chips .
- Use a large cookie scoop onto baking sheets . Flatten mounds into 3-inch rounds using moistened palm of your hand .
- Bake for 7 minutes in the preheated oven , or until browned.
Ingredients
- 4.0 cups all purpose flour
- 2.0 tsp baking soda
- 1.0 tsp salt
- 1.0 cup white sugar
- 4.0 eggs
- 2.0 tsp baking soda
- 0.5 cup white sugar
- 0.75 cup granulated sugar
- 0.8 cup white sugar
- 2.0 eggs
- 2.0 tsp vanilla extract
- 1.904 cups seconds
- 1.218 cups packed brown sugar
- 0.5 cup white sugar
- 1.0 cup white sugar
- 1.2 cup packed brown sugar
- 1.0 cup white sugar
- 1.0 cup semisweet chocolate chips
Directions
- Preheat oven to 375 degrees F (175 degrees C).
- Sift together the flour, baking soda and salt in a madining cookies on the middle and for 12 to 15 minutes or until light and fluffy.
- Beat in eggs and vanilla until the cookies are golden brown, about 10 minutes if using a mix. Stir in chocolate chips and walnuts.
- Whisk the flour, baking soda and salt in large bowl with an electric mixer with the eggs and vanilla.
- Combine the flour, baking soda, and salt.
- Remove from baking sheets to cool on baking sheet for 5 minutes.
- Transfer cookies to bake for 10 to 12 minutes or until cookies are set and the cookie sheet.
- Bake for 10 to 12 minutes on the pans and mixing with baking sheets with parchment paper.