\n",
"\n",
" \n",
"
\n",
"
"
],
"text/plain": [
" top1 top2 top3 \\\n",
"jamaican salt onions water \n",
"moroccan salt olive oil ground cumin \n",
"irish salt all-purpose flour butter \n",
"russian salt sugar onions \n",
"greek salt olive oil dried oregano \n",
"french salt sugar all-purpose flour \n",
"italian salt olive oil garlic cloves \n",
"korean soy sauce sesame oil garlic \n",
"thai fish sauce garlic salt \n",
"vietnamese fish sauce sugar salt \n",
"southern_us salt butter all-purpose flour \n",
"cajun_creole salt onions garlic \n",
"indian salt onions garam masala \n",
"british salt all-purpose flour butter \n",
"mexican salt onions ground cumin \n",
"brazilian salt onions olive oil \n",
"spanish salt olive oil garlic cloves \n",
"filipino salt garlic water \n",
"chinese soy sauce sesame oil salt \n",
"japanese soy sauce salt mirin \n",
"\n",
" top4 top5 \\\n",
"jamaican garlic ground allspice \n",
"moroccan onions ground cinnamon \n",
"irish onions potatoes \n",
"russian all-purpose flour sour cream \n",
"greek garlic cloves feta cheese crumbles \n",
"french unsalted butter olive oil \n",
"italian grated parmesan cheese garlic \n",
"korean green onions sugar \n",
"thai coconut milk vegetable oil \n",
"vietnamese garlic water \n",
"southern_us sugar large eggs \n",
"cajun_creole green bell pepper butter \n",
"indian water ground turmeric \n",
"british milk eggs \n",
"mexican garlic olive oil \n",
"brazilian lime water \n",
"spanish extra-virgin olive oil onions \n",
"filipino onions soy sauce \n",
"chinese corn starch sugar \n",
"japanese sugar water \n",
"\n",
" top6 top7 \\\n",
"jamaican pepper scallions \n",
"moroccan garlic cloves water \n",
"irish sugar baking soda \n",
"russian eggs water \n",
"greek extra-virgin olive oil fresh lemon juice \n",
"french butter water \n",
"italian ground black pepper extra-virgin olive oil \n",
"korean salt water \n",
"thai soy sauce sugar \n",
"vietnamese carrots soy sauce \n",
"southern_us baking powder water \n",
"cajun_creole olive oil cayenne pepper \n",
"indian garlic cumin seed \n",
"british unsalted butter sugar \n",
"mexican chili powder jalapeno chilies \n",
"brazilian garlic cloves garlic \n",
"spanish water tomatoes \n",
"filipino pepper oil \n",
"chinese garlic water \n",
"japanese sake rice vinegar \n",
"\n",
" top8 top9 top10 \n",
"jamaican dried thyme black pepper garlic cloves \n",
"moroccan ground ginger carrots paprika \n",
"irish baking powder milk carrots \n",
"russian butter unsalted butter large eggs \n",
"greek ground black pepper garlic pepper \n",
"french large eggs garlic cloves ground black pepper \n",
"italian onions water butter \n",
"korean sesame seeds onions scallions \n",
"thai water garlic cloves fresh lime juice \n",
"vietnamese shallots garlic cloves vegetable oil \n",
"southern_us unsalted butter milk buttermilk \n",
"cajun_creole cajun seasoning all-purpose flour water \n",
"indian ground cumin vegetable oil oil \n",
"british onions baking powder large eggs \n",
"mexican sour cream avocado corn tortillas \n",
"brazilian cachaca sugar tomatoes \n",
"spanish ground black pepper red bell pepper pepper \n",
"filipino sugar carrots ground black pepper \n",
"chinese green onions vegetable oil scallions \n",
"japanese vegetable oil scallions ginger "
]
},
"execution_count": 10,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"top10 = pd.DataFrame([[items[0] for items in counters[cuisine].most_common(10)] for cuisine in counters],\n",
" index=[cuisine for cuisine in counters],\n",
" columns=['top{}'.format(i) for i in range(1, 11)])\n",
"top10"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"An even better visualisation would be to have images instead of words for this visualization. We can do this by exporting the previous table to html and replacing the ingredient names with HTML image tags for the selected ingredients. This is done using regular expression matching, while the image is base64 encoded in the source ([thanks](http://stackoverflow.com/questions/606191/convert-bytes-to-a-python-string))."
]
},
{
"cell_type": "code",
"execution_count": 11,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"import re\n",
"import base64"
]
},
{
"cell_type": "code",
"execution_count": 12,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"import pdb"
]
},
{
"cell_type": "code",
"execution_count": 13,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"def repl(m):\n",
" ingredient = m.groups()[0]\n",
" image_path = 'img/' + ingredient + '.png'\n",
" with open(image_path, \"rb\") as image_file:\n",
" encoded_string = base64.b64encode(image_file.read())\n",
" return '| \n", " | top1 | \n", "top2 | \n", "top3 | \n", "top4 | \n", "top5 | \n", "top6 | \n", "top7 | \n", "top8 | \n", "top9 | \n", "top10 | \n", "
|---|---|---|---|---|---|---|---|---|---|---|
| jamaican | \n", "salt | \n", "onions | \n", "water | \n", "garlic | \n", "ground allspice | \n", "pepper | \n", "scallions | \n", "dried thyme | \n", "black pepper | \n", "garlic cloves | \n", "
| moroccan | \n", "salt | \n", "olive oil | \n", "ground cumin | \n", "onions | \n", "ground cinnamon | \n", "garlic cloves | \n", "water | \n", "ground ginger | \n", "carrots | \n", "paprika | \n", "
| irish | \n", "salt | \n", "all-purpose flour | \n", "butter | \n", "onions | \n", "potatoes | \n", "sugar | \n", "baking soda | \n", "baking powder | \n", "milk | \n", "carrots | \n", "
| russian | \n", "salt | \n", "sugar | \n", "onions | \n", "all-purpose flour | \n", "sour cream | \n", "eggs | \n", "water | \n", "butter | \n", "unsalted butter | \n", "large eggs | \n", "
| greek | \n", "salt | \n", "olive oil | \n", "dried oregano | \n", "garlic cloves | \n", "feta cheese crumbles | \n", "extra-virgin olive oil | \n", "fresh lemon juice | \n", "ground black pepper | \n", "garlic | \n", "pepper | \n", "
| french | \n", "salt | \n", "sugar | \n", "all-purpose flour | \n", "unsalted butter | \n", "olive oil | \n", "butter | \n", "water | \n", "large eggs | \n", "garlic cloves | \n", "ground black pepper | \n", "
| italian | \n", "salt | \n", "olive oil | \n", "garlic cloves | \n", "grated parmesan cheese | \n", "garlic | \n", "ground black pepper | \n", "extra-virgin olive oil | \n", "onions | \n", "water | \n", "butter | \n", "
| korean | \n", "soy sauce | \n", "sesame oil | \n", "garlic | \n", "green onions | \n", "sugar | \n", "salt | \n", "water | \n", "sesame seeds | \n", "onions | \n", "scallions | \n", "
| thai | \n", "fish sauce | \n", "garlic | \n", "salt | \n", "coconut milk | \n", "vegetable oil | \n", "soy sauce | \n", "sugar | \n", "water | \n", "garlic cloves | \n", "fresh lime juice | \n", "
| vietnamese | \n", "fish sauce | \n", "sugar | \n", "salt | \n", "garlic | \n", "water | \n", "carrots | \n", "soy sauce | \n", "shallots | \n", "garlic cloves | \n", "vegetable oil | \n", "
| southern_us | \n", "salt | \n", "butter | \n", "all-purpose flour | \n", "sugar | \n", "large eggs | \n", "baking powder | \n", "water | \n", "unsalted butter | \n", "milk | \n", "buttermilk | \n", "
| cajun_creole | \n", "salt | \n", "onions | \n", "garlic | \n", "green bell pepper | \n", "butter | \n", "olive oil | \n", "cayenne pepper | \n", "cajun seasoning | \n", "all-purpose flour | \n", "water | \n", "
| indian | \n", "salt | \n", "onions | \n", "garam masala | \n", "water | \n", "ground turmeric | \n", "garlic | \n", "cumin seed | \n", "ground cumin | \n", "vegetable oil | \n", "oil | \n", "
| british | \n", "salt | \n", "all-purpose flour | \n", "butter | \n", "milk | \n", "eggs | \n", "unsalted butter | \n", "sugar | \n", "onions | \n", "baking powder | \n", "large eggs | \n", "
| mexican | \n", "salt | \n", "onions | \n", "ground cumin | \n", "garlic | \n", "olive oil | \n", "chili powder | \n", "jalapeno chilies | \n", "sour cream | \n", "avocado | \n", "corn tortillas | \n", "
| brazilian | \n", "salt | \n", "onions | \n", "olive oil | \n", "lime | \n", "water | \n", "garlic cloves | \n", "garlic | \n", "cachaca | \n", "sugar | \n", "tomatoes | \n", "
| spanish | \n", "salt | \n", "olive oil | \n", "garlic cloves | \n", "extra-virgin olive oil | \n", "onions | \n", "water | \n", "tomatoes | \n", "ground black pepper | \n", "red bell pepper | \n", "pepper | \n", "
| filipino | \n", "salt | \n", "garlic | \n", "water | \n", "onions | \n", "soy sauce | \n", "pepper | \n", "oil | \n", "sugar | \n", "carrots | \n", "ground black pepper | \n", "
| chinese | \n", "soy sauce | \n", "sesame oil | \n", "salt | \n", "corn starch | \n", "sugar | \n", "garlic | \n", "water | \n", "green onions | \n", "vegetable oil | \n", "scallions | \n", "
| japanese | \n", "soy sauce | \n", "salt | \n", "mirin | \n", "sugar | \n", "water | \n", "sake | \n", "rice vinegar | \n", "vegetable oil | \n", "scallions | \n", "ginger | \n", "
| \n", " | top1 | \n", "top2 | \n", "top3 | \n", "top4 | \n", "top5 | \n", "top6 | \n", "top7 | \n", "top8 | \n", "top9 | \n", "top10 | \n", "
|---|---|---|---|---|---|---|---|---|---|---|
| jamaican | \n", "||||||||||
| moroccan | \n", "||||||||||
| irish | \n", "||||||||||
| russian | \n", "||||||||||
| greek | \n", "||||||||||
| french | \n", "||||||||||
| italian | \n", "||||||||||
| korean | \n", "||||||||||
| thai | \n", "||||||||||
| vietnamese | \n", "||||||||||
| southern_us | \n", "||||||||||
| cajun_creole | \n", "||||||||||
| indian | \n", "||||||||||
| british | \n", "||||||||||
| mexican | \n", "||||||||||
| brazilian | \n", "||||||||||
| spanish | \n", "||||||||||
| filipino | \n", "||||||||||
| chinese | \n", "||||||||||
| japanese | \n", "
\n",
"\n",
" \n",
"
\n",
"
"
],
"text/plain": [
" cuisine id ingredients \\\n",
"0 greek 10259 [romaine lettuce, black olives, grape tomatoes... \n",
"1 southern_us 25693 [plain flour, ground pepper, salt, tomatoes, g... \n",
"2 filipino 20130 [eggs, pepper, salt, mayonaise, cooking oil, g... \n",
"3 indian 22213 [water, vegetable oil, wheat, salt] \n",
"4 indian 13162 [black pepper, shallots, cornflour, cayenne pe... \n",
"\n",
" all_ingredients \n",
"0 romaine lettuce;black olives;grape tomatoes;ga... \n",
"1 plain flour;ground pepper;salt;tomatoes;ground... \n",
"2 eggs;pepper;salt;mayonaise;cooking oil;green c... \n",
"3 water;vegetable oil;wheat;salt \n",
"4 black pepper;shallots;cornflour;cayenne pepper... "
]
},
"execution_count": 17,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"df_train.head()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"We can now take advantage of the powerful string processing functions of pandas to check for the presence of an ingredient in a recipe:"
]
},
{
"cell_type": "code",
"execution_count": 18,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/plain": [
"0 False\n",
"1 False\n",
"2 False\n",
"3 False\n",
"4 False\n",
"5 False\n",
"6 False\n",
"7 False\n",
"8 False\n",
"9 False\n",
"10 False\n",
"11 False\n",
"12 True\n",
"13 False\n",
"14 False\n",
"15 False\n",
"16 False\n",
"17 False\n",
"18 False\n",
"19 False\n",
"20 False\n",
"21 False\n",
"22 False\n",
"23 False\n",
"24 False\n",
"25 False\n",
"26 False\n",
"27 False\n",
"28 False\n",
"29 False\n",
" ... \n",
"39744 True\n",
"39745 False\n",
"39746 False\n",
"39747 False\n",
"39748 False\n",
"39749 False\n",
"39750 False\n",
"39751 False\n",
"39752 False\n",
"39753 True\n",
"39754 True\n",
"39755 False\n",
"39756 False\n",
"39757 True\n",
"39758 False\n",
"39759 False\n",
"39760 False\n",
"39761 True\n",
"39762 False\n",
"39763 False\n",
"39764 False\n",
"39765 False\n",
"39766 False\n",
"39767 False\n",
"39768 False\n",
"39769 False\n",
"39770 False\n",
"39771 False\n",
"39772 False\n",
"39773 False\n",
"Name: all_ingredients, dtype: bool"
]
},
"execution_count": 18,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"df_train['all_ingredients'].str.contains('garlic cloves')"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"This can be used to group our recipes by the presence of that ingredient:"
]
},
{
"cell_type": "code",
"execution_count": 19,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/plain": [
"| \n", " | cuisine | \n", "id | \n", "ingredients | \n", "all_ingredients | \n", "
|---|---|---|---|---|
| 0 | \n", "greek | \n", "10259 | \n", "[romaine lettuce, black olives, grape tomatoes... | \n", "romaine lettuce;black olives;grape tomatoes;ga... | \n", "
| 1 | \n", "southern_us | \n", "25693 | \n", "[plain flour, ground pepper, salt, tomatoes, g... | \n", "plain flour;ground pepper;salt;tomatoes;ground... | \n", "
| 2 | \n", "filipino | \n", "20130 | \n", "[eggs, pepper, salt, mayonaise, cooking oil, g... | \n", "eggs;pepper;salt;mayonaise;cooking oil;green c... | \n", "
| 3 | \n", "indian | \n", "22213 | \n", "[water, vegetable oil, wheat, salt] | \n", "water;vegetable oil;wheat;salt | \n", "
| 4 | \n", "indian | \n", "13162 | \n", "[black pepper, shallots, cornflour, cayenne pe... | \n", "black pepper;shallots;cornflour;cayenne pepper... | \n", "