{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "## Missing column entries\n", "\n", "
\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Name 457894**Missing 2**
Department457677**Missing 219**
OrganizationID457896Missing 0
Institution457896Missing 0
ProvinceEN454115**Missing 3781**
CountryEN457896Missing 0
FiscalYear457896Missing 0
AwardAmount457896Missing 0
ProgramID457896Missing 0
ProgramNameEN457896Missing 0
Committee457896Missing 0
ResearchSubjectEN457896Missing 0
\n", "
\n", " As you can see some of the data columns are missing values.
\n", "
\n", " The missing Name data is for two 'Head Office' departments, so it does not get assigned to a specific name/person. One of these is for PIMS.
\n", "
\n", " The missing Department data seems unimportant but keep it in mind if you use any department selection or functions.
\n", "
\n", " The missing ProvinceEN data is mostly for non-canadian awards, and the canadian ones are for programs that are in more than one province.
\n", " \n", "
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Messy Data\n", "\n", "The 'ProgramID' column has leading whitespace that causes an issue if we do not remove it." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Search by Subject Issue\n", "Currently we are selecting funding based on subjects using the committee number. For example 1508 for mathematics,\n", "however this is problematic. You can see an example by selecting for 'Adem, Alejandro' in the SelectionsTemplate. They are clearly a mathematician in the math department however none of their committees are 1508. We will need to implement some regex to search for ex. 'Math*' in a few of the columns, then implement this as subject selection.
\n", "Columns that need to be searched for the subject word are: Department, Institution. We would also include all of committee 1508." ] } ], "metadata": { "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.6.4" } }, "nbformat": 4, "nbformat_minor": 2 }