## Selected projects in data science, machine learning and NLP
---
### Deep NLP for hate speech detection
Hate speech detection is the automated task of determining whether a piece of text contains hateful content. In this project, I built a classifier using PyTorch to fine-tune a BERT model.
[](#) [](#) [](#) [](#) [](#)
[View code on Colab](https://colab.research.google.com/drive/1d_q0vUpgwmbN7imUcdsbuDwJ61OuBjvO?usp=sharing)
---
### Examining panic-buying during the first wave of Covid-19, using mobility data
The first wave of COVID-19 infections led to widespread stories of shortages in grocery stores as consumers stocked up in anticipation of lockdowns, a behaviour colloquially known as ‘panic buying’. In this project, I used mobility data from Google and Apple to empirically investigate the extent of panic buying in different countries.
[](#) [](#) [](#) [](#) [](#) [](#)
View code on Colab
---
### The Fragile Families Challenge: ML with Bayesian hyperparameter tuning, KNN missing values imputation, and data preprocessing Pipelines
The Fragile Families Challenge was a predictive modelling challenge commissioned by researchers at Princeton University in 2017. In the challenge, participants were tasked with predicting six life outcomes (GPA, material hardship, grit, eviction, layoff, and job training) for 4,242 children based on their cirumstances between birth and age 9.
I took part in this challenge, using various ML and NLP techniques including: (i) imputing missing values using word embeddings and KNN, (ii) modelling with LASSO, Random Forests and XGBoost models, (iii) Bayesian hyperparameter optimisation, and (iv) using feature importance scores to interpret the models' predictions.
[](#) [](#) [](#) [](#) [](#) [](#)
[View code on Colab](https://colab.research.google.com/drive/1eMRq-WAtegW5_J5OhTPWoeB3QNf64D-A?usp=sharing)
---
### Implementing a custom data collection pipeline using Scrapy and MongoDB
The web hosts vast quantities of data useful for research. In this project, I built a custom data collection pipeline using the Python library `scrapy` and a MongoDB cluster.
[](#) [](#) [](#) [](#)
[View code on Github](https://github.com/mattschapman/mattschapman.github.io/tree/master/projects/mongodb_crawler/spiders)
---
### Geospatial analysis of deprivation in London
In this project, I use Geopandas to visualise data on deprivation levels in London and analyse changes over time.
[](#) [](#) [](#) [](#) [](#)
View code on Colab
---
### Interpretable machine learning: Parital Dependence Plots, LIME and Shapley values
A significant barrier to ML's adoption in many fields is the lack of interpretability of black box models. In this project, I use several techniques to gain insights into various models.
[](#) [](#) [](#) [](#) [](#)
[View code on Colab](https://colab.research.google.com/drive/1Msk1tmph1IQYom596vy3MmMwESID0KaW?usp=sharing)
---
### Using multi-level modelling in R to investigate the drivers of Covid-19 vaccine hesitancy
In many tasks, failing to account for the hierarchical relations and autocorrelations between data can create "ecological fallacies" which misguide our interpretation of the data. In this project, I use mutli-level regression modelling to account for spatial autocorrelation and study reasons for Covid-19 vaccine hesitancy.
[](#) [](#) [](#)
View code on Github
---
## Skills-based projects
A selection of smaller projects demonstrating specific data science and ML skills.
- [Working in the cloud: Using data stored in AWS S3 buckets](#)
- [Optimising code with multiprocessing](#)