---
title: "Homework #0: Hello SYS-6018"
author: "**Your Name Here**"
format: sys6018hw-html
---
```{r config, include=FALSE}
# Set global configurations and settings here
knitr::opts_chunk$set() # set global chunk options
ggplot2::theme_set(ggplot2::theme_bw()) # set ggplot2 theme
```
# Required R packages and Directories
```{r packages, message=FALSE, warning=FALSE}
data_dir = 'https://mdporter.github.io/SYS6018/data/' # data directory
library(tidyverse) # functions for data manipulation
```
# Getting Help
The purpose of this (ungraded) homework is to help get you prepared for the semester. Don't panic if you don't immediately know the answers to some of these. I expect everyone will need to look things up. Take note of the areas that are rusty and plan to spend a bit of extra time to get up to speed. If some of these items are not even remotely familiar to you, then you probably have not satisfied the pre-requisite material; review the course syllabus and speak to me about any questions.
The teaching staff (TA and myself) are here to help! Don't wait too long before asking for help and do let us know right away if you are starting to fall behind. I will also publish the solutions after due date. It is **highly encouraged** that you study the posted solutions.
# R Resources
## a. Update R, RStudio, and Quarto
- Use the latest version (R 4.3.2, RStudio 2023.12.0, Quarto 1.3.450)
- Installation help
- R:
- RStudio:
- Quarto:
## b. Install/Update the following packages we will meet during this course:
- Dynamic report generation: `rmarkdown`, `knitr`
- Utility: `remotes`
- Working with Data: `tidyverse`
- Data: `ISLR`, `moderndive`, `MASS`
- Resampling: `boot`, `rsample`
- Modeling: `tidymodels`, `modelr`, `broom`
- Regression: `glmnet`, `FNN`,
- Classification: `e1071`,
- Trees: `rpart`, `rpart.plot`, `randomForest`, `ranger`
- Ensembles: `gbm`, `xgboost`
- Density Estimation: `fitdistrplus`, `ks`
- Clustering: `mclust`, `mixtools`
- Association Analysis: `arules`
- Networks: `igraph`
- Forecasting: `fpp3`
You can see which of your existing packages need updating by running:
```{r, echo=TRUE, eval=FALSE}
old.packages() %>% as_tibble()
```
Or use the `update.packages()` function to update them.
Note: Do not call `install.packages()` in this Quarto document; it only needs to be done once from the console. However you will need to use `library()` in Quarto since it needs to be called every time the document is compiled.
## c. Install the course quarto extension
This document will not compile until you load the `sys6018hw-html` quarto extension. To do this, open a terminal window (if using RStudio, look for the terminal tab) and navigate to the **same directory where this file is**. Then run:
```
quarto add mdporter/quarto-sys6018-hw
```
which should create an `_extensions` directory (if connected to the internet). This contains the formatting for the compiled html document.
# Tidyverse Resources
Read the following sections in [R for Data Science 2e](https://r4ds.hadley.nz/):
- The Whole Game
- Chapters 2-9
- Visualize
- Chapters 10-12
- Transform
- 12-15, 19
- Program
- 26-27
- Communicate
- 29
# Save/Bookmark the following cheatsheets and resources
[Posit Cheatsheets](https://posit.co/resources/cheatsheets/)
## **RStudio and Quarto**
- [RStudio IDE Cheatsheet](https://rstudio.github.io/cheatsheets/html/rstudio-ide.html)
- [Quarto Website](https://quarto.org/docs/authoring/markdown-basics.html)
- [Quarto Cheatsheet](https://rstudio.github.io/cheatsheets/html/quarto.html)
- [Latex Cheatsheet](https://wch.github.io/latexsheet/latexsheet-0.png)
## **R**
- [Base R](https://rstudio.github.io/cheatsheets/base-r.pdf)
- [Data Visualization Cheatsheet](https://rstudio.github.io/cheatsheets/html/data-visualization.html)
- [`ggplot2` website](https://ggplot2.tidyverse.org/)
- [Tidy Data Cheatsheet](https://rstudio.github.io/cheatsheets/html/tidyr.html)
- [`tidyr` website](https://tidyr.tidyverse.org/)
- [Data Transform Cheatsheet](https://rstudio.github.io/cheatsheets/html/data-transformation.html)
- [`dplyr` website](https://dplyr.tidyverse.org/)
- [Factors with forcats Cheatsheet](https://rstudio.github.io/cheatsheets/html/factors.html)
- [`forcats` website](https://forcats.tidyverse.org/)
- [Data Import Cheatsheet](https://rstudio.github.io/cheatsheets/html/data-import.html)
- [`readr` website](https://readr.tidyverse.org/)
- [Apply Functions Cheatsheet](https://rstudio.github.io/cheatsheets/html/purrr.html)
- [`purrr` website](https://purrr.tidyverse.org/)
## **Python with RStudio/RMarkdown** (Optional)
- [Python with R and Reticulate Cheatsheet](https://rstudio.github.io/cheatsheets/html/reticulate.html)
# Problem 1: Math Notation
## a. What are the equations for the least squares coefficients in linear regression (in matrix notation)? Use $X$ for the model/design/predictor matrix, and $Y$ the vector of outcomes.
::: {.callout-note title="Solution"}
Add Solution Here
:::
## b. Let $x_1, x_2, \ldots, x_n$ be a sample of length of time that a customer is on the phone with a call center help line. We feel comfortable modeling the data as coming from an *exponential distribution*. What is the MLE (Maximum Likelihood Estimate) of the parameter? Show your steps.
::: {.callout-note title="Solution"}
Add Solution Here
:::
# Problem 2: Coding Practice
## a. Simulate 100 observations from the following model:
- $X \sim N(1, 1)$
- $Y \sim N(1 + 2X, 2)$
- $Z = \begin{cases} 1 &\quad Y<0 \\ 2 &\quad Y \ge 0 \end{cases}$
::: {.callout-note title="Solution"}
Add Solution Here
:::
## b. Make a scatter plot of the data. Put $X$ on the x-axis and $Y$ on the y-axis. Color the points according to $Z$.
::: {.callout-note title="Solution"}
Add Solution Here
:::
## c. Write a function that adds two numbers together and squares the result.
::: {.callout-note title="Solution"}
Add Solution Here
:::
## d. Write a loop to calculate the mean of every column in `mtcars`.
::: {.callout-note title="Solution"}
Add Solution Here
:::
# Problem 3: Statistics
## a. Find two [quantiles](https://en.wikipedia.org/wiki/Quantile) that capture 95% of the following data:
```{r}
set.seed(2022)
x = runif(n=100, min=2, max=22)
```
::: {.callout-note title="Solution"}
Add Solution Here
:::
## b. Confidence Interval
A new machine learning model, developed by UVA researchers, uses biopsy images to predict if a child has enteropathy or celiac disease. [In a study of 102 patients](https://jamanetwork.com/journals/jamanetworkopen/fullarticle/2735765), the model was able to correctly classify 95 of the images.
Find the 90% [confidence interval](https://en.wikipedia.org/wiki/Confidence_interval) for the probability a patient is correctly classified?
::: {.callout-note title="Solution"}
Add Solution Here
:::
## c. Linear Models
- Albemarle County real estate assessment data can be found [at this link](https://raw.githubusercontent.com/uvastatlab/phdplus2021/main/data/albemarle_real_estate.csv).
1. Fit a linear regression model that predicts the `TotalValue` using the predictors: `Condition`, size (`FinSqFt`), and location (`City`).
2. What are the estimated coefficients?
3. What is the estimated `TotalValue` for home with the following characteristics?
```{r, echo=FALSE}
tibble(FinSqFt = c(2500, 1850),
City = c('EARLYSVILLE', 'CROZET'),
Condition = c('Good', 'Fair')) %>%
knitr::kable()
```
::: {.callout-note title="Solution"}
Add Solution Here
:::
## d. Hypothesis Testing
Use the `movies_sample` (IMDb) data from the `moderndive` R package to performance a hypothesis test that *Action* movies are ranked lower (on average) than *Romance* movies.
::: {.callout-note title="Solution"}
Add Solution Here
:::