Opportunity Insights Economic Tracker
Data Revisions

last updated on 2026-10-16

PDF Download Click here to download a PDF version of this document

Overview

This document provides a description of major revisions to the data posted by the Opportunity Insights Economic Tracker. The document is organized sequentially by series in the tracker, among series that have had substantive data revisions since June 30, 2021 due to changes in data processing or data sources over time.

This document is updated regularly and the following information is subject to change.

For further information or if you have any questions please feel free to reach out to info@opportunityinsights.org and someone on our team will be in touch.

Active Data Series

Consumer Spending

Revisions on March 15th 2022

The consumer spending data was revised with three changes:

  1. We have improved our modeling of spending levels over time to better control for growth (or shrinkage) in payment providers’ customer bases. Previously we controlled for the sharp discontinuities generated by entries and exits of payment providers, but did not control for steady growth or shrinkage in individual payment providers’ customer bases. We have detected an increase in the customer base of existing payment providers during the year 2021, which was biasing our estimates of spending upward. The new processing, described in detail below, causes a downward revision in our estimates of the change in consumer spending—primarily in the second half of 2021.

    Our objective is to simultaneously (1) isolate and remove variation in spending driven by the number of debit/credit cards in our sample changing due to growth or shrinkage in a payment provider’s customer base, and (2) incorporate variation in spending driven by the number of debit/credit cards in our sample changing due to changes in the utilization of cards, which can reflect underlying economic conditions. To account for both, we first estimate a two-state switching model of the relationship between Personal Consumption Expenditure as measured by the U.S. Bureau of Economic Analysis and the level of credit and debit spending and number of cards in usage we received from Affinity Solutions. Our estimates imply a state change between February 2020 and August 2020: the number of cards in use is predictive of Personal Consumption Expenditures during this period, but statistically insignificant outside this period. This is consistent with a pattern where people exhibited extensive margin changes in card spending during the initial waves of COVID-19, but outside of that period changes in the number of cards being used reflect changes in the number of people in-sample as opposed to changes in the propensity to consume of a given set of people.

    We therefore construct an estimate of spending that reflects total spending during February to August 2020 and spending per card outside this period. For each location (l), industry (i) and time (t) we compute:

  1. We have improved the internal mapping between Merchant Category Codes (MCCs) to corresponding industry sectors to be more accurate. This causes a noticeable revision in the Transportation series.

  2. We have improved the amount of state-level data available by changing the aggregation of masked cells. Previously data in masked county-level cells were included in the national-level data but excluded from the state-level data. Now data in masked cells is included in the state-level data, which increases the set of state-level series available.

Revisions on June 15 2022

We have revised the method implemented on March 15, 2022 to control for steady growth or shrinkage in individual payment providers’ customer bases.

Revisions on August 12th 2022

As of June 5, 2022 we only receive consumer spending data at a weekly level of aggregation. We will continue to publish weekly data on consumer spending, but we will not publish daily variation past June 5, 2022.

Revisions on September 9th 2022

From August 12 to September 9, 2022, an error in the processing code resulted in small but significant biases due to incorrect chain-weighting around the sharp discontinuities generated by entries and exits of payment providers. For more information about the procedure for correcting those discontinuities, see the “Revisions on March 15th 2022” above.

During this period, the number of cards was correctly chain-weighted at break dates, but the spending per card was not being chain-weighted. This has been corrected in the latest data release so that both are chain weighted at break dates. Before and after this revision, the trends are similar. However, there are noticeable level changes in a handful of states: FL, ID, KY, ME, MO, OK and SD.

Revisions on December 2nd 2022

We corrected a bug in the implementation of our chain-weighting methodology. This methodology adjusts counties with sharp discontinuities generated by entries and exits of payment providers, as explained in Appendix B.2 of the companion paper:

we correct our estimates as follows. We first compute the state-level week-to-week percent change in spending excluding all counties with a structural break (using the national series for DC and states for which all counties have a structural break). If we identify a structural break in week t, we impute spending levels in weeks t − 1, t, and t + 1, as we cannot ascertain the precise date when the structural break occurred (e.g., it may have occurred on the 2nd day of week t − 1 or the 6th day of week t). When there is a change in coverage we adjust the series to be in line with the lower level of coverage.

From March 15 to December 2, 2022, the series was always chain-weighted forwards, so that it was always in line with the level of coverage prior to the discontinuity — rather than the lower level of coverage. This has been corrected so that the series is now chain-weighted forwards or backwards to be in line with the lower level of coverage. This has resulted in a noticeable revision to a few counties, which now have lower levels after a discontinuous break. At the state level, this adjustment has resulted in only minor revisions.

Revisions on June 14th 2023

We added four supplemental files:

For more details, please see the data documentation.

Revisions on July 21st 2023

We refined the date handling in our holiday adjustment methodology at the weekly level and corrected a processing error at the daily level. As described in Appendix B.2 of the companion paper, we intend to seasonally adjust the data by calculating, for each week and day, the year-on-year change relative to the 2019 value. To account for holidays, the year-on-year change for dates with holidays after 2019 is calculated relative to the day or week of the same holiday in 2019. In the latest release we have made two changes. First, we have updated how we define and align weeks across years during our adjustments of the weekly level data, and as a result, there are small revisions around some holidays. Second, due to an error in our processing scripts our holiday adjustments were being incorrectly applied to the daily level data. We have now fixed this error and the adjustments are being applied appropriately resulting in smoothing of the series around holidays.

Revisions on August 15th 2023

As of August 15, 2023 we receive a larger sample of consumer spending data from 2022 to present, resulting in small revisions to the series.

Revisions on March 14th 2024

We further refined our holiday adjustment methodology at the weekly level. As described in Appendix B.2 of the companion paper and the revisions statement on July 21st 2023, we seasonally adjust the data by calculating, for each week and day, the year-on-year change relative to the 2019 value. To account for holidays, the year-on-year change for dates with holidays after 2019 is calculated relative to the day or week of the same holiday in 2019.

From July 21st, 2023 to March 14th, 2024, our processing steps sometimes aligned the weekly data with the corresponding 2019 values by aligning both values with the week of the holiday in 2020. This resulted in a few cases where the values of the published indexed series were shifted a week forwards or backwards to match the weeks relative to the holiday in 2020. In the latest release, this has been corrected: the holiday adjustments are only applied to the 2019 values in our calculations, so the final indexed value is never shifted. This correction caused small revisions around some federal holidays.

Job Postings

Revisions on December 15th 2021

At the request of Lightcast (formerly known as Burning Glass Technologies) we’ve suppressed the historical data we publish for the following Job Postings series:

Revisions on August 30th 2022

Lightcast detected and corrected for a data anomaly related to a major national job board. This correction retroactively revises the data from May 2022 onward: a downward revision in May, an upward revision in June, and a downward revision in July. Lightcast issued the following statement outlining the data anomaly observed and corrective actions taken:

As you may know, Lightcast has over a billion job postings, career profiles, and other data points. As the labor market shifts through changes in the economy, our team actively reviews and manages our data set, working daily to refine our taxonomy and review data sources.

That’s why we set the global standard on commitment to data excellence - ensuring our data is consistent with other sources and benchmarked to the BLS Job Openings and Labor Turnover Survey (JOLTS) report.

One example of why this is important is a recent anomaly that our data team monitored in job posting data. The team found an uptick in posting numbers for May from one of the major national job boards. This trend then dropped in June and increased again in July.

The Lightcast team determined that this anomaly was the result of a change in job posting methodology at this particular source, and to compensate, the Lightcast data team changed how that data is reflected in our overall job posting numbers. In this case, users will see adjustments in the reported numbers and trendlines for May, June, and July, and in limited cases, may want to re-run analyses for these months.

Revisions on December 6th 2022

We have changed the file names of the data files corresponding to our job postings series: they are now prefixed Job Postings - * instead of Burning Glass - *. The data provider, the data received, and the data processing steps we perform remain otherwise unchanged.

We have renamed the files in light of the recent name change by our data provider, which now operates as Lightcast and was formerly known as Burning Glass Technologies.

Revisions on June 26th 2023

We added a supplemental file:

For more details, please see the data documentation.

Revisions on September 1st 2023

We have updated the Lightcast datastream and API used to pull the job postings data in response to the deprecation of the existing datastream and its corresponding API we have used up to this point. As part of the change to the new datastream, the existing scraped raw job postings data has undergone revamped and improved classification and coding by Lightcast resulting in both some small retroactive changes in the aggregate counts of postings and noticeable retroactive changes in the counts of postings by super sector and required education level as posts in the raw data were reclassified. As such, small retroactive changes in the total postings series have been made as well as moderate retroactive changes have been made to the industry and education level subgroup series.

Revisions on November 7th 2023

On 2023-11-03 Lightcast rolled out improvements to their deduplication processing of raw job postings where advances made to their job posting classification methodology were applied to produce more accurate posting counts. As a result, postings levels have been retroactively adjusted by a relatively small amount with the years 2022-2023 most impacted. This has resulted in small retroactive changes to the job postings series. For more details on the impact of the changes on the underyling posting counts please see Lightcast’s summary document here and for more details on Lightcast’s processing methodology please see here.

Revisions on December 18th 2023

On 2023-12-15 Lightcast deprecated the use of 2017 NAICS codes as part of their postings data API in favor of 2022 NAICS codes noting the option to use 2017 codes would be removed in 60 days. In response we have switched to using raw data where job postings industries are classified by 2022 NAICS codes. This has led to small retroactive revisions for the job postings by industry subgroup series as postings were reclassified into different categories prior to aggregation.

Revisions on January 14th 2025

On 2025-01-14 we updated the Job Posting series going forward to be published up to the Friday of two weeks ago rather than the Friday of the previous week. This is in response to an increased lag in the complete publication of the underlying raw data to the API we pull from that we’ve observed results in often incomplete and frequently revisied postings counts week to week when previous data pulls were performed.

Revisions on June 23rd 2025

We detected an error in our county by industry sector and jobzone processing that was suppressing a subset of counties that should have been included in the publicly available series. That error has been resolved and data on postings by industry sector and jobzone for those counties has been restored.

Revisions on January 28th 2026

On January 16th, 2026 Lightcast updated their job postings database to include improved geocoding of postings and a new category of postings not tied to subnational geography cells. Previously, as postings were always tied to at least the state level we built the national series from the sum of state level postings. In light of the changes we have updated the national series data to be pulled directly from the lightcast database so that it includes the new postings not tied to subnational geography cells. These changes to the underlying data have resulted in a overall retroactive upwards revision to the national series beginning in 2023 with the largest changes occurring over the course of 2023. For more details from Lightcast on the changes please see here.

Revisions on February 24th 2026

On February 16th, 2026 Lightcast revised their job postings database retroactively lowering the level of postings throughout 2023 and into mid 2024. This revision undoes a large part of the upwards revision made in the previous January 16th update. More information from Lightcast on the changes will be included when and if it becomes available.

Employment

Revisions on June 30th 2021

The Employment data was revised on June 30, 2021 due to three independent changes in methodology.

After making these changes, the (population-weighted) RMSE (root mean square error) of the state-level employment series relative to the CPS is 4.55 percentage points as of April 2021, after removing public sector and furloughed workers and expressing employment in seasonally-unadjusted terms relative to January 2020. Though we will continue to assess our series relative to the CPS, users should note that some amount of noise remains in both our state-level series estimates and in the CPS estimates. Particularly in instances where these two measures of employment differ, users may consider both the Opportunity Insights series and the CPS as helpful inputs in identifying local patterns.

Revisions on May 21st 2022

The Employment data was revised on May 21, 2022 due to four independent changes in methodology.

We adopt this alternative weighting scheme for cells with 50 or fewer employees to balance the fact that small firm births account for a sizable portion of the economic recovery in the second half of 2020 against the fact that growth of small cells can also be spuriously driven by entry into our sample. This new weightng scheme leads to better estimates of employment relative to public benchmarks (CES, QCEW, CPS, etc).

Revisions on October 17th 2022

The Employment data was revised in several ways.

Revisions on April 14th 2023

The Employment data was revised on April 14, 2023 to correct a data processing error.

From December 16, 2022 to April 14, 2023, there was a bug in the code adjusting for discontinuities in the Paychex data when quartile thresholds cross integer wages. For more details on this adjustment see Online Appendix E.2 of Chetty, Friedman, Hendren and Stepner (April 2023). During this period, the adjustment for the mass of employees at wage $X was incorrectly being made using the mass of employees at the lower wage $X-1. These discontinuities were therefore incompletely smoothed.

After correcting the code, the employment trends are smoother around these discontinuities. The overall trends in employment changes over time are unchanged.

Revisions on June 26th 2023

We added a supplemental file:

For more details, please see the data documentation.

Revisions on September 17th 2026

The employment series was overhauled on September 17, 2026 to roll out a new series built using a continuing unit methodology from Paychex client data. This new methodology has been applied to all series, from January 2016 through the present and differs from the prior methodology in the following ways.

The new data and methodology track public measures such as the CES and the Quarterly Census of Employment and Wages (QCEW) much more closely than before. Because growth is measured only among continuing employers, the series omits the contribution of firm births net of deaths, which cannot be distinguished from employers entering or leaving Paychex, and is best interpreted as employment growth within an evolving matched sample of employers rather than as a level of total employment. For a full description of the methodology and its validation against the QCEW and CES, see Bell, Dunn, English, Hood, Mance, Mason, Quistorff and Stepner, “Expanding the Frontier of Economic Measurement: Weekly Regional Employment Statistics” (2026).

Revisions on October 16th 2026

The employment series was revised on October 16, 2026 to correct an employee counting error in the processing pipeline. A type conversion applied when payroll records were read was setting some employees’ hours values to zero rather than preserving them and later imputing them, so weekly raw employment counts among continuing employers were understated. Because this processing was consistent, however, the effect on the growth rate derived final series is muted. In fixing the type conversion the Alteryx components of the pipeline have been migrated to Python.

Unemployment Claims

Revisions on July 29th 2021

The unemployment data was revised on July 29, 2021 to correct a data processing error. Previously we assigned continued PEUC and PUA claims to the end of week date indicated by the Report Date rather than the Reflect Date in the Department of Labor data. Effectively, this meant continued PEUC and PUA claims were offset by one week into the future in our data. We’ve corrected this, and claims now align to the appropriate week.

Revisions on July 20th 2023

The unemployment data was revised on July 20, 2023 to change the frequency of the county level Iowa initial claims data from the weekly frequency to the monthly frequency in light of changes in the underlying data’s publication at the Iowa Workforce Development - Labor Market Information Division.

Archived Data Series

Small Business Revenue & Small Businesses Open

Revisions on March 4th 2022

We now derive our published datasets using a county-level panel of small businesses. In each calendar year, we follow the sample of businesses operating during the first week of the year (i.e. we start following a new panel each calendar year). No new businesses enter our panel during the calendar year. Businesses may exit because they stop operating or because the underlying payment processors ceased providing data.

We detect cases where a payment processor disappears by detecting sharp drops in businesses operating, at the national and the state level. We then adjust the series to remove these drops at the State x Industry level, using the following assumptions:

After performing these adjustments, we aggregate up to the State level, the National x Industry level, and the National level.

Since the no-entry panel does not cover the ZIP code level, we impute the ZIP code level data to reconcile it with the rest of the geographic levels. We perform an additive adjustment on the ZIP level series so that the weighted sum of the ZIP series aligns with the county level same store series. In doing this, we get the levels from the County no-entry panel, and the within-county variation from the ZIP level data.

Revisions on May 17th 2022

We are now releasing county-level and city-level data derived from the same panel of small businesses described in the March 4, 2022 data revision.

Revisions on June 26th 2023

We added a supplemental file:

For more details, please see the data documentation.

Online Math Participation and Student Progress in Math

Revisions on December 14th 2021

As schools have attritioned from the sample we’ve revised our methodology to impute missing values for an otherwise active school. Previously school retention in the sample was very high and we imputed across the sample observations missing in a given week for a given school as zeros as the likelihood the omission of data was a sign of no usage but continuity in the sample was quite high. Overtime, and particularly during the 2021 fall semester, a subset of schools naturally attritioned from the sample of schools using Zearn prior to the onset of the COVID-19 pandemic and we paused our imputation procedure for the newest sample. As such we’ve now revised our methodology to impute missing values within semester based on semester activity. For this subset of schools that are missing observations for a given week within a semester and are active Zearn users at any point within a semester, we impute these values as zeros within the given semester. As such we avoid imputation of schools observations where a school has dropped from the sample in a given semester and identify weeks missing for schools that remain within the sample for a given semester and impute them as zeros appropriately. This change has resulted in a small downward revision to the estimates post summer 2020.

In addition, previously in the case when correcting for transitory anomalous spikes, week to week changes in the underlying levels of greater than 50 percentage points that immediately revert by an equally sized change in the subsequent week, for a given week for a given school we have changed how both the procedure overall operates and how one sided spikes bounded by a missing value are handled. Overall previously the procedure for spike correction detected and applied the correction sequentially for positive and the negative value spikes. This has been revised to apply these changes simultaneously to a series. Given the size of anomalous change needed for a spike to be identified this has a small impact on the overall series. In the case where a one sided spike was bounded by a missing observation we previously in the 2021 fall semester imputed the transitory anomalous spike as a missing observations as well. As we now impute within semester active schools’ missing observations as zeros, we now no longer impute these one sided spikes as missing and instead impute them with the 3 week moving average identically to all other transitory spike corrections in the series. This applies to a small number of cases within certain states and has minimal impact.

COVID-19 Infections and Vaccinations

Revisions on March 17th 2021

Previously we pulled reported cases and deaths from the New York Times’ COVID-19 database and reported tests from the COVID Tracking Project. At the conclusion of the COVID Tracking Project’s efforts in order to collect testing data we instead began pulling reported cases, deaths, and tests at the county level from the Centers For Disease Control and Prevention’s COVID Data Tracker and aggregated to other geographies.

Revisions on August 4th 2021

Previously we pulled reported cases, deaths, and tests at the county level from the Centers For Disease Control and Prevention’s COVID Data Tracker and aggregated to other geographies. On July 17th the Centers For Disease Control and Prevention began suppressing reported cases and deaths making aggregations across counties no longer feasible and we began to instead pull reported cases and deaths from the New York Times’ COVID-19 database, state level reported tests from the Johns Hopkins Coronavirus Resource Center’s U.S. testing database, and county level reported tests from The Centers for Disease Control and Prevention.

Revisions on April 11th 2023

On March 23, 2023 the New York Times discontinued its COVID tracking efforts and published the last updates to its database tracking COVID cases and deaths in light of increased tracking and reporting by government agencies like The Centers for Disease Control and Prevention. For COVID-19 cases and deaths data published after March 23, 2023, we now make use of weekly data published by The Centers for Disease Control and Prevention. In order to integrate the new weekly sums published by The Centers for Disease Control and Prevention with the previous daily values published by New York Times we scale all cases and deaths values to a 7 day rolling sum rather than a 7 day rolling average as previously reported.

Revisions on June 23rd 2023

  1. On May 11, 2023, the Centers for Disease Control and Prevention (CDC) ceased to update their COVID-19 vaccination tracking data series and existing COVID-19 cases and deaths tracking data series. On June 1, 2023, the CDC published the final update to their weekly data series tracking COVID-19 cases and deaths.

    The Economic Tracker data on weekly COVID-19 cases, deaths and vaccinations up to May 10, 2023 reflects these final updates from the CDC, which will not receive further updates.

    We continue to pull and collate the state-level death counts from the data available on the updated COVID Data Tracker and state level counts of hospitalizations available from the Department of Health and Human Services.

  2. We no longer compute a rolling 7 day sum of the cumulative COVID-19 cases and deaths. Starting on April 11, 2023 we switched from a 7-day rolling average to a 7-day rolling sum in order to ensure the units remain consistent across historical daily and weekly data. But the 7-day rolling sum was erroneously applied to cumulative COVID-19 cases and deaths, which multiplies the cumulative counts by 7. We have corrected the error and restored a 7-day rolling average for cumulative cases and deaths.

Time Outside Home

Revisions on October 20th 2022

On October 15, 2022, Google discontinued its updates to the COVID-19 Community Mobility Reports, posting the last revision on October 17, 2022. The Economic Tracker data on Time Outside Home reflects this final update from Google, and will not receive further updates.