### React-native CLI testing The react-native CLI tests come in three parts: - CLI tests, that don't require any remote connections or special setup - Testing an app build, which requires your local machine to be set up for building iOS and Android applications - Testing the built app, which requires the built application from the previous test set to run #### CLI tests The CLI tests target the command line interface by providing a set of responses to expected queries, verifying that the CLI tool responds correctly and makes appropriate changes to the workspace. ##### Setting up 1. Run through the initial setup in [TESTING.md](../../TESTING.md) 1. Run `npm pack packages/react-native-cli/` to pack the react-native-cli package 1. Copy the resulting package, `bugsnag-react-native-cli-{VERSION}.tgz` into the target fixture, e.g.: ```shell script cp bugsnag-react-native-cli-*.tgz test/react-native-cli/features/fixtures/rn0_64 ``` ##### Running 1. Change directory into `test/react-native-cli` 1. Check the contents of `Gemfile` to select the version of `maze-runner` to use 1. Install maze-runner with `bundle install` 1. Run the full set of cli tests targeting a specific react-native version (`rn0_61` for example): ```shell script REACT_NATIVE_VERSION=rn0_64 bundle exec maze-runner features/cli-tests ``` #### Build tests The build tests come in two flavours, Android and iOS, and are required to run the subsequent tests using the resulting `.apk` and `.ipa` artefacts. These tests ensure that the app can be built after Bugsnag is installed, and subsequent build messages are sent and contain the appropriate information. ##### Setup 1. Change directory into `test/react-native-cli` 1. Check the contents of `Gemfile` to select the version of `maze-runner` to use 1. Install maze-runner with `bundle install` ##### Running the Android variant - Run maze-runner targeting the specific Android build feature for a specific react-native version (`rn0_61` for example): ```shell script REACT_NATIVE_VERSION=rn0_61 bundle exec maze-runner features/build-app-tests/build-android-app.feature ``` ##### Running the iOS variant (MacOS only) - Run the script to trigger the build for the specific react-native version (`rn0_62` for example): ```shell script ./scripts/init-and-build-test.sh rn0_62 ``` #### App tests These tests ensure that Bugsnag has successfully been installed by the CLI, and errors and sessions are correctly reported. ##### Setup Before running these tests the previous tests, `Build Tests` must be run for the test fixtures to be present. 1. Change directory into `test/react-native-cli` 1. Check the contents of `Gemfile` to select the version of `maze-runner` to use 1. Install maze-runner with `bundle install` ##### Running Ensure that the following environment variables are set: - `BROWSER_STACK_USERNAME` - Your BrowserStack App Automate Username - `BROWSER_STACK_ACCESS_KEY` - Your BrowserStack App Automate Access Key - `MAZE_BS_LOCAL` - Location of the BrowserStack local testing binary See https://www.browserstack.com/local-testing/app-automate for details of the required local testing binary. In particular, these commands need the `BrowserStackLocal` binary (available [here](https://www.browserstack.com/local-testing/releases) to reside in your home directory. 1. To run on an Android device (`rn0_63` for example): ```shell script bundle exec maze-runner --app=./build/rn0_63.apk \ --farm=bs \ --device=ANDROID_16 \ --bs-local=~/BrowserStackLocal \ features/run-app-tests ``` 1. Or on iOS: ```shell script bundle exec maze-runner --app=../../build/rn0_63.ipa \ --farm=bs \ --device=IOS_13 \ --bs-local=~/BrowserStackLocal \ features/run-app-tests ``` #### Creating a new test fixture When each new version of React Native is released, a new test fixture project "shell" should be created. The inner workings of the app (that exercise the test scenarios) are then copied in dynamically by the build process. There are several steps to follow to create the project shell: 1. Add a new service to docker-compose.yml for the new fixture 1. Create a new React Native project of the desired version. E.g: ``` npx react-native init rn0_64 --version 0.64 ``` 1. Remove the following files/folders, if they exist: - \_\_tests\_\_ - .eslintrc.js 1. Create a `.dockerignore` file: ``` # Ignore lockfiles as they can influence test runs package-lock.json yarn.lock ``` 1. Add the following to `.gitignore`: ``` # Ignore lockfiles as they can influence test runs package-lock.json yarn.lock ``` 1. Copy `App.js` from an existing fixture (overwriting that created by React Native) 1. For Android: 1. In the `application` tag in app/src/main/AndroidManifest.xml, add: ``` android:usesCleartextTraffic="true" ``` 1. Add CrashyModule.java and CrashyPackage.java from an existing test fixture, updating the package name 1. In MainApplication.java, add: ``` packages.add(new CrashyPackage()); ``` 1. For iOS: 1. Disable Flipper by removing the following from the `Podfile` and run `pod install` to regenerate `Podfile.lock`. Flipper doesn't benefit the test fixture and removing it significantly speeds up the build. ``` use_flipper!() ``` 1. Copy the following files from an existing fixture: - `ios/rn0_xx/CrashyCrashy.h` - `ios/rn0_xx/CrashyCrashy.m` 1. Add to `rn_0_xx/Info.plist` (to the same `` as `NSExceptionDomains`): ``` NSAllowsArbitraryLoads ``` 1. Open the workspace and add `CrashyCrashy.h` and `CrashyCrashy.m` to the project. 1. Set the Bugsnag development team on the project.