• System Requirements
  Operating System	Windows, Mac OS, Ubuntu, or CentOs
  PHP	The opensslextension must be enabled for downloading files with HTTPS.
  Java, version 1.6 or later	To determine your current version of Java, enter the following at the command line: java -version If Java isn’t recognized, make sure the java and jar executables are in your system PATH. To learn more, see: Installing Java Using Java
  Magento	Magento URLs must not include a secret URL key. To verify the configuration, do the following: 1. Log in to the Magento Admin with administrator privileges. 2. On the Admin menu, select System > Configuration. 3. In the panel on the left under Advanced, select Admin. Then, click to expand the Security section. 4. Set Add Secret Key to URLs to “No.” 5. Click Save Config.
  Git	Git must be installed. (Windows Only) Add Git to your system PATH variable, or run Composer from the Git bash shell.
  Browser	If using a browser other than Firefox, download drivers that are compatible with Selenium.To learn more, see the Selenium Documentation. The browser must also be declared in the config.xmlfile. For an example, see: Non-Firefox Browsers.

1.

Download Composer for UNIX or Windows. Then, follow the instructions to install Composer.

2.

Run Composer from the [Magento install]/dev/tests/functional directory as follows:

• composer install

If you cannot run composer from the command line, do the following:

a.

Copy composer.phar to the same directory where composer.json is located. The typical location is:

[Magento install dir]/dev/tests/functional

The composer.json file contains dependency information and settings for PHPUnit, Selenium server, libraries, and so on, and is required to start MTF. It checks out MTF from a separate repository.

b.

Run Composer as follows:

• php composer.phar install

A new directory named vendor is created with the checked-out MTF. The vendor directory contains:

• An MTF framework directory ( magento/mtf )
• bin
• composer
• netwing
• phpunit
• symfony
• autoload.php (file)

3.

To run the generator, do one of the following:

• Use your browser to navigate to the following location:

[Magento install dir]/dev/tests/functional/utils/generate.php

• Execute the following from the command line:

• php utils/generate/factory.php

The generator tool creates generated directories with factories for pages, blocks, handlers, fixtures and repositories. After MTF is initialized, the factories are pre-generated to facilitate creating and running tests.

Q:

We want to run tests on a custom website. The tests assume that the main website is called “Main Website,” and do not work. Is there a way to provide a custom name without changing the tests?

A:

This is an error in the tests. Instead of “Main Website,” it should be set to main_website, which will select the default website. The website_selection_patch will be included in next MTF release.

 

Q:

I get errors in Mage\Adminhtml\Test\TestCase\CreateWebsiteEntityTest. How can I fix it?

A:

This is an misconfiguration in the test, which was designed for an internal workflow. The website patch addresses this issue.

You might also try this as an alternate solution. In the following file:

dev\tests\functional\tests\app\Mage\Adminhtml\Test\Constraint\
AssertProductIsPresentOnCustomWebsite.php

Change line 115 to:

• $this->magentoRoot = realpath(MTF_BP . '/../../../');

 

Q:

I get errors in Mage\Adminhtml\Test\TestCase\CreateStoreEntityTest. How can I fix it?

A:

This test fails due to lack of translations. Install translations into Magento.

 

Q:

I get errors while testing a custom website.

A:

One possible reason is that translations enabled. The tests expect to find English text on the page. Change the default language to English on the website that is being tested.

 

Q:

Why are some of tests so slow, especially when comparing the default address with the data sets?

A:

This is caused by the way the Selenium server processes the SELECT statement. The next version should address this issue.

 

Q:

Some of the tests are very slow, especially when choosing a category for a newly added product. This process slows down when there are a lot of categories.

A:

This is caused by the algorithm that prepares the tree:

\Magento\Mtf\Client\Element\TreeElement

The next version should address this issue.

 

Q:

How can I create tests that extend an existing module? For example, how do we add new attributes and assertions to customer tests?

A:

See this customer attribute example and instructions.

 

Q:

How can I create tests for a responsive theme or for any other custom theme?

A:

See this custom theme example and instructions.