Auto-testing is the ability to automatically run all the tests for a project every time the project is built. Failing tests appear as text markers, similar to compile errors.
Open the properties for a Java project. You will see a page labelled "Auto-testing". Click on it, and click on the "Auto-test" check box.