Detailed comparison TestNG 6 and JUnit 4 for Integration, System and Acceptance testing levels. Everything needed by QA automation/SDET team. IT Talk was in Wroclaw on 30/03/2017. https://crossweb.pl/wydarzenia/qa-talk-test-analyze-manage-marzec-2017 JUnit 4 code on github: https://github.com/a-oleynik/junit-workshop/tree/junit-4.13.2 TestNG code on github: https://github.com/a-oleynik/testng-workshop Webinar on youtube: https://www.youtube.com/watch?v=3C-Nu5mkyOQ&t=3189

1. Andrey Oleynik
Senior QA Automation Engineer
DataArt Wroclaw
TestNG vs. JUnit

2. About me
About 9 years of work in Quality Assurance area
Senior QA Automation Engineer
PhD, Theoretical physics
30 March 2017 2
ANDREY OLEYNIK

3. TestNG vs. JUnit, what do you think?
30 March 2017 3

4. Agenda
• JUnit
• TestNG
• Suites
• Fixtures
• Assertions
• Soft Assertions
• Hamcrest
• Ignore
• Timeout
• Exception
• Parameterization
• Grouping
• Dependencies
• Listeners
• Reporters
• Parallelization
30 March 2017 4

5. 30 March 2017
JUnit is a unit testing framework for the
Java programming language. JUnit has
been important in the development of test-
driven development, and is one of a family
of unit testing frameworks which is
collectively known as xUnit that originated
with SUnit.

6. 30 March 2017

7. 30 March 2017
TestNG is a testing framework for the Java
programming language created by Cédric
Beust and inspired by JUnit and NUnit. The
design goal of TestNG is to cover a wider
range of test categories: unit, functional,
end-to-end, integration, etc., with more
powerful and easy-to-use functionalities.

8. JUnit Suites
30 March 2017 8

9. TestNG Suites (testing.xml)
30 March 2017 F O O T E R H E R E 9

10. JUnit Fixtures
30 March 2017 10
• @BeforeClass setUpClass (static)
• @Before setUp
• @Test test1()
• @After tearDown
• @Before setUp
• @Test test2()
• @After tearDown
• @AfterClass tearDownClass (static)

11. TestNG Fixtures
30 March 2017 11
• @BeforeMethod
• @AfterMethod
• @BeforeClass
• @AfterClass
• @BeforeTest
• @AfterTest
• @BeforeGroups
• @AfterGroups
• @BeforeSuite
• @AfterSuite

12. JUnit Asserts
30 March 2017 12
• assertEquals
• assertTrue
• assertFalse
• assertNull
• assertNotNull
• assertThat
• assertArrayEquals
• assertSame
• fail

13. JUnit Asserts
30 March 2017 13
• assertEquals(java.lang.Object expected, java.lang.Object
actual)
• assertEquals(java.lang.String message, java.lang.Object
expected, java.lang.Object actual)
• fail()
• fail(java.lang.String message)
• …

14. TestNG Asserts
30 March 2017 14
• assertEquals
• assertEqualsNoOrder
• assertFalse
• assertNotEquals
• assertNotNull
• assertNotSame
• assertNull
• assertSame
• assertThrows
• assertTrue
• expectThrows
• fail

15. TestNG Asserts
30 March 2017 15
• assertEquals(java.lang.Object actual, java.lang.Object
expected)
• assertEquals(java.lang.Object actual, java.lang.Object
expected, java.lang.String message )
• fail()
• fail(java.lang.String message)
• fail(java.lang.String message, java.lang.Throwable
realCause)
• …

16. TestNG Soft Asserts
30 March 2017 16

17. JUnit Soft Asserts
30 March 2017 17

18. JUnit Hamcrest
30 March 2017 18

19. TestNG Hamcrest
30 March 2017 19

20. JUnit (Timeout, Ignoring)
• Timeout for tests
• Ignoring tests
30 March 2017 F O O T E R H E R E 20

21. TestNG timeOut
• Timeout for particular tests
• Timeout for suites
30 March 2017 F O O T E R H E R E 21

22. TestNG test Ignoring
• Ignore a test
• Throw SkipException
• Exclude test
30 March 2017 F O O T E R H E R E 22

23. JUnit exception testing
30 March 2017 23

24. JUnit exception testing (with @Rule)
30 March 2017 24

25. TestNG exception testing
30 March 2017 25

26. JUnit parameterization
30 March 2017 26

27. JUnit parameterization
30 March 2017 27

28. TestNG parameterization
30 March 2017 28

29. TestNG parameterization
30 March 2017 29
@Parameters
@DataProvider

30. TestNG parameterization
30 March 2017 30

31. TestNG parameterization
30 March 2017 31

32. JUnit parameterization (JUnitParams)
30 March 2017 32

33. JUnit parameterization (junit-dataprovider)
30 March 2017 33

34. JUnit parameterization (junit-dataprovider)
30 March 2017 34

35. JUnit categories
30 March 2017 35

36. TestNG groups
30 March 2017 36
Groups of Methods
Groups of Classes
Group of Groups

37. TestNG groups
30 March 2017 37

38. TestNG groups
30 March 2017 38

39. JUnit dependencies
30 March 2017 39

40. TestNG dependencies
30 March 2017 40
dependsOnMethods
dependsOnGroups

41. JUnit RunListener
30 March 2017 41

42. TestNG listeners
30 March 2017 42
ITestListener
• onStart
• onTestSuccess
• onTestFailure
• onTestSkipped
• onTestFailedButWithinSuccessPe
rcentage
IInvokedMethodListener
• beforeInvocation
• afterInvocation

43. TestNG listeners (how to include)
30 March 2017 43

44. TestNG listeners
30 March 2017 44
IExecutionListener
onExecutionStart()
onExecutionFinish()
ISuiteListener
onStart
onFinish
Ireporter
generateReport

45. JUnit parallelization
30 March 2017 45

46. TestNG parallelization
30 March 2017 46
Maven plugin
The suite tag has parallel and thread-count attributes
@Test has threadPoolSise attribute

47. More details about JUnit
30 March 2017 47
• Official Website: http://junit.org/junit4/
• Assert: http://junit.org/junit4/javadoc/latest/org/junit/Assert.html
• Junit Wiki on GitHub: https://github.com/junit-team/junit4/wiki
• JUnit Tutorial (Mkyong.com) http://www.mkyong.com/tutorials/junit-
tutorials/
• RunListener:
http://junit.sourceforge.net/javadoc/org/junit/runner/notification/RunListe
ner.html
• How to implement RunListener a JUnit Listener example:
http://memorynotfound.com/add-junit-listener-example/

48. More details about some additional libs
30 March 2017 48
• AssertJ http://joel-costigliola.github.io/assertj/index.html
• Hamcrest http://hamcrest.org/JavaHamcrest/
• The Benefits of Using assertThat over other Assert Methods in Unit
Tests https://objectpartners.com/2013/09/18/the-benefits-of-using-
assertthat-over-other-assert-methods-in-unit-tests/
• Hamcrest matchers tutorial
https://www.javacodegeeks.com/2015/11/hamcrest-matchers-
tutorial.html
• JUnitParams: https://github.com/Pragmatists/JUnitParams
• junit-dataprovider: https://github.com/TNG/junit-dataprovider

49. More details about TestNG
30 March 2017 49
• Official Website: http://testng.org/doc/documentation-main.html
• Assert: http://testng.org/javadocs/org/testng/Assert.html
• ITestListener: http://testng.org/javadocs/org/testng/ITestListener.html
• IInvokedMethodListener:
http://testng.org/javadocs/org/testng/IInvokedMethodListener.html
• TestNG Listeners Example:
https://examples.javacodegeeks.com/enterprise-java/testng/testng-
listeners-example/
• TestNG Tutorial (Mkyong.com) http://www.mkyong.com/tutorials/testng-
tutorials/

50. Questions?
30 March 2017 50

51. Thank you!
30 March 2017 51