openembedded-core.git/scripts/oe-selftest, branch krogoth

oe-selftest: Correct the usage examples

2016-04-18T15:27:45+00:00

Signed-off-by: Ross Burton

scripts/oe-selftest: avoid the creation of coverage file when coverage not installed

2016-04-05T22:12:41+00:00

Coverage subprocessing file is being created even when coverage
is not installed, which causes errors of "module not found" to
be send to the oe-selftest output.

This patch adds indent to the block of code creating this coverage
file, so it can only be executed when coverage is actually
installed.

[Yocto #9334]

Signed-off-by: Humberto Ibarra 
Signed-off-by: Richard Purdie

scripts/oe-selftest: remove coverage file if any coverage option is given

2016-04-05T22:12:41+00:00

Coverage temporal file for sub-processing is being removed only
when the --coverage option was found. This is wrong since the
file is created when any coverage option (source, include or omit)
is given, even if --coverage is not one of them.

This patch makes sure to remove the file if any coverage option was
given.

Signed-off-by: Humberto Ibarra 
Signed-off-by: Richard Purdie

scripts/oe-selftest: remove unneeded coverage warning

2016-04-05T22:12:41+00:00

There is a message that warns the user about enabling subprocessing
for coverage to work. After the fix for Yocto #8930,
this task is done automatically, so the warning is not needed
anymore.

Signed-off-by: Humberto Ibarra 
Signed-off-by: Richard Purdie

scripts, lib: Don't limit traceback lengths to arbitrary values

2016-03-31T12:18:12+00:00

There appears to have been a lot of copy and pasting of the code
which prints tracebacks upon failure and limits the stack trace to
5 entries. This obscures the real error and is very confusing to the user
it look me an age to work out why some tracebacks weren't useful.

This patch removes the limit, making tracebacks much more useful for
debugging.

[YOCTO #9230]

Signed-off-by: Richard Purdie

scripts:/oe-selftest: Use timestamp instead of test names in coverage data file

2016-03-28T14:54:52+00:00

This fixes the problem by changing the name to the coverage data file,
using the timestamp as an identifier.

The name for the coverage data file is constructed based on the tests
ran; this has created a couple of issues so far, affecting coverage report.

If --run-tests-by option is given, the data file name won't have any
identifier, causing following runs to overwrite themselves. On the
other hand, if too many tests are given, the file name exceeds linux
limits and fails to store the coverage data all together.

[Yocto #9253]

Signed-off-by: Humberto Ibarra 
Signed-off-by: Ross Burton 
Signed-off-by: Richard Purdie

oe-selftest: Fixed --list-tests-by tag option

2016-03-20T22:57:58+00:00

Commit 35be67951305950ba797dc2efddbc7d88fc0556a broke the
--list-tests-by tag option.
This patch fixes that.

Having a module in lib/oeqa/selftest named testmodule:
class TestClass(oeSelfTest):
    @tag(feature='tag1')
    def test_func1(self):
        pass
    @tag(feature=('tag1', 'tag2'))
    def test_func2(self):
        pass
    @tag(feature=('tag2', 'tag3'))
    def test_func3(self):
        pass
    @tag(feature=('tag1', 'tag2', 'tag3'))
    def test_func4(self):
        pass

$ oe-selftest --list-tests-by tag tag1
 ID  TAG(s)            NAME        CLASS      MODULE
----  ----------------  ----------  ---------  --------
      tag1              test_func1  TestClass  testmodule
      tag1, tag2        test_func2  TestClass  testmodule
      tag1, tag2, tag3  test_func4  TestClass  testmodule
______________________________
Filtering by:	 tag
Looking for:	 tag1
Total found:	 3

$  oe-selftest --list-tests-by tag tag1 tag2
  ID  TAG(s)            NAME        CLASS      MODULE
----  ----------------  ----------  ---------  --------
      tag1              test_func1  TestClass  testmodule
      tag1, tag2        test_func2  TestClass  testmodule
      tag1, tag2, tag3  test_func4  TestClass  testmodule
      tag2, tag3        test_func3  TestClass  testmodule
______________________________
Filtering by:	 tag
Looking for:	 tag1, tag2
Total found:	 4

$ oe-selftest --list-tests-by tag tag*
  ID  TAG(s)            NAME        CLASS      MODULE
----  ----------------  ----------  ---------  --------
      tag1              test_func1  TestClass  testmodule
      tag1, tag2        test_func2  TestClass  testmodule
      tag1, tag2, tag3  test_func4  TestClass  testmodule
      tag2, tag3        test_func3  TestClass  testmodule
______________________________
Filtering by:	 tag
Looking for:	 tag*
Total found:	 4

Signed-off-by: Daniel Istrate 
Signed-off-by: Ross Burton

scripts/oe-selftest: Add short names to most common options

2016-03-12T22:11:21+00:00

Add short names to most common options in oe-selftest. The options
changed were --run-tests, --run-all-tests, --list-tests and
--list-modules.

[Yocto #9079]

Signed-off-by: Humberto Ibarra 
Signed-off-by: Ross Burton

scripts/oe-selftest: Add search expression matching to run/list options

2016-03-12T22:11:20+00:00

The oe-selftest script required an exact matching for the parameters
passed to its run-tests-by and list-tests-by options. Many tests
can be retrieved here and filtering is a must.

This patch add this filtering functionality by enabling the use
of wildcards such as "*".

[Yocto #8916]

Signed-off-by: Humberto Ibarra 
Signed-off-by: Richard Purdie

oe-selftest: Add support for lib/oeqa/selftest subdirectories

2016-02-28T11:32:34+00:00

This patch adds functionality to allow creating subdirectories inside
lib/oeqa/selftest for all layers present in BBLAYERS. Like this, test
cases can be grouped into organized directories.

Addresses [YOCTO #7865]

Signed-off-by: Costin Constantin 
Signed-off-by: Ross Burton