openembedded-core.git/meta/lib/oeqa/oetest.py, branch 2015-4

oeqa: Added package installer to oetest to aid in future automatic install of packages

2014-09-10T14:19:58+00:00

Signed-off-by: Lucian Musat 
Signed-off-by: Ross Burton

oeqa/oetest.py: enable sdk tests to use hasFeature and hasPackage methods.

2014-08-27T11:12:06+00:00

In order to use the hasFeature and hasPackage methods, we need to make oeSDKTest extend oeTest and also set the test context (tc) attribute in the oeTest class when loading the tests.

Signed-off-by: Corneliu Stoicescu 
Signed-off-by: Richard Purdie

oeqa/oetest.py: enable sdk testing

2014-08-18T07:54:29+00:00

- add support for sdk tests in the loadTests and runTests methods
- add new oeSDKTest test object

NOTE: Original patch made by: Richard Purdie 

Signed-off-by: Corneliu Stoicescu 
Signed-off-by: Richard Purdie

oeqa/rutime: Added testcase decorators for automated runtime tests. Also added LogResults decorator for oeTest class in oetest.py

2014-07-25T15:54:27+00:00

Signed-off-by: Lucian Musat 
Signed-off-by: Richard Purdie

oeqa: Refactor test skipping decorators to use the unittest result object

2014-07-25T14:33:34+00:00

In order to make the test skipping decorators independent of the oeTest object we rely on the unittest result object to construct skip, fail and error lists used by these decorators.
Created a new object getResults that analyses upper frames and retrieves the unittest result object instance, then return a list of failed, skipped and error tests.
Also removed the oetest import from decorators.py because it was no longer required.

Signed-off-by: Lucian Musat 
Signed-off-by: Saul Wold 
Signed-off-by: Richard Purdie

testimage: add ability to export tests

2014-02-08T21:00:31+00:00

Add the ability to export the tests so that they can run independently of
the build system, as is required if you want to be able to hand the test
execution off to a scheduler.
Booting/deployment of the target is still handled by the build system,
as before, only the execution of the tests happens outside of the build system.
Tests exported are the ones defined in TEST_SUITES.

No tests have been changed as interesting parts of the data store have been
exported and tests can continue to query them as before. Small adjustments were made
for a couple of oeqa modules though.

[YOCTO #5613]

Signed-off-by: Stefan Stanacar 
Signed-off-by: Saul Wold

oeqa/runtime: drop restartTarget method

2014-01-29T17:36:30+00:00

Restart is a property of a specific target, not
of a test class, should a test really need to restart
the target the direct method should be called.
Also some tests used this to enforce more ram, which
makes sense only for qemu targets only (and the inital
reason this was needed isn't valid anymore, qemu machines had
the default ram size bumped a while ago).

Signed-off-by: Stefan Stanacar 
Signed-off-by: Richard Purdie

testimage: use the new targetcontrol.py module for running tests

2013-12-03T12:51:57+00:00

This patch makes the necessary changes for using the targetcontrol.py module
so that one can run the same tests on a qemu instance or a remote machine
based on the value of TEST_TARGET variable: "qemu" or "simpleremote".
The default value is "qemu" which starts a qemu instance and it's the
with what we currently have.

With "simpleremote", the remote machine must be up with network and ssh
and you need to set TEST_TARGET_IP with the IP address of the remote machine
(it can still be a qemu instance that was manually started).

Basically testimage.bbclass now does something along the lines of:
 - load tests -> deploy (prepare) / start target -> run tests.
There were a couple of changes necessary for tests and
also some cleanups/renames that were needed to adjust this change. (use
ip everywhere when refering to target and server_ip when refering to host/build machine)
Also two unnecessary and unsed methods were dropped from sshcontrol.

[ YOCTO #5554 ]

Signed-off-by: Stefan Stanacar 
Signed-off-by: Richard Purdie

lib/oeqa: use the new manifest file for determining if a package is installed

2013-12-03T12:50:49+00:00

Use the new manifest file instead of ${WORKDIR}/installed_pkgs.txt for determining
if an image has a certain package, because installed_pkgs.txt goes away with rm_work
enabled.
We can't use the IMAGE_MANIFEST var for the file path because that relies on IMAGE_NAME which
changes at every run (because of date), so we use the link which points to the last
one built.

[ YOCTO #5072 ]

Signed-off-by: Stefan Stanacar 
Signed-off-by: Richard Purdie

lib/oeqa: add oeTest superclass

2013-11-04T18:01:17+00:00

Add oeTest superclass, make oeRuntimeTest inherit that and
make the necesarry adjustments. Tests in lib/oeqa/runtime don't
change, they still inherit oeRuntimeTest.
We should do this because oetest.py in the future can be a base module
for more stuff than oeRuntimeTest.

Signed-off-by: Stefan Stanacar 
Signed-off-by: Saul Wold