openembedded-core.git/scripts/buildstats-diff, branch thud

scripts/buildstats-diff: move more code to lib/buildstats.py

2017-09-18T10:07:24+00:00

More refactoring of buildstats-diff script. Move recipe version
comparison functionality to scripts/lib/buildstats.py. This patch also
compasses some wording changes, i.e. changing 'package' to 'recipe'.

[YOCTO #11382]

Signed-off-by: Markus Lehtonen 
Signed-off-by: Ross Burton

scripts/buildstats-diff: move code to lib/buildstats.py

2017-09-18T10:07:23+00:00

Move over code from buildstats-diff to new scripts/lib/buildstats.py
module in order to share code related to buildstats processing.  Also,
refactor the code, introducing new classes to make the code readable,
maintainable and easier to debug.

[YOCTO #11381]

Signed-off-by: Markus Lehtonen 
Signed-off-by: Ross Burton

buildstats-diff: show more graceful error messages

2017-06-09T16:12:04+00:00

I got a following error when I run buildstats-diff against a invalid
buildstats file:
| Traceback (most recent call last):
|   File "/poky/scripts/buildstats-diff", line 548, in 
|     sys.exit(main())
|   File "/poky/scripts/buildstats-diff", line 534, in main
|     bs1 = read_buildstats(args.buildstats1, args.multi)
|   File "/poky/scripts/buildstats-diff", line 222, in read_buildstats
|     return read_buildstats_dir(path)
|   File "/poky/scripts/buildstats-diff", line 165, in read_buildstats_dir
|     os.path.join(recipe_dir, task))]
|   File "/poky/scripts/buildstats-diff", line 124, in read_buildstats_file
|     bs_task['elapsed_time'] = end_time - start_time
| UnboundLocalError: local variable 'end_time' referenced before assignment

the root cause is that a task was terminated by me on the terminal,
so the generated buildstats file was invalid, supposing that it would
make the buildstats.sh fail, but the script should give more graceful
error messages.

Signed-off-by: Ming Liu 
Signed-off-by: Ross Burton

scripts/buildstats-diff: support optimized rusage values

2017-05-23T16:44:00+00:00

Buildstats from oe-build-perf-test results have been optimized to not
have child rusage values at all. There, rusage is the sum of parent and
child rusage values. This patch makes buildstats-diff compatible with
this format.

[YOCTO #11355]

Signed-off-by: Markus Lehtonen 
Signed-off-by: Ross Burton

scripts/buildstats-diff: fix epoch numbers in --ver-diff

2017-02-23T20:29:10+00:00

Incorrect data was printed (recipe name instead of epoch number) when
displaying changes in epoch.

(From OE-Core rev: 5e2b1bfb684dc76963f692172f7457c2249c3266)

Signed-off-by: Markus Lehtonen 
Signed-off-by: Ross Burton 
Signed-off-by: Richard Purdie

scripts/buildstats-diff: simplify timestamp handling

2017-01-28T23:31:17+00:00

Simply use floats instead of datetime and timedelta objects for handling
timestamps.

Signed-off-by: Markus Lehtonen 
Signed-off-by: Richard Purdie

scripts/buildstats-diff: implement --multi option

2016-09-30T16:14:12+00:00

Makes it possible to average over multiple buildstats. If --multi is
specified (and the given path is a directory) the script will read all
buildstats from the given directory and use averaged values calculated
from them.

All of the buildstats must be from a "similar" build, meaning that no
differences in package versions or tasks are allowed. Otherwise, the
script will exit with an error.

Signed-off-by: Markus Lehtonen 
Signed-off-by: Ross Burton

scripts/buildstats-diff: make logger msg format a bit more readable

2016-09-30T16:14:12+00:00

Signed-off-by: Markus Lehtonen 
Signed-off-by: Ross Burton

scripts/buildstats-diff: use exception for internal error handling

2016-09-30T16:14:12+00:00

Signed-off-by: Markus Lehtonen 
Signed-off-by: Ross Burton

scripts/buildstats-diff: add walltime to --diff-attr

2016-09-30T16:14:11+00:00

For comparing the elapsed wall clock time of tests. Default values for
--min-val and --min-absdiff are 5 seconds and 2 seconds.

Signed-off-by: Markus Lehtonen 
Signed-off-by: Ross Burton