openembedded-core.git/meta/classes/buildstats.bbclass, branch thud

buildstats.bbclass: Avoid index exception in /proc/PID/io parsing

2017-03-01T12:54:23+00:00

There is some probability (depends on system load) to get empty
or line containing "0" as the last line while reading /proc/PID/io.
Avoid build failure by checking if line contains separator
":" before split.

Signed-off-by: Pavel Modilaynen 
Signed-off-by: Daniel Lublin 
Signed-off-by: Ross Burton

classes/buildstats: don't expand variable pointing to SystemStats

2017-01-09T13:27:00+00:00

We're placing an object into the datastore - it's very definitely not
something we want to be expanding.

Signed-off-by: Paul Eggleton 
Signed-off-by: Ross Burton

meta: remove True option to getVar calls

2016-12-16T08:30:03+00:00

getVar() now defaults to expanding by default, thus remove the True
option from getVar() calls with a regex search and replace.

Search made with the following regex: getVar ?\(( ?[^,()]*), True\)

Signed-off-by: Joshua Lock 
Signed-off-by: Ross Burton

buildstats: record disk space usage

2016-12-07T10:36:10+00:00

Hooks into the new monitordisk.py event and records the used space for
each volume. That is probably the only relevant value when it comes to
visualizing the build and recording more would only increase disk
usage.

Signed-off-by: Patrick Ohly 
Signed-off-by: Ross Burton

buildstats: add system state sampling

2016-12-07T10:36:10+00:00

/proc/[diskstats|meminfo|stat] get sampled and written to the same
proc_.log files as during normal bootchat logging. This will
allow rendering the CPU, disk and memory usage charts.

Right now sampling happens once a second, triggered by the heartbeat
event.That produces quite a bit of data for long builds, which will be
addressed in a separate commit by storing the data in a more compact
form.

Signed-off-by: Patrick Ohly 
Signed-off-by: Ross Burton

buildstats: Place 'Elapsed Time' stat into a single line

2016-11-23T11:02:30+00:00

All lines except one (the one containing the 'Elapsed Time') follows the format
'stat: value'. Fix that so post parsing the stats is simpler.

Signed-off-by: Leonardo Sandoval 
Signed-off-by: Ross Burton

buildstats: check IMAGE_ROOTFS exists before checking its size

2016-10-25T16:47:15+00:00

After 0d6b7276003f1afabc6de683f663540327d52bdc, the exceptions are
correctly checked if the rootfs size check fails. In case of a
failure a build error is triggered.

However, there are cases where this is known to fail (e.g.,
with meta-swupd the rootfs for swupd images is other than IMAGE_ROOTFS).

Because of that, check IMAGE_ROOTFS exists before trying to get the
size of it. Also, in case of any error catched as err, simply print
out a warning.

Signed-off-by: Mikko Ylinen 
Signed-off-by: Richard Purdie

subprocess: remove Popen in favor of check_output

2016-09-30T16:48:33+00:00

This begins moving away from the deprecated subprocess calls in an
effort to eventually move to some more global abstraction using the run
convenience method provided in python 3.5.

[ YOCTO #9342 ]

Signed-off-by: Stephano Cetola 
Signed-off-by: Richard Purdie

buildstats: Fix tracebacks for early task failures

2016-04-15T05:57:48+00:00

If a failure occurs early in the task, its possible we can have a
TaskFailed before the TaskStarted event can be triggered. This in
turn causes another traceback as the directory buildstats writes
files into doesn't exist.

Ensure the directory exists so we can see the original error.

Signed-off-by: Richard Purdie

buildstats.bbclass: Don't assume /proc//io present

2016-02-28T11:32:34+00:00

It is not guaranteed Linux kernel was configured with process I/O
statistics enabled. If process I/O statistcs are not present, issue
a one time warning and do not attempt to read the non-existing stats
counters.

[YOCTO#9025]

Signed-off-by: Juro Bystricky 
Signed-off-by: Ross Burton