summaryrefslogtreecommitdiff
path: root/bitbake/lib/bb/runqueue.py
AgeCommit message (Collapse)AuthorFiles
2010-12-21runqueue.py: set BB_TASKHASH approriately after moving to fork()Kevin Tian1
In previous exec() model, cooker is re-initialized from scratch with environmental variable exported accordingly. Now in fork() model, environmental variables are not exported again, and thus original method to export BB_TASKHASH doesn't apply now which breaks all sstate packages. Now we can set data variable directly instead. Signed-off-by: Kevin Tian <kevin.tian@intel.com>
2010-12-21bitbake/runqueue.py: Somehow the python environment mapping is failing so do ↵Richard Purdie1
it manually Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-17bitbake Revert bitbake exec() and go back to fork() for performace wins ↵Richard Purdie1
(first draft) Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-17bitbake/runqueue: Revert previous setscene noexec changes and ensure ↵Richard Purdie1
setscene stamp exists for setscene noexec tasks Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-17bitbake/runqueue: Clean up message log levelsRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-16bitbake/runqueue.py: We should just failoutright in scenequeue for noexec ↵Richard Purdie1
tasks, not skip them so stamps are created Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-14runqueue.py: use correct task ID when checking validity of setscene tasksKevin Tian1
sstate hash validation is done at initialization of RunQueueExecuteScenequeue. However the index of 'valid' list returned from the validation doesn't correspond to setscene task ID. It's just an intermediate namespace between runqueue and sstate hash func. Use it as setscene task ID fully mess the flow. Previously this doesn't cause trouble because all setscene tasks are passed. Commit 58396a5d24c62710fd0a9f3780d84ac8a95d8e7c add 'noexec' concept to setscene tasks which grabs some tasks out of the list and thus trigger this problem Without this fix there're ~50 recipes (gzip-native, glib, ...) rebuilt weirdly with a minimal build, even though existing sstate packages could accelerate them. there's another typo using wrong task ID in a debug message which further hide this issue Signed-off-by: Kevin Tian <kevin.tian@intel.com>
2010-12-09bitbake: Overhaul environment handlingRichard Purdie1
Currently, anything whitelisted in the environment makes it into the worker processes. This is undesireable and the worker environment should be as clean as possible. This patch adapts bitbake sosme variables are loaded into bitbake's datastore but not exported by default. Any variable can be exported by setting its export flag. Currently, this code only finalises the environment in he worker as doing so in the server means variables are unavailable in the worker. If we switch back to fork() calls instead of exec() this code will need revisting. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-28bitbake/runqueue: Teach scenequeue about noexec tasks (since they don't do ↵Richard Purdie1
anything we can assume they're always successful Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-28bitbake/runqueue.py: Fix stamp handling for noexec tasksRichard Purdie1
This means the noexec messages are only shown once as the stamp files are now correctly created. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-07bitbake.runqueue.py: Fix no exec task handling to correct counter housekeepingRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-06bitbake: Add support for 'noexec' tasksRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-06bitbake/siggen: Allow siggen code to control final stampfile formatRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-22pseudo/fakeroot: Move the pseudo directory creation into bitbakeRichard Purdie1
If sstate was used to accelerate a build, the pseudo directory might not have been created leading to subsequent task failures. Also, sstate packages were not being installed under pseudo context meaning file permissions could have been lost. Fix these problems by creating a FAKEROOTDIRS variable which bitbake ensures exists before running tasks and running the appropriate setscene tasks under fakeroot context. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-14bitbake-runtask: Ensure logging settings take effect in the worker process ↵Richard Purdie1
(and pass verbose setting) Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-12bitbake/runqueue: make the runtask program configurableJoshua Lock1
Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-10-11bitbake-runtask: Ensure logging options are inherited from the parentRichard Purdie1
[BUGID #291] Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-07bitbake/runqueue.py: Fix invalid variable reference fixing the -f option ↵Richard Purdie1
with setscene tasks Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-05bitbake/sstate: Implement a lookup function to speed up setscene processingRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-28bitbake: Pass task hash information to subprocessesRichard Purdie1
Pass task has informaiton to work processes, allowing full manipulation of the hash data in the task context allowing checksums to be usable. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-13bitbake/runqueue: Remove now unneeded indentationRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-13bitbake/runqueue.py: Optimise delay values to avoid unneeded delaysRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-09-08bitbake: save the initial PATH for use when starting a subprocessJoshua Lock1
It was possible for bitbake-runtime to be run against a semi-installed python-native resulting in tracebacks with ImportError's. To prevent this we stash the initial PATH in the BBConfiguration when bitbake is started and then set this in the env when launching bitbake-runtask through subprocesses Popen() call. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-09-03bitbake: Implement signaturesRichard Purdie1
Includes functionality to find out what changes between two different singature data dumps. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-25bitbake/runqueue.py: Ensure rqexe always exists and that empty task lists ↵Richard Purdie1
cause a graceful exit Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-20bitbake: Correctly route events from the worker to the serverRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-19bitbake/runqueue.py: Ensure the flush happens as late as possible to avoid ↵Richard Purdie1
data mixups Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-19bitbake/runqueue.py: Fix runqueue UI issuesRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-19bitbake: Switch to use subprocess for forking tasks and FAKEROOTENV to run ↵Richard Purdie1
shell and python under a fakeroot environment Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-19bitbake: Initial scenequeue implementation (needs major fixes)Richard Purdie1
bitbake: scenequeue: Skip setscene if the underlying task already ran bitbake/setscene: Make sure uneeded dependencies are removed recursively Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-19bitbake/runqueue.py: Factor task skipping code into a functionRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-19bitbake/runqueue.py: Create RunQueueExecute and RunQueueExecuteTasks ↵Richard Purdie1
classes, further splitting up runqueue Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-19bitbake/cooker.py: Allow idle handlers to pass through a true valueRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-19bitbake/runqueue.py: Drop duplicated classRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-18bitbake: Split Runqueue into two classes, a data processor and the execution ↵Richard Purdie1
part Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-03*: cosmetic whitespace removalBernhard Reutner-Fischer1
(Bitbake rev: 2ed36a3d57de25e1af31d657a7b0b14857e5056a) Signed-off-by: Bernhard Reutner-Fischer <rep.dot.nop@gmail.com> Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-08-03Let the runqueue find the user selected scheduler dynamicallyChris Larson1
Searches the module (bb.runqueue) for any new style classes which are instances of RunQueueScheduler, and uses the one whose 'name' attribute matches the value of BB_SCHEDULER. (Bitbake rev: 6497cedf9cfc03201250af816995dd2bd85c36ef) Signed-off-by: Chris Larson <chris_larson@mentor.com> Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-16bitbake: Add support for .bbappend files (see mailing lists for detais)Richard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-16bitbake: runqueue: Allow passing of success/failure handlers to ↵Richard Purdie1
runqueue_process_waitpid() Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-16bitbake: runqueue: Allow taskname to be passed to check_stamp_task()Richard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-16bitbake: runqueue: Make child process error scary so user is less likely to ↵Richard Purdie1
ignore Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-16bitbake: runqueue: Fix number of running tasks accounting (include failed tasks)Richard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-16bitbake: runqueue: Remove unneeded exception catching from fork_off_task()Richard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-16bitbake: runqueue: Separate out task forking code into a new functionRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-16bitbake: runqueue: Combine the waitpid result handling code into a functionRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-16bitbake: Remove two layers of unnecessary functions from task executionRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-02Apply some 2to3 refactoringsChris Larson1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-02Show a traceback when a task fails due to an exceptionChris Larson1
(Bitbake rev: 5bb24832761bd518cb0249125f67939e0cbd0998) Signed-off-by: Chris Larson <chris_larson@mentor.com> Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-02Don't tell the user we're sending SIGINT to the remaining 0 tasksChris Larson1
(Bitbake rev: 0b963e52eca0447d5bbfc87d826ad662fe940381) Signed-off-by: Chris Larson <chris_larson@mentor.com> Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-07-02Apply some 2to3 transforms that don't cause issues in 2.6Chris Larson1
(Bitbake rev: d39ab776e7ceaefc8361150151cf0892dcb70d9c) Signed-off-by: Chris Larson <chris_larson@mentor.com> Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
generated by cgit v1.2.3 (git 2.25.1) at 2025-05-30 11:48:05 +0000