summaryrefslogtreecommitdiff
path: root/bitbake
AgeCommit message (Collapse)AuthorFiles
2010-12-17bitbake/runqueue: Clean up message log levelsRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-16siggen.py: make sure stamp directory existingKevin Tian1
or else "bitbake -S" from scratch may report "No such file or directory" error. Signed-off-by: Kevin Tian <kevin.tian@intel.com>
2010-12-16bitbake/runqueue.py: We should just failoutright in scenequeue for noexec ↵Richard Purdie1
tasks, not skip them so stamps are created Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-14runqueue.py: use correct task ID when checking validity of setscene tasksKevin Tian1
sstate hash validation is done at initialization of RunQueueExecuteScenequeue. However the index of 'valid' list returned from the validation doesn't correspond to setscene task ID. It's just an intermediate namespace between runqueue and sstate hash func. Use it as setscene task ID fully mess the flow. Previously this doesn't cause trouble because all setscene tasks are passed. Commit 58396a5d24c62710fd0a9f3780d84ac8a95d8e7c add 'noexec' concept to setscene tasks which grabs some tasks out of the list and thus trigger this problem Without this fix there're ~50 recipes (gzip-native, glib, ...) rebuilt weirdly with a minimal build, even though existing sstate packages could accelerate them. there's another typo using wrong task ID in a debug message which further hide this issue Signed-off-by: Kevin Tian <kevin.tian@intel.com>
2010-12-14bitbake: add optional expansion to getVarFlag()Paul Eggleton2
Add a parameter to getVarFlag() to auto-expand the value of the flag. This makes getVarFlag() more consistent with getVar(), and allows expansion of vardeps and vardepsexclude (which has been done in this commit). Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
2010-12-14bitbake: allow excluding dependencies of variablesPaul Eggleton1
Adds a vardepsexclude flag that can be used to exclude a dependency of a variable (the opposite of vardeps). This will allow the exclusion of variables from the hash generation much more selectively than blanket whitelisting using BB_HASHBASE_WHITELIST. Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com>
2010-12-10bitbake/bitbake-runtask: Since the parent has set the environment up cleanly ↵Richard Purdie1
we don't need to filter this ourselves anymore Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-09bitbake: Overhaul environment handlingRichard Purdie5
Currently, anything whitelisted in the environment makes it into the worker processes. This is undesireable and the worker environment should be as clean as possible. This patch adapts bitbake sosme variables are loaded into bitbake's datastore but not exported by default. Any variable can be exported by setting its export flag. Currently, this code only finalises the environment in he worker as doing so in the server means variables are unavailable in the worker. If we switch back to fork() calls instead of exec() this code will need revisting. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-09bitbake/cooker: fix idle command processing in serversJoshua Lock1
idle command processing in each of the servers does not handle an explicit None return value, which means the goggle UI ends up repeatedly adding "Tasks Summary:" rows to the list. This patch modifies BBCooker.buildTargets.buildTargetsIdle to return False when BuildCompleted is fired, as is done in BBCooker.buildFile.buildFileIdle. It may be that the correct way to fix this is to change the idle command processing in the servers. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-12-07bitbake/goggle: add a ProgressBar for parse progressJoshua Lock1
Construct a ProgressBar and pass it to the RunningBuild.handle_event() so that goggle users are notified of metadata parsing progress. UI's with status make users less nervous Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-12-07bitbake/goggle: automatically show most recently added messageJoshua Lock1
It seems likely that the user would want to view the most recently emitted messages so this patch sets the message dislay treeview to scroll to any newly added rows. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-12-07bitbake/xmlrpc: Modify xmlrpc server to work with Python 2.7Joshua Lock1
Python 2.7's library changes some of xmlrpclib's internal implementation such that interacting with a proxy to BitBakes SimpleXMLRPCServer would cause BitBake to crash. The issue was traced to changes in the xmlrpclib.Transport implementation and Python bug #8194 (http://bugs.python.org/issue8194). This patch introduces a workaround by create a subclass of xmlrpclib.Transport, which overrides the offending methods with the Python 2.6.6 implementation copy and pasted from the Python 2.6.6 xmlrpclib, and using this BBTransport implementation for both xmlrpclib.Server objects we create. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-12-07bitbake/crumbs: add optional pbar parameter to RunningBuild.handle_event()Joshua Lock1
Defaults to None, but if set will pass the ParseProgress sofar and total to pbar's update() method. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-12-07bitbake/depexp: Factor ProgressBar into a separate class in crumbs/Joshua Lock2
ProgressBar will be useful in other UI elements so make it it's own class. Make ProgressBar a subclass of gtk.Dialog, rather than gtk.Window, so that we can suggest the window manager parent the ProgressBar to the widget passed at as parent. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-12-07bitbake/goggle: interaction tweaksJoshua Lock1
Set the goggle window to a more sane default size (640x480) and hook up the close button. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-12-07bitbake/crumbs: fix the event name determinationJoshua Lock1
Due to some recent change *somewhere* we need to explicitly look at the name attribute on the instances class, rather than the name attribute of the instance. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-12-07bitbake/crumbs: do the test for ignored messages soonerJoshua Lock1
Move the test for ignored messages to the start of the message handling loop to avoid doing work for messages which are only going to be ignored. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-12-07bitbake/crumbs: Fix crumbs UI for bitbake event class name changesJoshua Lock1
Some of the events we where trying to look for have had their class names changed, fix these references. Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-12-07siggen.py: fix the wrong usage on BB_TASKHASH_WHITELISTKevin Tian1
BB_TASKHASH_WHITELIST is expected to filter out native tasks from the dependency list for target recipe's checksum. However current code actually implements the opposite. All native sstate packages end up to have empty task dependency while target sstate packages still have native tasks counted into the checksum. Signed-off-by: Kevin Tian <kevin.tian@intel.com>
2010-12-07bitbake/data_smart: Refactor _append/_prepend code to remove duplicationRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-07bitbake/data_smart: Fix append/prepend/override ordering issueRichard Purdie1
Where a variable name consisted of an append/prepend combined with an override and there was also an append/prepend to the variable, the override could be lost if the override was not in OVERRIDES. For example: FOO = "A" FOO_append = "B" FOO_append_virtclass-native = "C" could result in "AB" even though virtclass-native was in OVERRIDES. With this patch applied, the result is "ABC" as would be expected. The problem was the deletion of the _append/_prepend flag was happening if *any* append/prepend was procesed, the result should really be that it should contain any unprocessed append/prepend. Kevin Tian deserves credit for looking into this and working out the problem here. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-06siggen.py: set 'runtaskdeps' correctlyKevin Tian1
Now 'runtaskdeps' is assigned before taskhash whitelist is filtered out, and thus always contains original task dependencies. This causes problem to diagnose sstate related problem. So fix it by appending filtered dep to 'runtaskdeps' in the fly. Signed-off-by: Kevin Tian <kevin.tian@intel.com>
2010-12-05bitbake/utils.py: Improve traceback to be more helpful/clear to usersRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-12-05bitbake/utils.py: Ensure the last lines of functions are printed in tracebacksRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-28bitbake/runqueue: Teach scenequeue about noexec tasks (since they don't do ↵Richard Purdie1
anything we can assume they're always successful Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-28bitbake: Simplfy pre and post cooker hooksRichard Purdie3
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-28bitbake/runqueue.py: Fix stamp handling for noexec tasksRichard Purdie1
This means the noexec messages are only shown once as the stamp files are now correctly created. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-15siggen.py: fix comparison around runtaskdepsKevin Tian1
two dep lists should be sorted before the comparison, or else it just causes false-positive confusion. Also fix 'taskdeps' to 'runtaskdeps' when printing out the difference. Signed-off-by: Kevin Tian <kevin.tian@intel.com>
2010-11-14bitbake-runtask-strace: simple shell script to wrap tasks in a strace callJoshua Lock1
Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-11-13bitbake: Rewrite profiling code so its functional for both none and xmlrpc ↵Richard Purdie4
backends Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-13bitbake/fetch: Allow checking of a single url at a time (massive sstate ↵Richard Purdie1
speed improvement) Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-13bitbake/fetch: Fix handling of mirrors when checking for url validityRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-13Revert "bitbake/fetch/local: Also check DL_DIR for files since they could ↵Richard Purdie1
already exists there" These changes were incorrect. This reverts commit ae98f7eacb9e61fe086d88dc694b4c651af9fee3.
2010-11-13Revert "bitbake/fetch/local: Fix os.exists reference"Richard Purdie1
These changes were incorrect. This reverts commit f8e33979352528bb7c289e7c839605a5880e1e43.
2010-11-13bitbake/fetch/local: Fix os.exists referenceRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-13bitbake/fetch/local: Also check DL_DIR for files since they could already ↵Richard Purdie1
exists there [BUGID #533] Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-07bitbake.runqueue.py: Fix no exec task handling to correct counter housekeepingRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-06bitbake: Add support for 'noexec' tasksRichard Purdie2
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-06bitbake/siggen: Allow siggen code to control final stampfile formatRichard Purdie2
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-02bitbake/siggen: Provide better warnings about empty tasksRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-11-01bitbake/siggen: Fix finalise call argumentsRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-23bitbake/fetch: When fetchers return errors, ensure any partial download is ↵Richard Purdie1
cleared Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-22bitbake/fetch: Make URL checking slightly less verbose (distracting with the ↵Richard Purdie1
sstate code) Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-22pseudo/fakeroot: Move the pseudo directory creation into bitbakeRichard Purdie1
If sstate was used to accelerate a build, the pseudo directory might not have been created leading to subsequent task failures. Also, sstate packages were not being installed under pseudo context meaning file permissions could have been lost. Fix these problems by creating a FAKEROOTDIRS variable which bitbake ensures exists before running tasks and running the appropriate setscene tasks under fakeroot context. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-19bitbake/fetch/git: Ensure fullclone repositories are fully fetchedRichard Purdie1
The git fetcher was failing to pull in new branches into a git repository mirror tarball as the git fetch command being used didn't add new remote branches. This patch uses "git fetch --all" for fullclones to ensure any new remote branches are cloned correctly. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-19bitbake/fetcher: Deal with a ton of different bugsRichard Purdie2
The more we try and patch up the fetcher code, the more things break. The code blocks in question are practically unreadable and are full of corner cases where fetching could fail. In summary the issues noticed included: a) Always fetching strange broken urls from the premirror for "noclone" git repositories b) Not creating or rewriting .md5 stamp files inconsistently c) Always fetching git source mirror tarballs from the premirror even if they already exist but the checkout directory does now d) Passing "None" values to os.access() and os.path.extsts() checks under certain circumstances e) Not using fetched git mirror tarballs if the preexist and always try and fetch them. This patch rewrites the sections of code in question to be simpler and more readable, fixing the above problems and most likely other odd corner cases. Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-19bitbake/fetch/git.py: Fix git fetcher to correctly use mirror tarballsRichard Purdie1
Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-14bitbake-runtask: Ensure logging settings take effect in the worker process ↵Richard Purdie2
(and pass verbose setting) Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>
2010-10-12bitbake/runqueue: make the runtask program configurableJoshua Lock1
Signed-off-by: Joshua Lock <josh@linux.intel.com>
2010-10-11bitbake/build.py: Write logfiles on a per task basis, not per functionRichard Purdie1
Per function logging made it hard to track down what was happening so switch to logging on a per task basis. [BUGID #383] Signed-off-by: Richard Purdie <rpurdie@linux.intel.com>