openembedded-core.git/meta/lib/oe/distro_check.py, branch 2016-10

oe/distro_check.py: Fixes for python3

2016-06-12T22:46:54+00:00

create_socket: Use urllib because urllib2 is now urllib in python3
and proxies as argument are deprecated so export them in the environ
instead.

get_links_from_url: Change usage of sgmllib for parsing HTML because
is deprecated in python 3, use instead bs4 that is already imported
in the bitbake tree.

[YOCTO #9744]

Signed-off-by: Aníbal Limón 
Signed-off-by: Ross Burton

distro_check.py: Don't mix tabs and spaces

2016-06-02T07:36:15+00:00

Signed-off-by: Jussi Kukkonen 
Signed-off-by: Richard Purdie

classes/lib: Complete transition to python3

2016-06-02T07:10:04+00:00

This patch contains all the other misc pieces of the transition to
python3 which didn't make sense to be broken into individual patches.

Signed-off-by: Richard Purdie

classes/lib: Update to explictly create lists where needed

2016-06-02T07:10:02+00:00

Iterators now return views, not lists in python3. Where we need
lists, handle this explicitly.

Signed-off-by: Richard Purdie

lib/oe/distro_check: don't set empty proxy keys

2015-11-24T15:55:27+00:00

If the proxies dictionary has a proxy set to None urllib will throw an exception
instead of not using a proxy (abridged stack):

File: '/home/ross/Yocto/poky/meta/lib/oe/distro_check.py', lineno: 43, function: get_links_from_url
 *** 0043:    with create_socket(url,d) as sock:
     0044:        webpage = sock.read()
File: '/home/ross/Yocto/poky/meta/lib/oe/distro_check.py', lineno: 5, function: create_socket
     0003:def create_socket(url, d):
     0004:    import urllib
 *** 0005:    socket = urllib.urlopen(url, proxies=get_proxies(d))
File: '/usr/lib/python2.7/urllib.py', lineno: 87, function: urlopen
     0086:    if data is None:
 *** 0087:        return opener.open(url)
File: '/usr/lib/python2.7/urllib.py', lineno: 203, function: open
     0201:        else:
     0202:            proxy = None
 *** 0203:        name = 'open_' + urltype
     0204:        self.type = urltype
     0205:        name = name.replace('-', '_')
Exception: TypeError: cannot concatenate 'str' and 'NoneType' objects

Filter out unset values so that the dictionary only has valid assignments in.

Signed-off-by: Ross Burton

lib/oe/distro_check: Remove '_proxy' on dict values used by urllib.open

2015-10-12T13:33:49+00:00

There are two ways to pass the proxies values into urllib.open: exporting
the environment variables *_proxy and passing as dictionary into the
urllib.open call. The latter is currenty used and values should not have
the '_proxy' string, so removing it. Also, ignore uppercase proxies, these
are not taken into account by the library.

Tested on a network with proxy, adding 'inherit +="distrodata"' on local.conf
with the following commands

    for distrotask in distrodataall distro_checkall checklicenseall; do
        bitbake universe -c $distrotask
    done

[YOCTO #7567]

Signed-off-by: Leonardo Sandoval 
Signed-off-by: Ross Burton

distrodata: Take account proxies on distrodata tasks

2015-10-01T13:13:47+00:00

Proxies defined in the enviroment where not taken into account
on the distrodata tasks. This commit implied passing the datastore
into the distro_check library and context manager for the
urllib.urlopen function.

One way to run distrodata tasks is using 'universe' as target and the
'all' distrodata task:

      $ bitbake universe -c distrodataall
      $ bitbake universe -c distro_checkall
      $ bitbake universe -c checklicenseall

Logs are located under TMPDIR/log

[YOCTO #7567]

Signed-off-by: Leonardo Sandoval 
Signed-off-by: Richard Purdie

distro_check: Remove creation of empty Meego filelist.

2013-02-12T13:22:14+00:00

This fixes permissions errors when running distrodata.

Signed-off-by: Anders Roxell 
Signed-off-by: Saul Wold

distrodata: Update distrocheck functions

2012-10-03T16:37:24+00:00

Fix the distro check functions for the change of nativesdk
being a suffix to a prefix. Also added crosssdk as another
case for converting to PN for matching in the distro_tracking

Signed-off-by: Saul Wold 
Signed-off-by: Richard Purdie

meta: replace os.system with subprocess.call

2012-05-30T09:56:15+00:00

Replace os.system with subprocess.call since the older function would
fail (more or less) silently if the executed program cannot be found

More info:
http://docs.python.org/library/subprocess.html#subprocess-replacements

[YOCTO #2454]

Signed-off-by: Robert Yang 
Signed-off-by: Richard Purdie