Still learning OE-- i guess.

I thought I had this figured out, but I'm missing something here.

I did a git pull and git checkout today, to get updates, and compile
everything again.

I'm using linux-omap in machine/beagleboard.conf instead of linux-omap2.
(PREFERRED_PROVIDER_virtual/kernel = "linux-omap")

This had solved some issues with Bluetooth and ---something else I don't
remember.

After the update, I'm having trouble getting the kernel source... The
messages are at the end of this email.

Ok it shows failing to download the specific rev (5019ed....).. ok It also
shows it gets a tarball with rev successfully.

However even more to the point, it is using www.angstrom-distribution.org as
a mirror, when the recipe clearly says
git://git.kernel.org/pub/scm/linux/kernel/git/tmlind/linux-omap-2.6.git;prot
ocol=git

Further examination of
http://www.angstrom-distribution.org/unstable/sources/ shows that rev
3b7de... is there, as well as a few others. But of course not the 5019ed...
version. Further examination of the gitweb interface of git.kernel.org
shows that the 3a7de... version is 4 days old, and 5019ed... is about 8 days
old. That's all fine and dandy, and proves the rev numbers are valid, but
-- and here is my question finally:

How do I stop oe or bitbake from going to the mirror, and then failing
because that particular rev isn't mirrored?

Or should I just change rev inside linux-omap_git.bb

I'm thinking I simply don't know the methodology that being followed in
downloading the items.

Thanks,
Kevin

Error mentioned above follows:

NOTE: package
linux-omap-2.6.27+2.6.28-rc6+r2+gitr5019ed843f3208482c64043e4052e89b3d5462a0
-r2: task do_fetch: started
NOTE: fetch
http://www.angstrom-distribution.org/unstable/sources/git_git.kernel.org.pub
.scm.linux.kernel.git.tmlind.linux-omap-2.6.git_5019ed843f3208482c64043e4052
e89b3d5462a0.tar.gz
--17:45:36--
http://www.angstrom-distribution.org/unstable/sources/git_git.kernel.org.pub
.scm.linux.kernel.git.tmlind.linux-omap-2.6.git_5019ed843f3208482c64043e4052
e89b3d5462a0.tar.gz
Resolving www.angstrom-distribution.org... 85.214.40.226
Connecting to www.angstrom-distribution.org|85.214.40.226|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
17:45:37 ERROR 404: Not Found.
NOTE: fetch
http://www.angstrom-distribution.org/unstable/sources/git_git.kernel.org.pub
.scm.linux.kernel.git.tmlind.linux-omap-2.6.git.tar.gz
--17:45:37--
http://www.angstrom-distribution.org/unstable/sources/git_git.kernel.org.pub
.scm.linux.kernel.git.tmlind.linux-omap-2.6.git.tar.gz
Resolving www.angstrom-distribution.org... 85.214.40.226
Connecting to www.angstrom-distribution.org|85.214.40.226|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 278298152 (265M) [application/x-gzip]
Saving to:
`/home/ole/oe/downloads/git_git.kernel.org.pub.scm.linux.kernel.git.tmlind.l
inux-omap-2.6.git.tar.gz'

100%[=======================================================================
====>] 278,298,152 591K/s in 7m 44s

17:53:21 (586 KB/s) -
`/home/ole/oe/downloads/git_git.kernel.org.pub.scm.linux.kernel.git.tmlind.l
inux-omap-2.6.git.tar.gz' saved [278298152/278298152]

NOTE: Fetched
git_git.kernel.org.pub.scm.linux.kernel.git.tmlind.linux-omap-2.6.git.tar.gz
from tarball stash, skipping checkout
Fetching tags only, you probably meant:
  git fetch --tags
NOTE: Task failed: Fetch failed: Fetch command export
PATH=/home/ole/oe/tmp/staging/i686-linux/usr/bin/beagleboard-angstrom-linux-
gnueabi:/home/ole/oe/tmp/staging/i686-linux/usr/bin/armv7a-angstrom-linux-gn
ueabi:/home/ole/oe/tmp/staging/i686-linux/usr/sbin:/home/ole/oe/tmp/staging/
i686-linux/usr/bin:/home/ole/oe/tmp/cross/armv7a/bin:/home/ole/oe/tmp/stagin
g/i686-linux/sbin:/home/ole/oe/tmp/staging/i686-linux/bin:/usr/kerberos/bin:
/usr/local/bin:/bin:/usr/bin:/home/ole/bin; git pull --tags
git://git.kernel.org/pub/scm/linux/kernel/git/tmlind/linux-omap-2.6.git
failed with signal 1, output:

NOTE: package
linux-omap-2.6.27+2.6.28-rc6+r2+gitr5019ed843f3208482c64043e4052e89b3d5462a0
-r2: task do_fetch: failed
ERROR: TaskFailed event exception, aborting

Hi,

I am not sure if this would help but I think I solved a similar problem by
downloading the file manually and copying it to the downloads folder.

DL_DIR = "$OE_HOME/downloads" in the conf file
(added this line to $OE_HOME/beagleboard/beagleboard/conf/local.conf in
http://elinux.org/BeagleBoardAndOpenEmbeddedGit
Based on step 3 in
http://www.angstrom-distribution.org/building-ångström
  )

bitbake then skipped the fetch for that file.
Another time a file was downloaded from the mirror and fetch failed because
the mirror wasn't listed in the checksum file. I added a manual entry but
now the update
cd $OE_HOME/openembedded
git pull
git checkout
complains about the checksum file.

Surely this is not the best way but was quick.
Will someone please send the best conf file as opposed to the ones in the
links above? Thanks

Best regards,
Tamer

u may also need to add a file in stamps directory
touch OE/tmp/stamps/arm7*****/application_dofetch
for bitbake to skip downloading

How do I stop oe or bitbake from going to the mirror, and then failing
because that particular rev isn't mirrored?

Some background on the bitbake fetchers:

If it encounter a git url it tries to do these things:

* look at the source mirror for the tarball of a checkout
if that's present, it will wget get it unpack and be happy

if not:
* look at the source mirror for a tarball of the repository
if that's present: unpack, git pull (*), make tarball of checkout

if not:
* git pull
* make tarball of repository
* make tarball of snapshot
* unpack tarball of snapshot and be happy

It does all this to save CPU and bandwidth of the servers (e.g. Måns' and Sakomans git servers are behind DSL, the source mirror has 100Mb/s).

Your problem is that it fails at (*), so I guess you are behind some firewall that's blocking git. So without the sourcemirror you'd get the same error message:

/usr/local/bin:/bin:/usr/bin:/home/ole/bin; git pull --tags
git://git.kernel.org/pub/scm/linux/kernel/git/tmlind/linux-omap-2.6.git
failed with signal 1, output:

But without people wrongly blaming the sourcemirror.

Thanks for the description of the bitbake fetch process, it helps quite a
bit.

I verified that git does work on the command line, nothing is blocking it.
But I noticed this in the error message below:
Fetching tags only, you probably meant:
  git fetch --tags

the command bitbake used was: git pull --tags

Does this mean anything? Or just a side effect of something else failing?.

After examining your description of bitbake's fetch steps,

I did a little more testing.

I took the tarball that it successfully downloaded uncompressed it in a new
directory.
[ole@localhost aaa]$ tar xzf
/home/ole/oe/downloads/git_git.kernel.org.pub.scm.linux.kernel.git.tmlind.li
nux-omap-2.6.git.tar.gz

Then I did the command:
[ole@localhost aaa]$ git pull --tags
git://git.kernel.org/pub/scm/linux/kernel/git/tmlind/linux-omap-2.6.git
Fetching tags only, you probably meant:
  git fetch --tags
[ole@localhost aaa]$

Which is the same as the log says.

Maybe its my version(s)?
[ole@localhost aaa]$ git --version
git version 1.6.0
[ole@localhost aaa]$ bitbake --version
BitBake Build Tool Core version 1.8.10, bitbake version 1.8.10
[ole@localhost aaa]$

If I use git fetch --tags, nothing is shown.

I did a tcpdump trace to be sure that the connection to git.kernel.org was
working, and indeed it did connect and it did connect and it received some
data.

Kevin

Thanks for the description of the bitbake fetch process, it helps quite a
bit.

I verified that git does work on the command line, nothing is blocking it.
But I noticed this in the error message below:
Fetching tags only, you probably meant:
git fetch --tags

the command bitbake used was: git pull --tags

Does this mean anything? Or just a side effect of something else failing?.

Aha! That makes the problem a bit clearer, it's a bug in bitbake:

http://svn.berlios.de/viewvc/bitbake/branches/bitbake-1.8/lib/bb/fetch/git.py?r1=1004&r2=1009

could you try the bitbake-1.8 branch from bitbake svn? That has more fixes for the git fetcher.

regards,

Koen

Thanks for the info.
I pulled a new version of bitbake from the bitbake-1.8 branch as you
suggested.
I had a little trouble, it seems the most current version breaks on my
config.
So I pulled a little older rev, but newer than the one you called out in
your link below.

But it seems, since yesterday, the 5019ed...rev showed up on
angstrom-distribution.org, so I can't tell if the new version of bitbake
fixed it or not. When I see similar behavior that tests the issue I'll
report back.

Kevin