Re: bitbake SRC_URI fetch Azure DevOps repository Azure DevOps Services Basic

[Richard Purdie <richard.purdie@linuxfoundation.org>]

On Mon, 2019-11-04 at 02:52 +0000, Samuel Jiang (江騏先) wrote:
> Dear yocto developer,
> The below disscussed about azure devops clone issue including test
> result with Microsoft support team member.
> We wonder know how Bitbake access repository through SSH. Does it
> different between git and Azue DevOps?


Try:

SRC_URI = "git://quanta01@vs-ssh.visualstudio.com/v3/quanta01/OpenBMC/crashdump;protocol=ssh;nobranch=1"

as I think you didn't convert the url to our syntax correctly.

Cheers,

Richard


> Thanks,
> 
> Samuel Jiang
> ---------- Forwarded message ----------
> From: Alex Chong (Shanghai Wicresoft Co,.Ltd.) <
> v-chucho@microsoft.com>
> Date: 2019年10月31日 PM5:39 [+0800]
> To: Samuel Jiang (江騏先) <Samuel.Jiang@quantatw.com>
> Cc: support <support@mail.support.microsoft.com>, Alex Chong
> (Shanghai Wicresoft Co,.Ltd.) <v-chucho@microsoft.com>
> Subject: RE: 119102923000220 use yocto bitbake SRC_URI fetch Azure
> DevOps repository Azure DevOps Services Basic
> 
> > Hi Samuel,
> > 
> >  
> > 
> > Thank you for reply.
> > 
> >  
> > 
> > I test and read the BitBake doc, let me share with you my finding
> > and analysis.
> > 
> > I have verified that our Azure DevOps Organization Repo could be
> > clone through SSH authentication successfully.
> > I create a new SSH key and add it to Azure DevOps SSH public keys.
> >  
> > 
> > Then I use git clone command and clone this repo successfully. The
> > url is “v-chucho-microsoft@vs-ssh.visualstudio.com:v3/v-chucho-
> > microsoft/testCodeCoverage/testCodeCoverage”
> > 
> > 
> > My testing verify that SSH Authentication is available, and the url
> > given by Azure DevOps is correct.
> > 
> >  
> > 
> > Then I also test it in GitHub, and succeed. The only difference is
> > the url of GitHub is “git@github.com:xxxxxxxxxxxxxxxxxx.git”
> >  
> > 
> > So let’s come back to BitBake. I read more of the BitBake doc.( 
> > https://www.yoctoproject.org/docs/1.8/bitbake-user-manual/bitbake-user-manual.html#bb-fetchers
> > ) . Your command SRC_URI = "git://quanta01@vs-
> > ssh.visualstudio.com:v3/quanta01/OpenBMC/crashdump;protocol=ssh;nob
> > ranch=1". The BitBake example is below.
> > 
> > 
> > We can see that the BitBake syntax is like git SSH but not Azure
> > DevOps SSH. Do you try to use this command clone a repo from
> > GitHub?
> > 
> >  
> > 
> > Then I read the doc you shared. The customer also met your issue
> > when trying to clone Azure DevOps repo with SSH url. In my
> > understanding, seems BitBake Git fetcher is good for Git SSH but
> > not ready to access the Azure DevOps SSH.
> > 
> > 
> >  
> > 
> > Action Plan
> > 
> > Could you involve BitBake support team? We can deliver this testing
> > result and consult them how BitBake access Azure DevOps through
> > SSH.
> > 
> >  
> > 
> > If you have any conern or query, please feel free to let me know.
> > 
> >  
> > 
> > Best Regards,
> > 
> >  
> > 
> > Alex Chong
> > 
> >  
> > 
> > 
> > 
> > Support Engineer
> > 
> > Microsoft APAC Developer Support Team
> > 
> > Customer Service & Support (CSS)
> > 
> > Email: v-chucho@microsoft.com
> > 
> > Office: +86 (21) 52638610
> > 
> > Time zone: (UTC+08:00) Beijing, Chongqing, Hong Kong, Urumqi
> > 
> > Working time: 9:00am-6:00pm, Mon-Tue-Wed-Thu-Fri
> > 
> >  
> > 
> > From: Samuel Jiang (江騏先) <Samuel.Jiang@quantatw.com>
> > Sent: Thursday, October 31, 2019 12:16 PM
> > To: Alex Chong (Shanghai Wicresoft Co,.Ltd.) <
> > v-chucho@microsoft.com>
> > Cc: support <support@mail.support.microsoft.com>
> > Subject: RE: 119102923000220 use yocto bitbake SRC_URI fetch Azure
> > DevOps repository Azure DevOps Services Basic
> > 
> >  
> > 
> > Hi Alex,
> > 
> > I catch same problem on the yocto mail list
> > link: 
> > https://lists.yoctoproject.org/pipermail/yocto/2018-October/042736.html
> > 
> > when I use SRC_URI = "git://quanta01@vs-
> > ssh.visualstudio.com:v3/quanta01/OpenBMC/crashdump;protocol=ssh;nob
> > ranch=1"
> > 
> > the bitbake response below error message:
> > git -c core.fsyncobjectfiles=0 ls-remote 
> > ssh://quanta01@vs-ssh.visualstudio.com:v3/quanta01/OpenBMC/crashdump
> >   failed with exit code 128, output:
> > 
> > ssh: Could not resolve hostname vs-ssh.visualstudio.com:v3: Name or
> > service not known
> > 
> > fatal: Could not read from remote repository.
> > 
> > I think the bitbake call “git ls-remote” command however it could
> > not parser below host vs-ssh.visualstudio.com:v3
> > 
> > Could you help confirm the  “git ls-remote”command could work on
> > ssh method clone with ssh:// prefix?
> > 
> > BTW, the protocol will define the uri prefix, I didn’t find any way
> > removing this prefix.
> > 
> > Thanks,
> > Samuel Jiang
> > 
> >  
> > 
> > From: Alex Chong (Shanghai Wicresoft Co,.Ltd.) <
> > v-chucho@microsoft.com>
> > Sent: Thursday, October 31, 2019 10:32 AM
> > To: Samuel Jiang (江騏先) <Samuel.Jiang@quantatw.com>
> > Cc: Alex Chong (Shanghai Wicresoft Co,.Ltd.) <
> > v-chucho@microsoft.com>; support <
> > support@mail.support.microsoft.com>
> > Subject: RE: 119102923000220 use yocto bitbake SRC_URI fetch Azure
> > DevOps repository Azure DevOps Services Basic
> > 
> >  
> > 
> > Hi Samuel,
> > 
> >  
> > 
> > How are you?
> > 
> >  
> > 
> > Do you try our Azure DevOps SSH authentication? Do you contact
> > BitBake support for help? Is there any suggestion or new issue?
> > Please feel free to contact me if there is something I can do for
> > you.
> > 
> >  
> > 
> > Best Regards,
> > 
> >  
> > 
> > Alex Chong
> > 
> >  
> > 
> > 
> > 
> > Support Engineer
> > 
> > Microsoft APAC Developer Support Team
> > 
> > Customer Service & Support (CSS)
> > 
> > Email: v-chucho@microsoft.com
> > 
> > Office: +86 (21) 52638610
> > 
> > Time zone: (UTC+08:00) Beijing, Chongqing, Hong Kong, Urumqi
> > 
> > Working time: 9:00am-6:00pm, Mon-Tue-Wed-Thu-Fri
> > 
> >  
> > 
> > From: Alex Chong (Shanghai Wicresoft Co,.Ltd.) <
> > v-chucho@microsoft.com>
> > Sent: Tuesday, October 29, 2019 3:50 PM
> > To: Samuel.Jiang@quantatw.com
> > Cc: Alex Chong (Shanghai Wicresoft Co,.Ltd.) <
> > v-chucho@microsoft.com>
> > Subject: 119102923000220 use yocto bitbake SRC_URI fetch Azure
> > DevOps repository Azure DevOps Services Basic
> > 
> >  
> > 
> >  
> > 
> >  
> > 
> > 
> > 
> >  
> > 
> > Hi Samuel,
> > 
> >  
> > 
> > Thank you for contacting Microsoft.
> > 
> >  
> > 
> > My name is Alex and I am the Microsoft Support Engineer from APGC
> > who will be working with you on this support request . You can
> > reach me using the contact information in my signature.
> > 
> >  
> > 
> > I just called you at +886 3 327 2345 and had a quick discussion.
> > 
> > Issue Description
> > 
> > 1.Customer is using a 3rd-party application BitBake to clone Azure
> > DevOps repo. 
> > 
> > 2.Customer could fetch file from https url successfully.
> > 
> > 3.Customer wants to know whether Azure DevOps support SSH
> > authentication method.
> > 
> >  
> > 
> > Analysis
> > 
> > 1.Yes, Azure DevOps has SSH authentication method. (Reference: 
> > https://docs.microsoft.com/en-us/azure/devops/repos/git/use-ssh-keys-to-authenticate?view=azure-devops
> > )
> > 
> >  Create your SSH keys
> >     Create your SSH keys with the ssh-keygen command from
> > the bash prompt.
> > 
> >  Add the public key to your Azure DevOps Organization
> > Open your security settings by browsing to the web portal and
> > selecting your avatar in the upper right of the user interface.
> > Select Security in the menu that appears.
> > 
> > 
> > 
> > Select SSH public keys , then select +New Key.
> > 
> > 
> > 
> > Copy the contents of the public key (for example, id_rsa.pub) that
> > you generated into the Public Key Data field.
> > 
> >  
> > 
> > 
> > 
> >  
> > 
> >  Clone the Git repository with SSH
> > Copy the SSH clone URL from the web portal. In this example the SSL
> > clone URL is for a repo in an organization named fabrikam-fiber, as
> > indicated by the first part of the URL after dev.azure.com.
> > 
> > 
> > 
> > Run git clone from the command prompt.
> > 
> > My example is git clone v-chucho-microsoft@vs-ssh.visualstudio.com:
> > v3/v-chucho-microsoft/testCodeCoverage/testCodeCoverage
> > 
> >  
> > 
> > 2.Regarding to BitBake. (Reference: 
> > https://www.yoctoproject.org/docs/1.8/bitbake-user-manual/bitbake-user-manual.html#bb-fetchers
> > )
> > 
> > This is a 3rd-party application which is out of our Microsoft
> > support. Our Azure DevOps has SSH authentication method. But I have
> > no experience whether there is such option in BitBake. 
> > 
> > I did some research on this application and find Git fetcher and
> > ssh:// fetcher functionalities. In my understanding, it should
> > support git with SSH or SSH fecher directly. It's suggested to
> > consult BitBake support for more details of these 2 fetchers. If
> > there is something our Microsoft could help, please feel free to
> > involve me directly.
> > 
> > 
> > 
> > 
> > 
> >  
> > 
> > If you have any concern or query, please feel free to contact me.
> > 
> >  
> > 
> > Best Regards,
> > 
> >  
> > 
> > Alex Chong
> > 
> >  
> > 
> > Support Engineer
> > 
> > Microsoft APAC Developer Support Team
> > 
> > Customer Service & Support (CSS)
> > 
> > Email: v-chucho@microsoft.com
> > 
> > Office: +86 (21) 52638610
> > 
> > Time zone: (UTC+08:00) Beijing, Chongqing, Hong Kong, Urumqi
> > 
> > Working time: 9:00am-6:00pm, Mon-Tue-Wed-Thu-Fri
> > 
> >  
> > 
> > 這則來自 Microsoft 的訊息是您或貴公司所購買或參與之計畫、服務或產品的重要部分。請檢閱我們的線上隱私權聲明
> > 
> > Microsoft Corporation
> > One Microsoft Way
> > Redmond, WA, USA 98052
> > 
> > 
> >