Re: bitbake SRC_URI fetch Azure DevOps repository Azure DevOps Services Basic

["Samuel Jiang (江騏先)" <Samuel.Jiang@quantatw.com>]

Hi Richard,

I try use 
SRC_URI = "git://quanta01@vs-ssh.visualstudio.com/v3/quanta01/OpenBMC/crashdump;protocol=ssh;nobranch=1"

the bitbake response below error message:
 git -c core.fsyncobjectfiles=0 ls-remote 
ssh://quanta01@vs-ssh.visualstudio.com:v3/quanta01/OpenBMC/crashdump
  failed with exit code 128, output:

ssh: Could not resolve hostname vs-ssh.visualstudio.com:v3: Name or 
 service not known
fatal: Could not read from remote repository.

I discussed with Microsoft support team,
the Azure DevOps support SSH url clone without [ ssh:// ] prefix, like below:
git -c core.fsyncobjectfiles=0 ls-remote 
quanta01@vs-ssh.visualstudio.com:v3/quanta01/OpenBMC/crashdump

Does bitbake support git SRC_URI without any prefix or need extra with Azure SSH protocol support it?

Thanks,
Samuel Jiang


-----Original Message-----
From: Richard Purdie <richard.purdie@linuxfoundation.org> 
Sent: Tuesday, November 5, 2019 11:30 PM
To: Samuel Jiang (江騏先) <Samuel.Jiang@quantatw.com>; yocto@yoctoproject.org
Cc: Alex Chong <v-chucho@microsoft.com>
Subject: Re: [yocto] bitbake SRC_URI fetch Azure DevOps repository Azure DevOps Services Basic

On Mon, 2019-11-04 at 02:52 +0000, Samuel Jiang (江騏先) wrote:
> Dear yocto developer,
> The below disscussed about azure devops clone issue including test 
> result with Microsoft support team member.
> We wonder know how Bitbake access repository through SSH. Does it 
> different between git and Azue DevOps?


Try:

SRC_URI = "git://quanta01@vs-ssh.visualstudio.com/v3/quanta01/OpenBMC/crashdump;protocol=ssh;nobranch=1"

as I think you didn't convert the url to our syntax correctly.

Cheers,

Richard


> Thanks,
> 
> Samuel Jiang
> ---------- Forwarded message ----------
> From: Alex Chong (Shanghai Wicresoft Co,.Ltd.) < 
> v-chucho@microsoft.com>
> Date: 2019年10月31日 PM5:39 [+0800]
> To: Samuel Jiang (江騏先) <Samuel.Jiang@quantatw.com>
> Cc: support <support@mail.support.microsoft.com>, Alex Chong (Shanghai 
> Wicresoft Co,.Ltd.) <v-chucho@microsoft.com>
> Subject: RE: 119102923000220 use yocto bitbake SRC_URI fetch Azure 
> DevOps repository Azure DevOps Services Basic
> 
> > Hi Samuel,
> > 
> >  
> > 
> > Thank you for reply.
> > 
> >  
> > 
> > I test and read the BitBake doc, let me share with you my finding 
> > and analysis.
> > 
> > I have verified that our Azure DevOps Organization Repo could be 
> > clone through SSH authentication successfully.
> > I create a new SSH key and add it to Azure DevOps SSH public keys.
> >  
> > 
> > Then I use git clone command and clone this repo successfully. The 
> > url is “v-chucho-microsoft@vs-ssh.visualstudio.com:v3/v-chucho-
> > microsoft/testCodeCoverage/testCodeCoverage”
> > 
> > 
> > My testing verify that SSH Authentication is available, and the url 
> > given by Azure DevOps is correct.
> > 
> >  
> > 
> > Then I also test it in GitHub, and succeed. The only difference is 
> > the url of GitHub is “git@github.com:xxxxxxxxxxxxxxxxxx.git”
> >  
> > 
> > So let’s come back to BitBake. I read more of the BitBake doc.( 
> > https://www.yoctoproject.org/docs/1.8/bitbake-user-manual/bitbake-us
> > er-manual.html#bb-fetchers
> > ) . Your command SRC_URI = "git://quanta01@vs- 
> > ssh.visualstudio.com:v3/quanta01/OpenBMC/crashdump;protocol=ssh;nob
> > ranch=1". The BitBake example is below.
> > 
> > 
> > We can see that the BitBake syntax is like git SSH but not Azure 
> > DevOps SSH. Do you try to use this command clone a repo from GitHub?
> > 
> >  
> > 
> > Then I read the doc you shared. The customer also met your issue 
> > when trying to clone Azure DevOps repo with SSH url. In my 
> > understanding, seems BitBake Git fetcher is good for Git SSH but not 
> > ready to access the Azure DevOps SSH.
> > 
> > 
> >  
> > 
> > Action Plan
> > 
> > Could you involve BitBake support team? We can deliver this testing 
> > result and consult them how BitBake access Azure DevOps through SSH.
> > 
> >  
> > 
> > If you have any conern or query, please feel free to let me know.
> > 
> >  
> > 
> > Best Regards,
> > 
> >  
> > 
> > Alex Chong
> > 
> >  
> > 
> > 
> > 
> > Support Engineer
> > 
> > Microsoft APAC Developer Support Team
> > 
> > Customer Service & Support (CSS)
> > 
> > Email: v-chucho@microsoft.com
> > 
> > Office: +86 (21) 52638610
> > 
> > Time zone: (UTC+08:00) Beijing, Chongqing, Hong Kong, Urumqi
> > 
> > Working time: 9:00am-6:00pm, Mon-Tue-Wed-Thu-Fri
> > 
> >  
> > 
> > From: Samuel Jiang (江騏先) <Samuel.Jiang@quantatw.com>
> > Sent: Thursday, October 31, 2019 12:16 PM
> > To: Alex Chong (Shanghai Wicresoft Co,.Ltd.) < 
> > v-chucho@microsoft.com>
> > Cc: support <support@mail.support.microsoft.com>
> > Subject: RE: 119102923000220 use yocto bitbake SRC_URI fetch Azure 
> > DevOps repository Azure DevOps Services Basic
> > 
> >  
> > 
> > Hi Alex,
> > 
> > I catch same problem on the yocto mail list
> > link: 
> > https://lists.yoctoproject.org/pipermail/yocto/2018-October/042736.h
> > tml
> > 
> > when I use SRC_URI = "git://quanta01@vs- 
> > ssh.visualstudio.com:v3/quanta01/OpenBMC/crashdump;protocol=ssh;nob
> > ranch=1"
> > 
> > the bitbake response below error message:
> > git -c core.fsyncobjectfiles=0 ls-remote 
> > ssh://quanta01@vs-ssh.visualstudio.com:v3/quanta01/OpenBMC/crashdump
> >   failed with exit code 128, output:
> > 
> > ssh: Could not resolve hostname vs-ssh.visualstudio.com:v3: Name or 
> > service not known
> > 
> > fatal: Could not read from remote repository.
> > 
> > I think the bitbake call “git ls-remote” command however it could 
> > not parser below host vs-ssh.visualstudio.com:v3
> > 
> > Could you help confirm the  “git ls-remote”command could work on ssh 
> > method clone with ssh:// prefix?
> > 
> > BTW, the protocol will define the uri prefix, I didn’t find any way 
> > removing this prefix.
> > 
> > Thanks,
> > Samuel Jiang
> > 
> >  
> > 
> > From: Alex Chong (Shanghai Wicresoft Co,.Ltd.) < 
> > v-chucho@microsoft.com>
> > Sent: Thursday, October 31, 2019 10:32 AM
> > To: Samuel Jiang (江騏先) <Samuel.Jiang@quantatw.com>
> > Cc: Alex Chong (Shanghai Wicresoft Co,.Ltd.) < 
> > v-chucho@microsoft.com>; support < 
> > support@mail.support.microsoft.com>
> > Subject: RE: 119102923000220 use yocto bitbake SRC_URI fetch Azure 
> > DevOps repository Azure DevOps Services Basic
> > 
> >  
> > 
> > Hi Samuel,
> > 
> >  
> > 
> > How are you?
> > 
> >  
> > 
> > Do you try our Azure DevOps SSH authentication? Do you contact 
> > BitBake support for help? Is there any suggestion or new issue?
> > Please feel free to contact me if there is something I can do for 
> > you.
> > 
> >  
> > 
> > Best Regards,
> > 
> >  
> > 
> > Alex Chong
> > 
> >  
> > 
> > 
> > 
> > Support Engineer
> > 
> > Microsoft APAC Developer Support Team
> > 
> > Customer Service & Support (CSS)
> > 
> > Email: v-chucho@microsoft.com
> > 
> > Office: +86 (21) 52638610
> > 
> > Time zone: (UTC+08:00) Beijing, Chongqing, Hong Kong, Urumqi
> > 
> > Working time: 9:00am-6:00pm, Mon-Tue-Wed-Thu-Fri
> > 
> >  
> > 
> > From: Alex Chong (Shanghai Wicresoft Co,.Ltd.) < 
> > v-chucho@microsoft.com>
> > Sent: Tuesday, October 29, 2019 3:50 PM
> > To: Samuel.Jiang@quantatw.com
> > Cc: Alex Chong (Shanghai Wicresoft Co,.Ltd.) < 
> > v-chucho@microsoft.com>
> > Subject: 119102923000220 use yocto bitbake SRC_URI fetch Azure 
> > DevOps repository Azure DevOps Services Basic
> > 
> >  
> > 
> >  
> > 
> >  
> > 
> > 
> > 
> >  
> > 
> > Hi Samuel,
> > 
> >  
> > 
> > Thank you for contacting Microsoft.
> > 
> >  
> > 
> > My name is Alex and I am the Microsoft Support Engineer from APGC 
> > who will be working with you on this support request . You can reach 
> > me using the contact information in my signature.
> > 
> >  
> > 
> > I just called you at +886 3 327 2345 and had a quick discussion.
> > 
> > Issue Description
> > 
> > 1.Customer is using a 3rd-party application BitBake to clone Azure 
> > DevOps repo.
> > 
> > 2.Customer could fetch file from https url successfully.
> > 
> > 3.Customer wants to know whether Azure DevOps support SSH 
> > authentication method.
> > 
> >  
> > 
> > Analysis
> > 
> > 1.Yes, Azure DevOps has SSH authentication method. (Reference: 
> > https://docs.microsoft.com/en-us/azure/devops/repos/git/use-ssh-keys
> > -to-authenticate?view=azure-devops
> > )
> > 
> >  Create your SSH keys
> >     Create your SSH keys with the ssh-keygen command from the bash 
> > prompt.
> > 
> >  Add the public key to your Azure DevOps Organization Open your 
> > security settings by browsing to the web portal and selecting your 
> > avatar in the upper right of the user interface.
> > Select Security in the menu that appears.
> > 
> > 
> > 
> > Select SSH public keys , then select +New Key.
> > 
> > 
> > 
> > Copy the contents of the public key (for example, id_rsa.pub) that 
> > you generated into the Public Key Data field.
> > 
> >  
> > 
> > 
> > 
> >  
> > 
> >  Clone the Git repository with SSH
> > Copy the SSH clone URL from the web portal. In this example the SSL 
> > clone URL is for a repo in an organization named fabrikam-fiber, as 
> > indicated by the first part of the URL after dev.azure.com.
> > 
> > 
> > 
> > Run git clone from the command prompt.
> > 
> > My example is git clone v-chucho-microsoft@vs-ssh.visualstudio.com:
> > v3/v-chucho-microsoft/testCodeCoverage/testCodeCoverage
> > 
> >  
> > 
> > 2.Regarding to BitBake. (Reference: 
> > https://www.yoctoproject.org/docs/1.8/bitbake-user-manual/bitbake-us
> > er-manual.html#bb-fetchers
> > )
> > 
> > This is a 3rd-party application which is out of our Microsoft 
> > support. Our Azure DevOps has SSH authentication method. But I have 
> > no experience whether there is such option in BitBake.
> > 
> > I did some research on this application and find Git fetcher and 
> > ssh:// fetcher functionalities. In my understanding, it should 
> > support git with SSH or SSH fecher directly. It's suggested to 
> > consult BitBake support for more details of these 2 fetchers. If 
> > there is something our Microsoft could help, please feel free to 
> > involve me directly.
> > 
> > 
> > 
> > 
> > 
> >  
> > 
> > If you have any concern or query, please feel free to contact me.
> > 
> >  
> > 
> > Best Regards,
> > 
> >  
> > 
> > Alex Chong
> > 
> >  
> > 
> > Support Engineer
> > 
> > Microsoft APAC Developer Support Team
> > 
> > Customer Service & Support (CSS)
> > 
> > Email: v-chucho@microsoft.com
> > 
> > Office: +86 (21) 52638610
> > 
> > Time zone: (UTC+08:00) Beijing, Chongqing, Hong Kong, Urumqi
> > 
> > Working time: 9:00am-6:00pm, Mon-Tue-Wed-Thu-Fri
> > 
> >  
> > 
> > 這則來自 Microsoft 的訊息是您或貴公司所購買或參與之計畫、服務或產品的重要部分。請檢閱我們的線上隱私權聲明
> > 
> > Microsoft Corporation
> > One Microsoft Way
> > Redmond, WA, USA 98052
> > 
> > 
> >