git-svn-import or CVS import from local HD rather than remote.

git-svn-import or CVS import from local HD rather than remote.

[Boyd Lynn Gerber]

Hello,

I have a local svn of about 100 svn projects.  I have sripts that update 
via svn all these repo's daily.  What I want to do is to import these 
local svn tree's into git.  I can not seem to get it to work.

This is the latest attempt.

git-svnimport -C /working/git/project /master/svn/pub-svn/category/project

The above seems to work with the remote url's, but I really need to be 
able to update my working copies of svn and cvs into git.

I have as follows...

/master/cvs/category/project/
/master/svn/category/project/
/master/git/categroy/project/

/working/cvs/category/project/
/working/svn/category/project/
/working/git/category/project/

All my master stuff is being updated automatically.  My working is being 
updated as well via the various management systems.  What I am having 
problems doing is the automation of cvs and svn into my working git.

Git pulls from master git to the working git project without a problem.  
I want all the projects under git.  What I have now or want is in

/working/git/category/project

Examples of categories are

X11
audio
db
devtools
ebus
emulators
fileutils
gnome
interp
java
libraries
mail
net
qt
shells
shellutils
sysadmin
textproc

so for example

I want to have

/working/git/interp/perl
/working/git/interp/php
/working/git/interp/python

And have it updated via cron from my master repo's.  Could anyone shed 
some light on the best way to do this?

Thanks,

--
Boyd Gerber <gerberb@zenez.com>
ZENEZ	1042 East Fort Union #135, Midvale Utah  84047

Re: git-svn-import or CVS import from local HD rather than remote.

[Miklos Vajna]

[-- Attachment #1: Type: text/plain, Size: 350 bytes --]

On Thu, Jun 12, 2008 at 12:36:43PM -0600, Boyd Lynn Gerber <gerberb@zenez.com> wrote:
> git-svnimport -C /working/git/project /master/svn/pub-svn/category/project

From RelNotes-1.5.4.txt:

 * "git svnimport" was removed in favor of "git svn".  It is still there
   in the source tree (contrib/examples) but unsupported.

Try using git-svn.

[-- Attachment #2: Type: application/pgp-signature, Size: 197 bytes --]

Re: git-svn-import or CVS import from local HD rather than remote.

[Boyd Lynn Gerber]

On Thu, 12 Jun 2008, Miklos Vajna wrote:
> On Thu, Jun 12, 2008 at 12:36:43PM -0600, Boyd Lynn Gerber 
> <gerberb@zenez.com> wrote:
> > git-svnimport -C /working/git/project /master/svn/pub-svn/category/project
> 
> From RelNotes-1.5.4.txt:
> 
>  * "git svnimport" was removed in favor of "git svn".  It is still there
>    in the source tree (contrib/examples) but unsupported.
> 
> Try using git-svn.

Thanks, I was not sure which I should use,  I had tried both with similar 
results.  Here is what I used with git-svn

> git-svn clone /working/svn/networking/wireshark .
Initialized empty Git repository in .git/
Bad URL passed to RA layer: Unrecognized URL scheme for 
'/working/svn/networking/wireshark' at /usr/bin/git-svn line 934

It appears I am unable to use local repo's unless I have the setup to use 
via http.  I really would rather just take from my local working svn to 
git.

Thanks,

--
Boyd Gerber <gerberb@zenez.com>
ZENEZ	1042 East Fort Union #135, Midvale Utah  84047

Re: git-svn-import or CVS import from local HD rather than remote.

[Miklos Vajna]

[-- Attachment #1: Type: text/plain, Size: 595 bytes --]

On Thu, Jun 12, 2008 at 01:20:40PM -0600, Boyd Lynn Gerber <gerberb@zenez.com> wrote:
> Thanks, I was not sure which I should use,  I had tried both with similar 
> results.  Here is what I used with git-svn
> 
> > git-svn clone /working/svn/networking/wireshark .
> Initialized empty Git repository in .git/
> Bad URL passed to RA layer: Unrecognized URL scheme for 
> '/working/svn/networking/wireshark' at /usr/bin/git-svn line 934

I would try "git-svn clone file:///working/svn/networking/wireshark".

See also the svn-remote.<name>.rewriteRoot setting in the git-svn
manpage.

[-- Attachment #2: Type: application/pgp-signature, Size: 197 bytes --]

Re: git-svn-import or CVS import from local HD rather than remote.

[Daniel Barkalow]

On Thu, 12 Jun 2008, Boyd Lynn Gerber wrote:

> On Thu, 12 Jun 2008, Miklos Vajna wrote:
> > On Thu, Jun 12, 2008 at 12:36:43PM -0600, Boyd Lynn Gerber 
> > <gerberb@zenez.com> wrote:
> > > git-svnimport -C /working/git/project /master/svn/pub-svn/category/project
> > 
> > From RelNotes-1.5.4.txt:
> > 
> >  * "git svnimport" was removed in favor of "git svn".  It is still there
> >    in the source tree (contrib/examples) but unsupported.
> > 
> > Try using git-svn.
> 
> Thanks, I was not sure which I should use,  I had tried both with similar 
> results.  Here is what I used with git-svn
> 
> > git-svn clone /working/svn/networking/wireshark .
> Initialized empty Git repository in .git/
> Bad URL passed to RA layer: Unrecognized URL scheme for 
> '/working/svn/networking/wireshark' at /usr/bin/git-svn line 934

Maybe file:///working/svn/networking/wireshark?

	-Daniel
*This .sig left intentionally blank*

Re: git-svn-import or CVS import from local HD rather than remote.

[Boyd Lynn Gerber]

On Thu, 12 Jun 2008, Daniel Barkalow wrote:
> On Thu, 12 Jun 2008, Boyd Lynn Gerber wrote:
> > On Thu, 12 Jun 2008, Miklos Vajna wrote:
> > > On Thu, Jun 12, 2008 at 12:36:43PM -0600, Boyd Lynn Gerber 
> > > <gerberb@zenez.com> wrote:
> > > > git-svnimport -C /working/git/project /master/svn/pub-svn/category/project
> > > 
> > > From RelNotes-1.5.4.txt:
> > > 
> > >  * "git svnimport" was removed in favor of "git svn".  It is still there
> > >    in the source tree (contrib/examples) but unsupported.
> > > 
> > > Try using git-svn.
> > 
> > Thanks, I was not sure which I should use,  I had tried both with similar 
> > results.  Here is what I used with git-svn
> > 
> > > git-svn clone /working/svn/networking/wireshark .
> > Initialized empty Git repository in .git/
> > Bad URL passed to RA layer: Unrecognized URL scheme for 
> > '/working/svn/networking/wireshark' at /usr/bin/git-svn line 934
> 
> Maybe file:///working/svn/networking/wireshark?

This is really frustrating.

I have tried every combination of file://localhost/ file:///

This is what I get

git-svn clone file:///working/svn/network/wireshark/ -T trunk -b branches 
-t tags wireshark
Initialized empty Git repository in .git/
Couldn't open a repository: Unable to open an ra_local session to URL: 
Unable to open repository 'file:///working/svn/network/wireshark' at 
/usr/bin/git-svn line 1048

> ls -la /working/svn/network/wireshark/
total 16
drwxr-xr-x  8 gerberb zenez  208 2008-06-10 12:44 .
drwxr-xr-x  9 gerberb zenez  240 2008-06-12 13:00 ..
drwxr-xr-x  6 gerberb zenez  240 2008-06-12 12:14 .svn
drwxr-xr-x  6 gerberb zenez  152 2008-06-10 12:43 historic
drwxr-xr-x  5 gerberb zenez  152 2008-06-10 12:46 prereleases
drwxr-xr-x 86 gerberb zenez 2728 2008-06-10 12:37 releases
drwxr-xr-x 26 gerberb zenez 7016 2008-06-10 12:39 trunk
drwxr-xr-x 25 gerberb zenez 7136 2008-06-10 11:45 trunk-1.0

It is the exact same message wheter I use...

> cd /working/git/network/wireshark/
> git-svn clone file:///working/svn/network/wireshark .
> git-svn clone file:///working/svn/network/wireshark? .
> git-svn clone file:///working/svn/network/wireshark/ .
> cd /working/git/network/
> git-svn clone file:///working/svn/network/wireshark wireshark
> git-svn clone file:///working/svn/network/wireshark? wireshark
> git-svn clone file:///working/svn/network/wireshark/ wireshark

Add the options -T trunk -b branches -t tags above same results.

git-svn really does not like to import from a local svn file...

Any other ideas,

Thanks, I really apperciate the assistance.

--
Boyd Gerber <gerberb@zenez.com>
ZENEZ	1042 East Fort Union #135, Midvale Utah  84047

Re: git-svn-import or CVS import from local HD rather than remote.

[Miklos Vajna]

[-- Attachment #1: Type: text/plain, Size: 710 bytes --]

On Thu, Jun 12, 2008 at 01:57:28PM -0600, Boyd Lynn Gerber <gerberb@zenez.com> wrote:
> This is really frustrating.
> 
> I have tried every combination of file://localhost/ file:///
> 
> This is what I get
> 
> git-svn clone file:///working/svn/network/wireshark/ -T trunk -b branches 
> -t tags wireshark
> Initialized empty Git repository in .git/
> Couldn't open a repository: Unable to open an ra_local session to URL: 
> Unable to open repository 'file:///working/svn/network/wireshark' at 
> /usr/bin/git-svn line 1048

Did you do just a simple checkout or do you have the full repository at
/working/svn/network/wireshark?

You need the later if you want to do the conversion offline.

[-- Attachment #2: Type: application/pgp-signature, Size: 197 bytes --]

Re: git-svn-import or CVS import from local HD rather than remote.

[Boyd Lynn Gerber]

On Thu, 12 Jun 2008, Miklos Vajna wrote:
> On Thu, Jun 12, 2008 at 01:57:28PM -0600, Boyd Lynn Gerber <gerberb@zenez.com> wrote:
> > This is really frustrating.
> > 
> > I have tried every combination of file://localhost/ file:///
> > 
> > This is what I get
> > 
> > git-svn clone file:///working/svn/network/wireshark/ -T trunk -b branches 
> > -t tags wireshark
> > Initialized empty Git repository in .git/
> > Couldn't open a repository: Unable to open an ra_local session to URL: 
> > Unable to open repository 'file:///working/svn/network/wireshark' at 
> > /usr/bin/git-svn line 1048
> 
> Did you do just a simple checkout or do you have the full repository at
> /working/svn/network/wireshark?
> 
> You need the later if you want to do the conversion offline.

I have the full svn for each of the svn projects.  Eventually I want the 
communications to go both ways.
 

--
Boyd Gerber <gerberb@zenez.com>
ZENEZ	1042 East Fort Union #135, Midvale Utah  84047

Re: git-svn-import or CVS import from local HD rather than remote.

[Daniel Barkalow]

On Thu, 12 Jun 2008, Boyd Lynn Gerber wrote:

> On Thu, 12 Jun 2008, Daniel Barkalow wrote:
> > On Thu, 12 Jun 2008, Boyd Lynn Gerber wrote:
> > > On Thu, 12 Jun 2008, Miklos Vajna wrote:
> > > > On Thu, Jun 12, 2008 at 12:36:43PM -0600, Boyd Lynn Gerber 
> > > > <gerberb@zenez.com> wrote:
> > > > > git-svnimport -C /working/git/project /master/svn/pub-svn/category/project
> > > > 
> > > > From RelNotes-1.5.4.txt:
> > > > 
> > > >  * "git svnimport" was removed in favor of "git svn".  It is still there
> > > >    in the source tree (contrib/examples) but unsupported.
> > > > 
> > > > Try using git-svn.
> > > 
> > > Thanks, I was not sure which I should use,  I had tried both with similar 
> > > results.  Here is what I used with git-svn
> > > 
> > > > git-svn clone /working/svn/networking/wireshark .
> > > Initialized empty Git repository in .git/
> > > Bad URL passed to RA layer: Unrecognized URL scheme for 
> > > '/working/svn/networking/wireshark' at /usr/bin/git-svn line 934
> > 
> > Maybe file:///working/svn/networking/wireshark?
> 
> This is really frustrating.
> 
> I have tried every combination of file://localhost/ file:///
> 
> This is what I get
> 
> git-svn clone file:///working/svn/network/wireshark/ -T trunk -b branches 
> -t tags wireshark
> Initialized empty Git repository in .git/
> Couldn't open a repository: Unable to open an ra_local session to URL: 
> Unable to open repository 'file:///working/svn/network/wireshark' at 
> /usr/bin/git-svn line 1048
> 
> > ls -la /working/svn/network/wireshark/
> total 16
> drwxr-xr-x  8 gerberb zenez  208 2008-06-10 12:44 .
> drwxr-xr-x  9 gerberb zenez  240 2008-06-12 13:00 ..
> drwxr-xr-x  6 gerberb zenez  240 2008-06-12 12:14 .svn
> drwxr-xr-x  6 gerberb zenez  152 2008-06-10 12:43 historic
> drwxr-xr-x  5 gerberb zenez  152 2008-06-10 12:46 prereleases
> drwxr-xr-x 86 gerberb zenez 2728 2008-06-10 12:37 releases
> drwxr-xr-x 26 gerberb zenez 7016 2008-06-10 12:39 trunk
> drwxr-xr-x 25 gerberb zenez 7136 2008-06-10 11:45 trunk-1.0

That looks like a SVN working copy, not an SVN repository. Maybe you want 
file:///master/svn/...?

	-Daniel
*This .sig left intentionally blank*

Re: git-svn-import or CVS import from local HD rather than remote.

[Boyd Lynn Gerber]

On Thu, 12 Jun 2008, Daniel Barkalow wrote:
> On Thu, 12 Jun 2008, Boyd Lynn Gerber wrote:
> > 
> > This is really frustrating.
> > 
> > I have tried every combination of file://localhost/ file:///
> > 
> > This is what I get
> > 
> > git-svn clone file:///working/svn/network/wireshark/ -T trunk -b 
> > branches -t tags wireshark Initialized empty Git repository in .git/ 
> > Couldn't open a repository: Unable to open an ra_local session to URL: 
> > Unable to open repository 'file:///working/svn/network/wireshark' at 
> > /usr/bin/git-svn line 1048
> > 
> > > ls -la /working/svn/network/wireshark/
> > total 16
> > drwxr-xr-x  8 gerberb zenez  208 2008-06-10 12:44 .
> > drwxr-xr-x  9 gerberb zenez  240 2008-06-12 13:00 ..
> > drwxr-xr-x  6 gerberb zenez  240 2008-06-12 12:14 .svn
> > drwxr-xr-x  6 gerberb zenez  152 2008-06-10 12:43 historic
> > drwxr-xr-x  5 gerberb zenez  152 2008-06-10 12:46 prereleases
> > drwxr-xr-x 86 gerberb zenez 2728 2008-06-10 12:37 releases
> > drwxr-xr-x 26 gerberb zenez 7016 2008-06-10 12:39 trunk
> > drwxr-xr-x 25 gerberb zenez 7136 2008-06-10 11:45 trunk-1.0
> 
> That looks like a SVN working copy, not an SVN repository. Maybe you 
> want file:///master/svn/...?

I tried /master/svn/network/... as well.  Same results.  I can cd 
/master/svn/network/... svn update and I get any updates from the URL.  

I really do not want to run web-dav.  I am able to do it if I run web-dav 
and have my server as a svn master.  I have had security issues with 
web-dav and I really want to avoid running it at all costs.

Thanks,

--
Boyd Gerber <gerberb@zenez.com>
ZENEZ	1042 East Fort Union #135, Midvale Utah  84047

Re: git-svn-import or CVS import from local HD rather than remote.

[Daniel Barkalow]

On Thu, 12 Jun 2008, Boyd Lynn Gerber wrote:

> On Thu, 12 Jun 2008, Daniel Barkalow wrote:
> > On Thu, 12 Jun 2008, Boyd Lynn Gerber wrote:
> > > 
> > > This is really frustrating.
> > > 
> > > I have tried every combination of file://localhost/ file:///
> > > 
> > > This is what I get
> > > 
> > > git-svn clone file:///working/svn/network/wireshark/ -T trunk -b 
> > > branches -t tags wireshark Initialized empty Git repository in .git/ 
> > > Couldn't open a repository: Unable to open an ra_local session to URL: 
> > > Unable to open repository 'file:///working/svn/network/wireshark' at 
> > > /usr/bin/git-svn line 1048
> > > 
> > > > ls -la /working/svn/network/wireshark/
> > > total 16
> > > drwxr-xr-x  8 gerberb zenez  208 2008-06-10 12:44 .
> > > drwxr-xr-x  9 gerberb zenez  240 2008-06-12 13:00 ..
> > > drwxr-xr-x  6 gerberb zenez  240 2008-06-12 12:14 .svn
> > > drwxr-xr-x  6 gerberb zenez  152 2008-06-10 12:43 historic
> > > drwxr-xr-x  5 gerberb zenez  152 2008-06-10 12:46 prereleases
> > > drwxr-xr-x 86 gerberb zenez 2728 2008-06-10 12:37 releases
> > > drwxr-xr-x 26 gerberb zenez 7016 2008-06-10 12:39 trunk
> > > drwxr-xr-x 25 gerberb zenez 7136 2008-06-10 11:45 trunk-1.0
> > 
> > That looks like a SVN working copy, not an SVN repository. Maybe you 
> > want file:///master/svn/...?
> 
> I tried /master/svn/network/... as well.  Same results.  I can cd 
> /master/svn/network/... svn update and I get any updates from the URL.

That means it's a SVN working copy; SVN working copies don't contain the 
project history, so it's impossible to import from them. 

Basically, if you can't use your master copy for "svn co <URL>", you can't 
use it for "git svn".

> I really do not want to run web-dav.  I am able to do it if I run web-dav 
> and have my server as a svn master.  I have had security issues with 
> web-dav and I really want to avoid running it at all costs.

The SVN FAQ has information on running a SVN master without any web 
service. You should probably read that.

Alternatively, you could give up on having any local SVN-based storage, 
and have /master/svn/... be a git repository that you update from the 
upstream SVN server with "git svn".

	-Daniel
*This .sig left intentionally blank*

Re: git-svn-import or CVS import from local HD rather than remote.

[Boyd Lynn Gerber]

On Thu, 12 Jun 2008, Daniel Barkalow wrote:
> On Thu, 12 Jun 2008, Boyd Lynn Gerber wrote:
> > On Thu, 12 Jun 2008, Daniel Barkalow wrote:
> > > On Thu, 12 Jun 2008, Boyd Lynn Gerber wrote:
> > > > 
> > > > This is really frustrating.
> > > > 
> > > > I have tried every combination of file://localhost/ file:///
> > > > 
> > > > This is what I get
> > > > 
> > > > git-svn clone file:///working/svn/network/wireshark/ -T trunk -b 
> > > > branches -t tags wireshark Initialized empty Git repository in .git/ 
> > > > Couldn't open a repository: Unable to open an ra_local session to URL: 
> > > > Unable to open repository 'file:///working/svn/network/wireshark' at 
> > > > /usr/bin/git-svn line 1048
> > > > 
> > > > > ls -la /working/svn/network/wireshark/
> > > > total 16
> > > > drwxr-xr-x  8 gerberb zenez  208 2008-06-10 12:44 .
> > > > drwxr-xr-x  9 gerberb zenez  240 2008-06-12 13:00 ..
> > > > drwxr-xr-x  6 gerberb zenez  240 2008-06-12 12:14 .svn
> > > > drwxr-xr-x  6 gerberb zenez  152 2008-06-10 12:43 historic
> > > > drwxr-xr-x  5 gerberb zenez  152 2008-06-10 12:46 prereleases
> > > > drwxr-xr-x 86 gerberb zenez 2728 2008-06-10 12:37 releases
> > > > drwxr-xr-x 26 gerberb zenez 7016 2008-06-10 12:39 trunk
> > > > drwxr-xr-x 25 gerberb zenez 7136 2008-06-10 11:45 trunk-1.0
> > > 
> > > That looks like a SVN working copy, not an SVN repository. Maybe you 
> > > want file:///master/svn/...?
> > 
> > I tried /master/svn/network/... as well.  Same results.  I can cd 
> > /master/svn/network/... svn update and I get any updates from the URL.
> 
> That means it's a SVN working copy; SVN working copies don't contain the 
> project history, so it's impossible to import from them. 
> 
> Basically, if you can't use your master copy for "svn co <URL>", you can't 
> use it for "git svn".

OK, but when I have web-dav running I am able to do a svn co URL.
 
> > I really do not want to run web-dav.  I am able to do it if I run web-dav 
> > and have my server as a svn master.  I have had security issues with 
> > web-dav and I really want to avoid running it at all costs.
> 
> The SVN FAQ has information on running a SVN master without any web 
> service. You should probably read that.

That is what I have been going over and play with for the last about 2 
hours.  Thanks for the hints.  

> Alternatively, you could give up on having any local SVN-based storage, 
> and have /master/svn/... be a git repository that you update from the 
> upstream SVN server with "git svn".

The problem is I have over 100 projects in my /master/svn/... we use them 
to do checkouts.  I am able to check out from my /master/svn/ with svn, I 
just can not seem to get the same to work with git.  But it probably is 
just me being dumb or missing something.  I am going to finish going over 
the various FAQ's again.  I am sure I am missing something.  I am sure 
there has to be a way without having web-dav running.

Thanks,

--
Boyd Gerber <gerberb@zenez.com>
ZENEZ	1042 East Fort Union #135, Midvale Utah  84047

Re: git-svn-import or CVS import from local HD rather than remote.

[Asheesh Laroia]

On Thu, 12 Jun 2008, Boyd Lynn Gerber wrote:

> The problem is I have over 100 projects in my /master/svn/... we use them
> to do checkouts.  I am able to check out from my /master/svn/ with svn, I
> just can not seem to get the same to work with git.

Can you type the working "svn checkout" command into an email, and paste 
that conversation into the email also?

Can you then try doing "git svn init $THAT_URL_YOU_PASSED_TO_SVN_CHECKOUT 
; git svn fetch" and paste the conversation into an email to the git list?

-- Asheesh.

-- 
Ok, I'm just uploading the new version of the kernel, v1.3.33, also
known as "the buggiest kernel ever".
 		-- Linus Torvalds