From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ramkumar Ramachandra Subject: Re: Advertising the Git User's Survey 2011 Date: Sun, 3 Oct 2010 18:18:22 +0530 Message-ID: <20101003124818.GA328@kytes> References: <20101002062056.GB16626@kytes> <201010031121.03795.jnareb@gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: =?iso-8859-1?Q?=C6var_Arnfj=F6r=F0?= Bjarmason , Git Mailing List To: Jakub Narebski X-From: git-owner@vger.kernel.org Sun Oct 03 14:49:29 2010 Return-path: Envelope-to: gcvg-git-2@lo.gmane.org Received: from vger.kernel.org ([209.132.180.67]) by lo.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1P2O0O-0001a5-8N for gcvg-git-2@lo.gmane.org; Sun, 03 Oct 2010 14:49:29 +0200 Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753437Ab0JCMtW (ORCPT ); Sun, 3 Oct 2010 08:49:22 -0400 Received: from mail-pw0-f46.google.com ([209.85.160.46]:43800 "EHLO mail-pw0-f46.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753324Ab0JCMtV (ORCPT ); Sun, 3 Oct 2010 08:49:21 -0400 Received: by pwj5 with SMTP id 5so901274pwj.19 for ; Sun, 03 Oct 2010 05:49:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:date:from:to:cc:subject :message-id:references:mime-version:content-type:content-disposition :in-reply-to:user-agent; bh=hE+bHoTCeqL1t3o2OEsjgcL/FbSqqylBSZe4iVFeiQU=; b=D9o2dFxFq04JW1wVOB7OKXp1CoU8KDqhf/uLA15NpdTgloBrTd/3/mDeUwG6rPfrSJ fDMj5kZ/iO602N3mb3ufIauxC8re7L5wX54tiI+HXQ1ycStPsqR8hQFBdhWsW5qw/ktV v8UD7FgLBP7eIKN2dICIXdG9+YZIqPMo7UiOQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=PC5F4GDI/++PUaADIrAZ2MbVWOMbhJZuXPeczUm205ew6Ci+TnnFfOsgEeNkZ7la5Y tvq2Z3y7ng/do+7306M38b0SM1734ygN1BCCZtq0OnsS3EJK1BMzOdvkQJkA9DN9Y9y7 vBrULiGoq8T1QqI5usgev3YzPpAnPKUwBtxl8= Received: by 10.142.71.11 with SMTP id t11mr7247028wfa.121.1286110161440; Sun, 03 Oct 2010 05:49:21 -0700 (PDT) Received: from kytes ([203.110.240.41]) by mx.google.com with ESMTPS id b5sm3808719wfe.6.2010.10.03.05.49.17 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sun, 03 Oct 2010 05:49:20 -0700 (PDT) Content-Disposition: inline In-Reply-To: <201010031121.03795.jnareb@gmail.com> User-Agent: Mutt/1.5.20 (2009-06-14) Sender: git-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org Archived-At: Hi Jakub, Thanks for taking the time to go through my long (somewhat unstructured) note. Jakub Narebski writes: > On Sat, 2 Oct 2010, Ramkumar Ramachandra wrote: > > Interesting statistic: 24508 people viewed it, 7821 people completed > > it, but 0 people started filling out information and later decided not > > to submit it. It could mean that many people clicked through and found > > the survey, but probably left because it looked too long at a glance? > > Without the knowledge how those two numbers are calculated we can only > speculate what do they mean. > > I think that '0' in 'Incomplete' statistics is here because this survey > doesn't have compulsory questions: answering all questions are optional, > so it might mean that even if one question in the survey is answered, > then the survey is considered complete by Survs.com statistics. I just opened up survs.com, signed up for a free account and created a survey with two compulsory questions- I couldn't submit the results without filling up both of them. Then I looked at the statistics and I saw a '0' in incomplete- I'm confused. Perhaps we can email survs.com and ask them? > I personally do not like the "wizard" formatting of surveys, i.e. > dividing survey into page so you are not presented with very long page, > but are presented withc chunks of survey at glance. Even if you see > how much survey did you fill in (how many pages there are in total), > and even if you can go back to previous page. Same. I also think "wizard" is a bad idea for this- it would make it look like some sort of online test :p > I'd prefer to create a better information about survey upfront. We say > that all questions are optional ("Note that you may skip questions as > you like"). It is also stated that you can fill only a part of survey, > and later go back to finish it... hmmm, I wonder if those cases where > one edited his/her survey responses multiple times are counted as one > finished survey, but multiple views. Sure. Again, we should perhaps email survs.com for such clarifications. > We could also write how much time it takes on average to fil the survey. Sounds good. > > The average time spent on the survery is 34 minutes > > It would be interesting to have more detailed statistics of time spent > on the survey that only average time, a single number. When one is > filling open-form essay-length question, it would obviously take much > more time than for one who doesn't. Hm, yes. I didn't think about this. > > - I think we can bring that down to 10~15 minutes if we design > > questions to extract more information. Also, there's little incentive > > for taking the survey: while many companies actually give out > > discounts/ coupons for taking surveys, the least we can do is present > > real-time results in the most interesting manner possible ie. survey > > takers should see the "results so far" immediately after taking the > > survey; some visualizations such as pie charts? > > What we can do is after finishing the survey to redirect to the > survey analysis page: > > https://www.survs.com/results/33Q0OZZE/MV653KSPI2 > http://tinyurl.com/GitSurvey2010Analysis > > instead of IIRC currently used redirect to > > https://git.wiki.kernel.org/index.php/GitSurvey2010 > > > As far as I know Survs.com doesn't provide any API for extracting data > or survey statistics required for creating such visualization. Neither > we have a place where such app could be created, I think. Oh, ok- we should take too much trouble though; we should keep cost-to-benefit ratio in mind. > > In questions 5, 10, 12, 13, 16, cut down out the options that have > > very few respondents and let them all go into "other". It probably > > doesn't actually save the survey taker any time, but I think seeing a > > long page with many options can be scary. > > The "5. Which Git version(s) are you using?" is not that long. We could > create a cut off a bit earlier, perhaps on 1.4 (i.e. have "pre 1.4") or > even earlier, we could remove alternate implementations answers > (git-bigfiles, JGit, other implementations), or even concatenate 'master', > 'next', 'pu' into single response... but would it buy us much? > > The other side of removing choices, relying instead on "other, please > specify" response is that it makes it harder to analyze results of survey: > different people use different words for the same thing (and there are > also spelling mistakes), and make results less reliable: people do not > fill "other" if there is at least partial match, or do not know how to > specify their version. Ofcourse. We should only remove options that don't necessarily tell us very much. > We can remove those choices in "12. What Git GUIs (graphical user > interfaces) do you use?" that got less than 1% rounded, or less than > 10 responses. On the other hand some people stated earlier that the > list of possible choices in the survey (not necessarily about this > question in specific) serve as reminder / information about possible > choices. Hm, I hadn't thought of that. I suppose it can be used to advertise various applications. > The other side of removing options from "13. Which git hosting site(s) > do you use for your project(s)?" is that when sending requests to > announce the survey to those git hosting sites that are not on this > list, some of them requested to be added (which is impossible after > starting the survey; and before survey begins it is little sense to > send announcements). I see. How are we going to tackle this in future? > Besides all of those below 1% rounded (Codesion, GitFarm, The Chaw, > CipherHive) are also those that I didn't get response to request for > announcing Git User's Survey 2010... Interesting. > We could make it more organized though, e.g. by sorting list of options > alphabetically, or something like that. Sounds good. > > 1. Country of residence: we can probably make this a nice click-on-map > > interface as opposed to freeform text. It'll be more useful to us, > > and more interesting to users when we advertise the results. > > It would be nice to have click-on-map (Google Maps or Bing Maps based), > something like Ohloh provides, resulting in map of survey responders > similar to the map of git users and git contributors on Ohloh > > http://www.ohloh.net/p/git/map > > it isn't something that Survs.com offers currently. I can only ask for > it to be provided... > > > Another solution would be to have pre-filled combo box (