Dogfooding and usability testing Toaster

Dogfooding and usability testing Toaster

[Barros Pena, Belen]

Hi all, 

I am looking into collecting feedback on the first version of Toaster

https://www.yoctoproject.org/blogs/belenbarrospena/2014/eye-candy

which will be out with Yocto Project 1.6. There are 2 things I'd like to
do:

1) Dogfooding

Once the release is out, it would be great to have people trying Toaster
for real work stuff, and telling us how it went. I am of course
particularly keen on hearing about what's wrong, so feel free to vent your
frustrations with the thing.

2) (More formal) usability testing

I am also looking into validating the Toaster interface in more
conventional ways, which means usability testing. This is done in
30-minute sessions run remotely using screen sharing software, although we
can also do it in person if you are going to ELC or the OEDAM. During
those 30 minutes you will be asked to do some stuff with Toaster and to
speak your mind a lot. I will also ask for your permission to record the
session, which you can of course refuse.

If you would like to volunteer for this (which is useful and important
stuff), get in touch with me (I am belen in IRC, or email me). I would
normally give out something in return for your time, but things are tight
right now, so I'm afraid all you'll get on this occasion is a heartwarming
thank you.

Cheers

Belén

Dogfooding and usability testing Toaster

[Barros Pena, Belen]

Hi all,

I am looking into collecting feedback on the first version of Toaster

https://www.yoctoproject.org/blogs/belenbarrospena/2014/eye-candy

which will be out with Yocto Project 1.6. There are 2 things I'd like to
do:

1) Dogfooding

Once the release is out, it would be great to have people trying Toaster
for real work stuff, and telling us how it went. I am of course
particularly keen on hearing about what's wrong, so feel free to vent your
frustrations with the thing.

2) (More formal) usability testing

I am also looking into validating the Toaster interface in more
conventional ways, which means usability testing. This is done in
30-minute sessions run remotely using screen sharing software, although we
can also do it in person if you are going to ELC or the OEDAM. During
those 30 minutes you will be asked to do some stuff with Toaster and to
speak your mind a lot. I will also ask for your permission to record the
session, which you can of course refuse.

If you would like to volunteer for this (which is useful and important
stuff), get in touch with me (I am belen in IRC, or email me). I would
normally give out something in return for your time, but things are tight
right now, so I'm afraid all you'll get on this occasion is a heartwarming
thank you.

Cheers

Belén

Re: Dogfooding and usability testing Toaster

[Philip Balister]

On 04/09/2014 03:43 AM, Barros Pena, Belen wrote:
> Hi all,
> 
> I am looking into collecting feedback on the first version of Toaster
> 
> https://www.yoctoproject.org/blogs/belenbarrospena/2014/eye-candy
> 
> which will be out with Yocto Project 1.6. There are 2 things I'd like to
> do:
> 
> 1) Dogfooding
> 
> Once the release is out, it would be great to have people trying Toaster
> for real work stuff, and telling us how it went. I am of course
> particularly keen on hearing about what's wrong, so feel free to vent your
> frustrations with the thing.
> 
> 2) (More formal) usability testing
> 
> I am also looking into validating the Toaster interface in more
> conventional ways, which means usability testing. This is done in
> 30-minute sessions run remotely using screen sharing software, although we
> can also do it in person if you are going to ELC or the OEDAM. During
> those 30 minutes you will be asked to do some stuff with Toaster and to
> speak your mind a lot. I will also ask for your permission to record the
> session, which you can of course refuse.

Belen, can you add this to the OEDAM wiki page? We should have a good
variety of people there to give feedback.

Philip

> 
> If you would like to volunteer for this (which is useful and important
> stuff), get in touch with me (I am belen in IRC, or email me). I would
> normally give out something in return for your time, but things are tight
> right now, so I'm afraid all you'll get on this occasion is a heartwarming
> thank you.
> 
> Cheers
> 
> Belén
> 

Re: Dogfooding and usability testing Toaster

[Rudolf Streif]

[-- Attachment #1: Type: text/plain, Size: 940 bytes --]

Hi Belen,

That is exciting. I just ran with it and started a build with toaster in
the background. A couple of observations from the get-go:

   - South 0.8.4 is also needed in addition to Django. The Toaster Wiki [1]
   does not say that but the Contribute to Toaster page [2] does.
   - You need to run 'sudo pip install ...' for Django and South otherwise
   the installation fails with 'permission denied' for /usr/lib/python2.7
   - Clicking on "Show me the manual" in the Toaster UI directs to [3]
   which requires a log in
   - Is it possible to relocate/rename the toaster.sqlite database via
   configuration setting? If so, could I use the same database for different
   build environments?

Thanks,
Rudi




[1] https://wiki.yoctoproject.org/wiki/Toaster#Installation_and_Running
[2] https://wiki.yoctoproject.org/wiki/Contribute_to_Toaster
[3] https://www.yoctoproject.org/documentation/toaster-manual

[-- Attachment #2: Type: text/html, Size: 1418 bytes --]

Re: Dogfooding and usability testing Toaster

[Chris Larson]

[-- Attachment #1: Type: text/plain, Size: 1162 bytes --]

On Wed, Apr 9, 2014 at 4:33 PM, Rudolf Streif <rudolf.streif@linux.com>wrote:

> That is exciting. I just ran with it and started a build with toaster in
> the background. A couple of observations from the get-go:
>
>    - South 0.8.4 is also needed in addition to Django. The Toaster Wiki
>    [1] does not say that but the Contribute to Toaster page [2] does.
>    - You need to run 'sudo pip install ...' for Django and South
>    otherwise the installation fails with 'permission denied' for
>    /usr/lib/python2.7
>    - Clicking on "Show me the manual" in the Toaster UI directs to [3]
>    which requires a log in
>    - Is it possible to relocate/rename the toaster.sqlite database via
>    configuration setting? If so, could I use the same database for different
>    build environments?
>
>
Side note: you can use pip install --user ... rather than sudo pip, to
install it to your user site-packages directory under ~/.local, which won't
impact the rest of the system.
-- 
Christopher Larson
clarson at kergoth dot com
Founder - BitBake, OpenEmbedded, OpenZaurus
Maintainer - Tslib
Senior Software Engineer, Mentor Graphics

[-- Attachment #2: Type: text/html, Size: 1500 bytes --]

Re: Dogfooding and usability testing Toaster

[Paul Eggleton]

On Wednesday 09 April 2014 16:39:38 Chris Larson wrote:
> On Wed, Apr 9, 2014 at 4:33 PM, Rudolf Streif 
<rudolf.streif@linux.com>wrote:
> > That is exciting. I just ran with it and started a build with toaster in
> > 
> > the background. A couple of observations from the get-go:
> >    - South 0.8.4 is also needed in addition to Django. The Toaster Wiki
> >    [1] does not say that but the Contribute to Toaster page [2] does.
> >    - You need to run 'sudo pip install ...' for Django and South
> >    otherwise the installation fails with 'permission denied' for
> >    /usr/lib/python2.7
> >    - Clicking on "Show me the manual" in the Toaster UI directs to [3]
> >    which requires a log in
> >    - Is it possible to relocate/rename the toaster.sqlite database via
> >    configuration setting? If so, could I use the same database for
> >    different
> >    build environments?
> 
> Side note: you can use pip install --user ... rather than sudo pip, to
> install it to your user site-packages directory under ~/.local, which won't
> impact the rest of the system.

I'd like to see this documented using virtualenv [1] to install the additional 
packages - it's so much cleaner than any other solution.

Cheers,
Paul

[1] For those who aren't familiar with virtualenv:
http://simononsoftware.com/virtualenv-tutorial/

-- 

Paul Eggleton
Intel Open Source Technology Centre

Re: Dogfooding and usability testing Toaster

[Barros Pena, Belen]

On 09/04/2014 21:52, "Philip Balister" <philip@balister.org> wrote:

>On 04/09/2014 03:43 AM, Barros Pena, Belen wrote:
>> Hi all,
>> 
>> I am looking into collecting feedback on the first version of Toaster
>> 
>> https://www.yoctoproject.org/blogs/belenbarrospena/2014/eye-candy
>> 
>> which will be out with Yocto Project 1.6. There are 2 things I'd like to
>> do:
>> 
>> 1) Dogfooding
>> 
>> Once the release is out, it would be great to have people trying Toaster
>> for real work stuff, and telling us how it went. I am of course
>> particularly keen on hearing about what's wrong, so feel free to vent
>>your
>> frustrations with the thing.
>> 
>> 2) (More formal) usability testing
>> 
>> I am also looking into validating the Toaster interface in more
>> conventional ways, which means usability testing. This is done in
>> 30-minute sessions run remotely using screen sharing software, although
>>we
>> can also do it in person if you are going to ELC or the OEDAM. During
>> those 30 minutes you will be asked to do some stuff with Toaster and to
>> speak your mind a lot. I will also ask for your permission to record the
>> session, which you can of course refuse.
>
>Belen, can you add this to the OEDAM wiki page? We should have a good
>variety of people there to give feedback.

Good point. It also gave me the excuse to request an account for the wiki.
Will do as soon as I get login details.

Thanks!

Belén

>
>Philip
>
>> 
>> If you would like to volunteer for this (which is useful and important
>> stuff), get in touch with me (I am belen in IRC, or email me). I would
>> normally give out something in return for your time, but things are
>>tight
>> right now, so I'm afraid all you'll get on this occasion is a
>>heartwarming
>> thank you.
>> 
>> Cheers
>> 
>> Belén
>> 

Re: Dogfooding and usability testing Toaster

[Barros Pena, Belen]

On 10/04/2014 11:14, "Paul Eggleton" <paul.eggleton@linux.intel.com> wrote:

>On Wednesday 09 April 2014 16:39:38 Chris Larson wrote:
>> On Wed, Apr 9, 2014 at 4:33 PM, Rudolf Streif
><rudolf.streif@linux.com>wrote:
>> > That is exciting. I just ran with it and started a build with toaster
>>in
>> > 
>> > the background. A couple of observations from the get-go:
>> >    - South 0.8.4 is also needed in addition to Django. The Toaster
>>Wiki
>> >    [1] does not say that but the Contribute to Toaster page [2] does.
>> >    - You need to run 'sudo pip install ...' for Django and South
>> >    otherwise the installation fails with 'permission denied' for
>> >    /usr/lib/python2.7

Thanks for this. We'll make sure to update the wiki.


>> >    - Clicking on "Show me the manual" in the Toaster UI directs to [3]
>> >    which requires a log in

Ah, yes: the manual is not ready yet, so its web page is not published.
That's why you are being asked to log in. It should be ready by release
time.

>> >    - Is it possible to relocate/rename the toaster.sqlite database via
>> >    configuration setting? If so, could I use the same database for
>> >    different
>> >    build environments?

I believe you can, although Alex Damien is the one who can explain the
details. The information here:

https://wiki.yoctoproject.org/wiki/Toaster#Setting_up_a_Toaster_Instance_on
_a_Remote_Host

might also answer some questions.

>> 
>> Side note: you can use pip install --user ... rather than sudo pip, to
>> install it to your user site-packages directory under ~/.local, which
>>won't
>> impact the rest of the system.
>
>I'd like to see this documented using virtualenv [1] to install the
>additional 
>packages - it's so much cleaner than any other solution.

Good point. I'll look into getting that going.

Belén

>
>Cheers,
>Paul
>
>[1] For those who aren't familiar with virtualenv:
>http://simononsoftware.com/virtualenv-tutorial/
>
>-- 
>
>Paul Eggleton
>Intel Open Source Technology Centre
>-- 
>_______________________________________________
>yocto mailing list
>yocto@yoctoproject.org
>https://lists.yoctoproject.org/listinfo/yocto