Re: Viewing userspace apps traces

Re: Viewing userspace apps traces

[Alexandre Montplaisir]

Hi Paul,

On 12-10-02 04:10 PM, Paul Chavent wrote:
> Hi.
>
> Today, I've tested the tracing of a user space app.
>
> I wonder what is the best solution for viewing it ?
>
> I have tried babeltrace that produce a good comprehensive text outpout.
> I have tried eclipse that isn't able to use the vtid and vpid context.
> It's unfortunate as i would like to see a timeline representation...

Do you mean the Events view does not show the event contexts? It should,
afaik. It could be a bug.

As for graphical views, like timegraphs, it's not easy to have a general
view that can work with any UST trace. Each application defines its own
event types, so we have no guarantee for any given event type to be there.

What would you like see in your "timeline representation" exactly? Maybe
we could give you some pointers as to how to implement such a view.
(We're currently working on making it easy to extend the framework to
implement new views, so this could be a good exercise!)

> Is it a good solution to use the custom text parser of the eclipse tool ?

Not really, the custom parsers are, for example, when you have a text
log and want to import it into the TMF framework. LTTng/UST traces are
in CTF format, and that format is already supported in TMF.



Cheers,

-- 
Alexandre Montplaisir
DORSAL lab,
École Polytechnique de Montréal

Re: Viewing userspace apps traces

[Paul Chavent]

Hi

Thank you for your reply :

On 10/02/2012 10:29 PM, Alexandre Montplaisir wrote:
> Hi Paul,
>
> On 12-10-02 04:10 PM, Paul Chavent wrote:
>> Hi.
>>
>> Today, I've tested the tracing of a user space app.
>>
>> I wonder what is the best solution for viewing it ?
>>
>> I have tried babeltrace that produce a good comprehensive text outpout.
>> I have tried eclipse that isn't able to use the vtid and vpid context.
>> It's unfortunate as i would like to see a timeline representation...
>
> Do you mean the Events view does not show the event contexts? It should,
> afaik. It could be a bug.
>
> As for graphical views, like timegraphs, it's not easy to have a general
> view that can work with any UST trace. Each application defines its own
> event types, so we have no guarantee for any given event type to be there.
>
> What would you like see in your "timeline representation" exactly? Maybe
> we could give you some pointers as to how to implement such a view.
> (We're currently working on making it easy to extend the framework to
> implement new views, so this could be a good exercise!)

I would like to see, eg, one line per tid, and on each line, the value of one context or argument value.

I'm ready to follow an exercise for extending the framework !

>
>> Is it a good solution to use the custom text parser of the eclipse tool ?
>
> Not really, the custom parsers are, for example, when you have a text
> log and want to import it into the TMF framework. LTTng/UST traces are
> in CTF format, and that format is already supported in TMF.
>
>
>
> Cheers,
>

Re: Viewing userspace apps traces

[Alexandre Montplaisir]

Sorry for the late reply, I had to update/rebase some of the stuff first...

(Cross-posting linuxtools-dev, as it might interest some people who
follow that list too. This is about extending TMF to implement a
graphical view for a specific UST trace type.)


On 12-10-03 01:50 AM, Paul Chavent wrote:
> [...]
>
> On 10/02/2012 10:29 PM, Alexandre Montplaisir wrote:
>> [...]
>>
>> What would you like see in your "timeline representation" exactly? Maybe
>> we could give you some pointers as to how to implement such a view.
>> (We're currently working on making it easy to extend the framework to
>> implement new views, so this could be a good exercise!)
>
> I would like to see, eg, one line per tid, and on each line, the value
> of one context or argument value.
>
> I'm ready to follow an exercise for extending the framework !

Ok good! We don't have a nice tutorial ready yet, as most parts are
still working their way upstream. But if you want to dig into it and try
it out now, you can:

1 - Set up the development environment for TMF:
http://wiki.eclipse.org/Linux_Tools_Project/LTTng_Eclipse_Plug-in_Development_Environement_Setup

2 - Checkout the "lttng-kepler" branch in the git. This is where the
latest development happens.

3 - Apply those two patches, in that order:
https://git.eclipse.org/r/#/c/7747/
https://git.eclipse.org/r/#/c/7748/
(you can copy-paste the "cherry-pick" command shown on the page)

4 - Download the example program and view from:
git://git.dorsal.polymtl.ca/~alexmont/ust-example.git

Now at this point you should be able to import and build the example
plugins (ust.example.core and ust.example.ui) and the TMF/LTTng ones in
the same workspace.

You can try it to make sure it works correctly : take a UST trace of the
"myprog" program, and then load it into TMF, and show the "Example ->
Connections" view. It should display the yellow and green rectangles
corresponding to the states that were defined.


After that, it shouldn't be too hard (famous last words...) to rework
the ust.example.* code to fit your application. The points of interest
will be (before renames):

MyUstTraceInput, line 85+: This is where you assign your trace events to
states
ConnectionsPresentationProvider, line 31-34: This is where you assign
the colors to each state in the view
and same file, lines 64-68 and 81-85 : This is where you assign the
trace's states to the ones in the view.
(one place is for the actual colored rectangle, the other is for the
tooltips, iirc).


If you have any question or problem, please let me know!

Good luck ;)

-- 
Alexandre Montplaisir
DORSAL lab,
École Polytechnique de Montréal

Re: Viewing userspace apps traces

[Oestman, Fredrik]

Alexandre Montplaisir wrote:
> As for graphical views, like timegraphs, it's not easy to have a general
> view that can work with any UST trace. Each application defines its own
> event types, so we have no guarantee for any given event type to be there.

Maybe this doesn't really help you, but our commercial tool can do just that.

Cheers,

Fredrik Östman

http://go.mentor.com/sourceryanalyzer/

Re: Viewing userspace apps traces

[eamcs/eedbhu]

Hi Paul

The Eclipse Linux Tools release v1.1.1 (which is also included in the 
CDT EPP Juno SR1 release) contains an update that displays CTF context 
information in the events table.
So you should be able to see the context information.

Best Regards
Bernd


On 10/03/2012 11:41 PM, Alexandre Montplaisir wrote:
> Sorry for the late reply, I had to update/rebase some of the stuff first...
>
> (Cross-posting linuxtools-dev, as it might interest some people who
> follow that list too. This is about extending TMF to implement a
> graphical view for a specific UST trace type.)
>
>
> On 12-10-03 01:50 AM, Paul Chavent wrote:
>> [...]
>>
>> On 10/02/2012 10:29 PM, Alexandre Montplaisir wrote:
>>> [...]
>>>
>>> What would you like see in your "timeline representation" exactly? Maybe
>>> we could give you some pointers as to how to implement such a view.
>>> (We're currently working on making it easy to extend the framework to
>>> implement new views, so this could be a good exercise!)
>> I would like to see, eg, one line per tid, and on each line, the value
>> of one context or argument value.
>>
>> I'm ready to follow an exercise for extending the framework !
> Ok good! We don't have a nice tutorial ready yet, as most parts are
> still working their way upstream. But if you want to dig into it and try
> it out now, you can:
>
> 1 - Set up the development environment for TMF:
> http://wiki.eclipse.org/Linux_Tools_Project/LTTng_Eclipse_Plug-in_Development_Environement_Setup
>
> 2 - Checkout the "lttng-kepler" branch in the git. This is where the
> latest development happens.
>
> 3 - Apply those two patches, in that order:
> https://git.eclipse.org/r/#/c/7747/
> https://git.eclipse.org/r/#/c/7748/
> (you can copy-paste the "cherry-pick" command shown on the page)
>
> 4 - Download the example program and view from:
> git://git.dorsal.polymtl.ca/~alexmont/ust-example.git
>
> Now at this point you should be able to import and build the example
> plugins (ust.example.core and ust.example.ui) and the TMF/LTTng ones in
> the same workspace.
>
> You can try it to make sure it works correctly : take a UST trace of the
> "myprog" program, and then load it into TMF, and show the "Example ->
> Connections" view. It should display the yellow and green rectangles
> corresponding to the states that were defined.
>
>
> After that, it shouldn't be too hard (famous last words...) to rework
> the ust.example.* code to fit your application. The points of interest
> will be (before renames):
>
> MyUstTraceInput, line 85+: This is where you assign your trace events to
> states
> ConnectionsPresentationProvider, line 31-34: This is where you assign
> the colors to each state in the view
> and same file, lines 64-68 and 81-85 : This is where you assign the
> trace's states to the ones in the view.
> (one place is for the actual colored rectangle, the other is for the
> tooltips, iirc).
>
>
> If you have any question or problem, please let me know!
>
> Good luck ;)
>

Re: Viewing userspace apps traces

[Mathieu Desnoyers]

* Oestman, Fredrik (Fredrik_Oestman@mentor.com) wrote:
> Alexandre Montplaisir wrote:
> > As for graphical views, like timegraphs, it's not easy to have a general
> > view that can work with any UST trace. Each application defines its own
> > event types, so we have no guarantee for any given event type to be there.
> 
> Maybe this doesn't really help you, but our commercial tool can do just that.
> 
> Cheers,
> 
> Fredrik Östman
> 
> http://go.mentor.com/sourceryanalyzer/

Hi Fredrik,

Hinting at this tool in this context (discussion of an open source
viewer implementation) on lttng-dev (an open source project mailing
list) can only mean that you seem to be willing to contribute views to
the open source project. That would be very welcome indeed. What are
Mentor's plans in contributing to the open source viewer efforts of the
LTTng project ?

Thank you,

Mathieu

-- 
Mathieu Desnoyers
Operating System Efficiency R&D Consultant
EfficiOS Inc.
http://www.efficios.com

Re: Viewing userspace apps traces

[Paul Chavent]

Hi,

I've follow this link (http://www.eclipse.org/downloads/download.php?file=/technology/epp/downloads/release/juno/SR1/eclipse-cpp-juno-SR1-linux-gtk-x86_64.tar.gz) to download the Eclipse env.

Here is the version notes i can give you :
**************
Eclipse
Version: Juno Release
Build id: 20120614-1722

Eclipse Linux Tools LTTng ... 1.0.0.201206130106
**************

Then i've got my traces with :

lttng create
lttng enable-event -u -a
lttng add-context -u -t vpid -t vtid
lttng start
...
lttng stop
lttng destroy

Here is a sample of the traces :
http://paul.chavent.free.fr/tmp/sample_traces.tar.bz2


I can open the traces in eclipse (i see the "Events" panel), but i can't see the events ordered by pid/tid in the "Time Chart" panel, neither "Control Flow", nor "Ressources" ...)

Is it possible to have the traces displayed sorted by tid for instance ?

Thanks.

Paul.


On 10/04/2012 03:40 PM, eamcs/eedbhu wrote:
> Hi Paul
>
> The Eclipse Linux Tools release v1.1.1 (which is also included in the CDT EPP Juno SR1 release) contains an update that displays CTF context information in the events table.
> So you should be able to see the context information.
>
> Best Regards
> Bernd
>
>
> On 10/03/2012 11:41 PM, Alexandre Montplaisir wrote:
>> Sorry for the late reply, I had to update/rebase some of the stuff first...
>>
>> (Cross-posting linuxtools-dev, as it might interest some people who
>> follow that list too. This is about extending TMF to implement a
>> graphical view for a specific UST trace type.)
>>
>>
>> On 12-10-03 01:50 AM, Paul Chavent wrote:
>>> [...]
>>>
>>> On 10/02/2012 10:29 PM, Alexandre Montplaisir wrote:
>>>> [...]
>>>>
>>>> What would you like see in your "timeline representation" exactly? Maybe
>>>> we could give you some pointers as to how to implement such a view.
>>>> (We're currently working on making it easy to extend the framework to
>>>> implement new views, so this could be a good exercise!)
>>> I would like to see, eg, one line per tid, and on each line, the value
>>> of one context or argument value.
>>>
>>> I'm ready to follow an exercise for extending the framework !
>> Ok good! We don't have a nice tutorial ready yet, as most parts are
>> still working their way upstream. But if you want to dig into it and try
>> it out now, you can:
>>
>> 1 - Set up the development environment for TMF:
>> http://wiki.eclipse.org/Linux_Tools_Project/LTTng_Eclipse_Plug-in_Development_Environement_Setup
>>
>> 2 - Checkout the "lttng-kepler" branch in the git. This is where the
>> latest development happens.
>>
>> 3 - Apply those two patches, in that order:
>> https://git.eclipse.org/r/#/c/7747/
>> https://git.eclipse.org/r/#/c/7748/
>> (you can copy-paste the "cherry-pick" command shown on the page)
>>
>> 4 - Download the example program and view from:
>> git://git.dorsal.polymtl.ca/~alexmont/ust-example.git
>>
>> Now at this point you should be able to import and build the example
>> plugins (ust.example.core and ust.example.ui) and the TMF/LTTng ones in
>> the same workspace.
>>
>> You can try it to make sure it works correctly : take a UST trace of the
>> "myprog" program, and then load it into TMF, and show the "Example ->
>> Connections" view. It should display the yellow and green rectangles
>> corresponding to the states that were defined.
>>
>>
>> After that, it shouldn't be too hard (famous last words...) to rework
>> the ust.example.* code to fit your application. The points of interest
>> will be (before renames):
>>
>> MyUstTraceInput, line 85+: This is where you assign your trace events to
>> states
>> ConnectionsPresentationProvider, line 31-34: This is where you assign
>> the colors to each state in the view
>> and same file, lines 64-68 and 81-85 : This is where you assign the
>> trace's states to the ones in the view.
>> (one place is for the actual colored rectangle, the other is for the
>> tooltips, iirc).
>>
>>
>> If you have any question or problem, please let me know!
>>
>> Good luck ;)
>>
>

Re: [lttng-dev] Viewing userspace apps traces

[Bernd Hufmann]

Hi Paul

I was trying your trace with the Eclipse Juno SR1 CDT EPP and you're
right the context information is not displayed in the Events Table
(I'm not talking about the Time Graph and its table).
I was verifying the commits and the commit that added the support for
displaying of context information in the Events Table is in the
release. As well as the example trace with context
information I generated and tested with works. However, it was a
Kernel trace with context information and not a UST trace.

So, that needs to be investigated on our side (Eclipse developer) why
the context information is not shown for the UST trace. We'll let you
know.

Best Regard
Bernd

On Thu, Oct 4, 2012 at 4:39 PM, Paul Chavent <paul.chavent-oNGEd6G4ga4@public.gmane.org> wrote:
> Hi,
>
> I've follow this link
> (http://www.eclipse.org/downloads/download.php?file=/technology/epp/downloads/release/juno/SR1/eclipse-cpp-juno-SR1-linux-gtk-x86_64.tar.gz)
> to download the Eclipse env.
>
> Here is the version notes i can give you :
> **************
> Eclipse
> Version: Juno Release
> Build id: 20120614-1722
>
> Eclipse Linux Tools LTTng ... 1.0.0.201206130106
> **************
>
> Then i've got my traces with :
>
> lttng create
> lttng enable-event -u -a
> lttng add-context -u -t vpid -t vtid
> lttng start
> ...
> lttng stop
> lttng destroy
>
> Here is a sample of the traces :
> http://paul.chavent.free.fr/tmp/sample_traces.tar.bz2
>
>
> I can open the traces in eclipse (i see the "Events" panel), but i can't see
> the events ordered by pid/tid in the "Time Chart" panel, neither "Control
> Flow", nor "Ressources" ...)
>
> Is it possible to have the traces displayed sorted by tid for instance ?
>
> Thanks.
>
> Paul.
>
>
>
> On 10/04/2012 03:40 PM, eamcs/eedbhu wrote:
>>
>> Hi Paul
>>
>> The Eclipse Linux Tools release v1.1.1 (which is also included in the CDT
>> EPP Juno SR1 release) contains an update that displays CTF context
>> information in the events table.
>> So you should be able to see the context information.
>>
>> Best Regards
>> Bernd
>>
>>
>> On 10/03/2012 11:41 PM, Alexandre Montplaisir wrote:
>>>
>>> Sorry for the late reply, I had to update/rebase some of the stuff
>>> first...
>>>
>>> (Cross-posting linuxtools-dev, as it might interest some people who
>>> follow that list too. This is about extending TMF to implement a
>>> graphical view for a specific UST trace type.)
>>>
>>>
>>> On 12-10-03 01:50 AM, Paul Chavent wrote:
>>>>
>>>> [...]
>>>>
>>>> On 10/02/2012 10:29 PM, Alexandre Montplaisir wrote:
>>>>>
>>>>> [...]
>>>>>
>>>>> What would you like see in your "timeline representation" exactly?
>>>>> Maybe
>>>>> we could give you some pointers as to how to implement such a view.
>>>>> (We're currently working on making it easy to extend the framework to
>>>>> implement new views, so this could be a good exercise!)
>>>>
>>>> I would like to see, eg, one line per tid, and on each line, the value
>>>> of one context or argument value.
>>>>
>>>> I'm ready to follow an exercise for extending the framework !
>>>
>>> Ok good! We don't have a nice tutorial ready yet, as most parts are
>>> still working their way upstream. But if you want to dig into it and try
>>> it out now, you can:
>>>
>>> 1 - Set up the development environment for TMF:
>>>
>>> http://wiki.eclipse.org/Linux_Tools_Project/LTTng_Eclipse_Plug-in_Development_Environement_Setup
>>>
>>> 2 - Checkout the "lttng-kepler" branch in the git. This is where the
>>> latest development happens.
>>>
>>> 3 - Apply those two patches, in that order:
>>> https://git.eclipse.org/r/#/c/7747/
>>> https://git.eclipse.org/r/#/c/7748/
>>> (you can copy-paste the "cherry-pick" command shown on the page)
>>>
>>> 4 - Download the example program and view from:
>>> git://git.dorsal.polymtl.ca/~alexmont/ust-example.git
>>>
>>> Now at this point you should be able to import and build the example
>>> plugins (ust.example.core and ust.example.ui) and the TMF/LTTng ones in
>>> the same workspace.
>>>
>>> You can try it to make sure it works correctly : take a UST trace of the
>>> "myprog" program, and then load it into TMF, and show the "Example ->
>>> Connections" view. It should display the yellow and green rectangles
>>> corresponding to the states that were defined.
>>>
>>>
>>> After that, it shouldn't be too hard (famous last words...) to rework
>>> the ust.example.* code to fit your application. The points of interest
>>> will be (before renames):
>>>
>>> MyUstTraceInput, line 85+: This is where you assign your trace events to
>>> states
>>> ConnectionsPresentationProvider, line 31-34: This is where you assign
>>> the colors to each state in the view
>>> and same file, lines 64-68 and 81-85 : This is where you assign the
>>> trace's states to the ones in the view.
>>> (one place is for the actual colored rectangle, the other is for the
>>> tooltips, iirc).
>>>
>>>
>>> If you have any question or problem, please let me know!
>>>
>>> Good luck ;)
>>>
>>
>
>
> _______________________________________________
> lttng-dev mailing list
> lttng-dev-bnB2LGs2QVJ+nrgayQ7rhA@public.gmane.org
> http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

Re: Viewing userspace apps traces

[Paul Chavent]

Thank you very much for handling this point.

On 10/05/2012 02:15 PM, Bernd Hufmann wrote:
> Hi Paul
>
> I was trying your trace with the Eclipse Juno SR1 CDT EPP and you're
> right the context information is not displayed in the Events Table
> (I'm not talking about the Time Graph and its table).
> I was verifying the commits and the commit that added the support for
> displaying of context information in the Events Table is in the
> release. As well as the example trace with context
> information I generated and tested with works. However, it was a
> Kernel trace with context information and not a UST trace.
>
> So, that needs to be investigated on our side (Eclipse developer) why
> the context information is not shown for the UST trace. We'll let you
> know.
>
> Best Regard
> Bernd
>
> On Thu, Oct 4, 2012 at 4:39 PM, Paul Chavent <paul.chavent@fnac.net> wrote:
>> Hi,
>>
>> I've follow this link
>> (http://www.eclipse.org/downloads/download.php?file=/technology/epp/downloads/release/juno/SR1/eclipse-cpp-juno-SR1-linux-gtk-x86_64.tar.gz)
>> to download the Eclipse env.
>>
>> Here is the version notes i can give you :
>> **************
>> Eclipse
>> Version: Juno Release
>> Build id: 20120614-1722
>>
>> Eclipse Linux Tools LTTng ... 1.0.0.201206130106
>> **************
>>
>> Then i've got my traces with :
>>
>> lttng create
>> lttng enable-event -u -a
>> lttng add-context -u -t vpid -t vtid
>> lttng start
>> ...
>> lttng stop
>> lttng destroy
>>
>> Here is a sample of the traces :
>> http://paul.chavent.free.fr/tmp/sample_traces.tar.bz2
>>
>>
>> I can open the traces in eclipse (i see the "Events" panel), but i can't see
>> the events ordered by pid/tid in the "Time Chart" panel, neither "Control
>> Flow", nor "Ressources" ...)
>>
>> Is it possible to have the traces displayed sorted by tid for instance ?
>>
>> Thanks.
>>
>> Paul.
>>
>>
>>
>> On 10/04/2012 03:40 PM, eamcs/eedbhu wrote:
>>>
>>> Hi Paul
>>>
>>> The Eclipse Linux Tools release v1.1.1 (which is also included in the CDT
>>> EPP Juno SR1 release) contains an update that displays CTF context
>>> information in the events table.
>>> So you should be able to see the context information.
>>>
>>> Best Regards
>>> Bernd
>>>
>>>
>>> On 10/03/2012 11:41 PM, Alexandre Montplaisir wrote:
>>>>
>>>> Sorry for the late reply, I had to update/rebase some of the stuff
>>>> first...
>>>>
>>>> (Cross-posting linuxtools-dev, as it might interest some people who
>>>> follow that list too. This is about extending TMF to implement a
>>>> graphical view for a specific UST trace type.)
>>>>
>>>>
>>>> On 12-10-03 01:50 AM, Paul Chavent wrote:
>>>>>
>>>>> [...]
>>>>>
>>>>> On 10/02/2012 10:29 PM, Alexandre Montplaisir wrote:
>>>>>>
>>>>>> [...]
>>>>>>
>>>>>> What would you like see in your "timeline representation" exactly?
>>>>>> Maybe
>>>>>> we could give you some pointers as to how to implement such a view.
>>>>>> (We're currently working on making it easy to extend the framework to
>>>>>> implement new views, so this could be a good exercise!)
>>>>>
>>>>> I would like to see, eg, one line per tid, and on each line, the value
>>>>> of one context or argument value.
>>>>>
>>>>> I'm ready to follow an exercise for extending the framework !
>>>>
>>>> Ok good! We don't have a nice tutorial ready yet, as most parts are
>>>> still working their way upstream. But if you want to dig into it and try
>>>> it out now, you can:
>>>>
>>>> 1 - Set up the development environment for TMF:
>>>>
>>>> http://wiki.eclipse.org/Linux_Tools_Project/LTTng_Eclipse_Plug-in_Development_Environement_Setup
>>>>
>>>> 2 - Checkout the "lttng-kepler" branch in the git. This is where the
>>>> latest development happens.
>>>>
>>>> 3 - Apply those two patches, in that order:
>>>> https://git.eclipse.org/r/#/c/7747/
>>>> https://git.eclipse.org/r/#/c/7748/
>>>> (you can copy-paste the "cherry-pick" command shown on the page)
>>>>
>>>> 4 - Download the example program and view from:
>>>> git://git.dorsal.polymtl.ca/~alexmont/ust-example.git
>>>>
>>>> Now at this point you should be able to import and build the example
>>>> plugins (ust.example.core and ust.example.ui) and the TMF/LTTng ones in
>>>> the same workspace.
>>>>
>>>> You can try it to make sure it works correctly : take a UST trace of the
>>>> "myprog" program, and then load it into TMF, and show the "Example ->
>>>> Connections" view. It should display the yellow and green rectangles
>>>> corresponding to the states that were defined.
>>>>
>>>>
>>>> After that, it shouldn't be too hard (famous last words...) to rework
>>>> the ust.example.* code to fit your application. The points of interest
>>>> will be (before renames):
>>>>
>>>> MyUstTraceInput, line 85+: This is where you assign your trace events to
>>>> states
>>>> ConnectionsPresentationProvider, line 31-34: This is where you assign
>>>> the colors to each state in the view
>>>> and same file, lines 64-68 and 81-85 : This is where you assign the
>>>> trace's states to the ones in the view.
>>>> (one place is for the actual colored rectangle, the other is for the
>>>> tooltips, iirc).
>>>>
>>>>
>>>> If you have any question or problem, please let me know!
>>>>
>>>> Good luck ;)
>>>>
>>>
>>
>>
>> _______________________________________________
>> lttng-dev mailing list
>> lttng-dev@lists.lttng.org
>> http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
>