I’m waiting at a train station to go back after doing 2 presentations on kanban. It’s super hot, I’m tired and it’s 2 hours to wait before my train, with AC, comes. Perfect time to write a blog post in other words. (I’m also happy, proud and healthy again after my flu - came out a bit pessimistic there for awhile).
One of the things that’s always included in my presentation is a slide that asks for feedback. “I love feedback” is my presenter notes and then I ask the people in the room to give me some.
I have experimented with a few ways to get proper and honest feedback and I wanted to share my latests experiment.
What I’ve done up to now is to ask for two different metrics.
ROTI (which in Indonesian means bread… I’ll come back to that). Return On Time Invested. Did the attendees think that they spent their time wisely? I do a scale from 1 to 6 (so that Swedes cannot be in the middle) and define 1 as “Worst time in my life” and 6 as “If could have been in heaven I’d rather go back here and here this presentation again - because life cannot get better than this” to get the spread distributed. I ask the attendees to put a X where they think the value should be.
The next thing I ask people to do is to write something good, on one sticky, and something that was bad (on another sticky) and post next to the ROTI-diagram on the way out.
Why it “fails”
I’ve been using this approach for a couple of years and it gives me feedback. But I’m not really happy with the feedback I get.
- ROTI suffers from wisdom-of-the-crowd-syndrome, in that if the first X is around 5, most everyone is around 5. That’s ok, but maybe not true. It’s easier to just put it down close to the other ones not to make me too sad.
- People have a much easier time to write about “What was good” it seems and forces out the “What is bad”-part. Also I’m noticing a lot of copying or at least very equally worded suggestions.
The really good approach here would be to ask people on beforehand what they want to get out of the presentation, but I’ve noticed that many attendees are there to be info-tained not to participate up front. I do that for training and longer workshop since I then can tweak the program a bit.
Today I tried to use other words to get another result. It worked kinda good.
Instead of saying “What was good, what was bad” I draw two columns:
- One column called Happy - “Put stickies here with thing that will make me happy”, I say.
- One column Better - “Put stickies here with things that will make me better”
I got more feedback this way. Almost everyone brought me something good and something bad. In the normal way I got many “Nothing to complain about”-stickies in the “Bad”-column.
Also it’s nice to don’t have Good vs Bad but rather Happy and Better. That feels nicer to me.
For the ROTI I turned their attention towards the company or groups I’ve visited instead. I might say something like
We've been 25 people in this room for 1,5 h. That totals to ca 40 man-hours. Do you think those hours was spent wisely here? Did this presentation bring *R*eturn *O*n the *T*ime *I*nvested?
This led a little better spread I think and we saw a brave low point under average. A little bit more sincere.
One day, when I’m really brave I will use the ROTI to, a little bit more literal, mean Bread. What if I told the company my going rate per presentation hour? What if that was a bit lower than I usually take for my presentations?
In Sweden I do 2 h presentations for 3 - 7 000 SEK ($375 - $875), depending on the audience and event. That’s a bit too low really but let’s use that as an example.
Let’s say that I offer a $200 / hour as base rate. As an incentive for me I get that multiplied by the ROTI-score I get:
$200 * ROTI of 3 = $800, if I’m awesome and everyone thinks the time was well invested
$200 * 5.5 ROTI = $1100.
Or I can take my average score and say: “My average is 4.5 and my average rate is $625. If I get above my average we double the fee, below it’s half price”.
Something like that would be cool. If I dared. But I don’t, I think.