What do we want? Higher adoption! When do we want it? NOW!
ANALYZE THE IMPACT OF EVENTS ON ACTUAL TOOL USAGE OF A TARGETED AUDIENCE
KEEP USERS IN SIGHT AND IN MIND
Have you ever given a talk, looked out at the audience and wondered how many are listening? It can be infuriating to put lots of effort into communicating information without ever really knowing if anyone listened. With Campaigns, you can easily see who paid attention and who needs another prod!
Campaigns enable you to target specific users regarding particular Tools and then track their adoption following your logged actions, or Events. In this way, you can easily see the fruits of your labors as well as making sure you reach your targets. By analyzing the impact of different types of communication with the target group, whether it’s a proactive in-application message or a training session, you can easily see what works to more effectively impact adoption in future Campaigns.
A Campaign can be created from the Tool Adoption Report, or from scratch.
Follow the steps below to access My Campaigns:
1. Open up the EesySoft web application and log into the relevant environment.
2. Click on the My Campaigns section, OR access it directly through the orange menu panel on the left of the screen.
3. An Overview of your Campaigns will open listing all existing Campaigns, as well as the ability to create a new Campaign from scratch.
You can sort the list by clicking on the diamond next to each column heading. Click once for ascending, click again for descending. You can also delete Campaigns from this list by clicking on the X on the far right.
Click on a Campaign to open, edit and view its results.
The Campaign can be broken down into 3 sections:
The General Properties outline the targeted audience, specified Tools, and purpose of the Campaign.
The Tool Adoption section presents usage data in groupings of Monitors according to the targeted Tool Group and presented in a number of ways dependent on the Selection Options. You can drilldown on each Tool Group to see the results of its Sub Segments. When a Sub Segment is selected, the graph will update to present that Sub Segment’s data. Hover over a plotted point on the graph to see the actual figure represented. Remove items from the graph by clicking on the relevant item in the graph’s legend. Click once to remove the data from view, click again to return the data to the graph.
The Event Overview lists actions you have taken related to this Campaign. You can add as many Events as you like. Click on an Event to see it presented on the graph above as a vertical dotted line.
AND NOW FOR THE MATHS…
When a Campaign is created, the users and Tools to be targeted must be identified. As a Campaign is related to a specific period of time, the users targeted will not change. Therefore, a count of the users targeted in this Campaign is provided in the Campaign’s General Properties and a list of their related user information can be downloaded from here.
The Tools to be targeted by the Campaign are selected from a Reporting Template. The Segment(s) selected determine the structure of the results in the Tool Adoption section of the Campaign.
Tool Adoption section
The calculations presented in the Tool Adoption section are worked individually. This means that the results you see in the Sub Segments of a Tool Group will not add up to the calculation presented for the Tool Group.
These results are calculated using this formula:
The Tool Adoption results can be presented in a number of ways determined by the Selection Options that are set.
When Events are logged, they are done so with a date. When selected, an Event’s date will appear on the graph in the Tool Adoption section as a vertical dotted line, allowing you to immediately see the change in adoption before and after the Event took place.
NEW CAUSE? CREATE A NEW CAMPAIGN!
You can create a new Campaign from scratch from My Campaigns, but sometimes it’s easier to identify your mark in the Tool Adoption Report, so you can also create a Campaign directly from any level of the Tool Adoption Breakdown.
When you create a Campaign from the Tool Adoption Report, certain fields are populated for you dependant on the settings in your report.
Follow the steps below to create a new Campaign:
1. Use the dropdown next to a Tool Group in the Tool Adoption Report to select a Campaign on Active or Inactive users, OR click on the Add Campaign button in My Campaigns.
2. A Popup will appear prompting you to enter a Name and Intention for the Campaign.
The Name enables the Campaign to be found in the Assigned to section of the Help Item Overview. With this, you can create proactive messages specifically for the users in this Campaign.
3. You will then be prompted to enter specifics about who and what is to be targeted in the Campaign.
If you have created your Campaign through the Tool Adoption Report, these fields will be filled in for you but you can make changes and additions if you want. Use the dropdown or start typing to find the entries you want. Click on the x to the left of an entry to remove it.
Select a Segment of a Reporting Template to capture the Monitors relating to the Tools you wish to analyze.
Select a Role Category, Role, User Group, Filter, User ID or combination of these to determine the users you wish to target. To find out more about User Groups and Roles, go to User Groups, Roles and everything in-between.
From the Tool Adoption Report, the Impact Points are automatically populated with the Reporting Template Tool Group from which the Campaign was created. The Target audience is automatically populated from the Role Category, Role, Start and End dates for which the report was run.
4. Now, simply click on Launch and your new Campaign will save and open.
The Campaign can now be found and edited through My Campaigns.
All 3 sections of the Campaign can be updated so you can tailor your Campaign to suit your needs:
- General Properties can be updated to change targeted users and Tools
- The Tool Adoption section can be manipulated to analyze your Campaign’s results
- The Event Overview can be used to log actions related to your Campaign and view their impact on the Tool Adoption graph
I’LL ADD YOU TO THE LIST
Forgotten to add a User Group? Or are you interested in more Tools? You can update the general details of your Campaign by clicking on the Edit Properties button in the Campaign Details section.
Just to let you know, we don’t recommend doing this in the middle of a Campaign as it may skew your results.
WHAT OPTIONS DO I HAVE?
Now that your Campaign is up and running, you can play around with the data to analyze further what your targeted users are playing at by using the Selection Options to manipulate the data presented in the Tool Adoption section. They are:
- Start Date & End Date
- Graph Type
START DATE & END DATE
The reports automatically run for the last 3 months. However, the date parameters can be extended or shortened using the calendar icon next to the Start Date and End Date fields.
The report will return data from 12am on the Start Date until 12am on the End Date. This means the report will not contain results for the date entered in the End Date field. To view live results, enter tomorrow’s date in the End Date field.
The scale of the x-axis will change depending on the number of days on which you want to report:
- A period of 8-30 days shows results on a daily basis.
- 31 days – 8 months shows weekly results based on week numbers.
- 8 months – 2 years, 7 months shows monthly results.
- Over 2 years and 7 months and you get yearly results.
There are 3 options here which define how the calculation result is presented:
- Fixed %
- Scaled %
- Actual Numbers
Let’s see what they do.
This is the default Presentation Option for the report. The Fixed % option shows the calculation as a percentage of the total active users for the selected time period, rounded to two decimal points.
This Presentation Option only has an effect on the presentation of the graph. The data shown is the same as in the Fixed % view (see above). This Presentation Option will zoom into the graph, taking your usage peaks into consideration. Therefore, it is great for tools with low usage.
My preferred Presentation Option, this provides the data as the actual number of users rather than as a percentage. With this option, it’s easy to see just how many users we’re talking about. With Actual Numbers, we get a precise value for our level of adoption in each Tool Group and Sub Segment. In the graph, the y-axis will adjust to cover the maximum number of unique users active in a particular week (or x-axis segment).
This option can be set as follows:
This Graph Type show the number of unique users who trigger the Tool during each x-axis time unit, or week.
This Graph Type gives you an idea of how many users in total have used the Tool over time. If a new unique user triggers the Tool, the line will rise. If a user who has already triggered the Tool does so again, the line will not.
To see an example of interpreting data using the Trend Line and Cumulative options, please go to The Tool Adoption Report Presentation section.
It’s often difficult to keep track of communications, training sessions and so-on. It’s nigh-on impossible to see what impact these actions had on the subject in question. But with Events, not only can you keep track of what you did when, but also see quickly and easily just how each event impacted on the adoption of your targeted Tool.
Once an event is recorded, you can hover over it to see a dotted red line appear on the graph of the Tool Adoption section above. Click on an event and the dotted line turns black and permanent on the graph. Click the event again and the permanent black line will be removed.
JOIN THE PARTY
Events help you keep track of each time you have done something for this Campaign. By logging what you did and when, you can quickly see how much impact each action had and identify actions that have a higher impact than others. An Event doesn’t have to be a big thing like a training course, it can also be a proactive message, an addition to the Support Center, even just a cut-off date for internal reporting. To create an Event, simply click on the Add Event button in the Event Overview.
You will be prompted to enter a Title, Information and Start date for your Event.
Although the main benefit of Events is their application to the Tool Adoption graph, much more insight can be gained by including some detail as to the type of Event recorded. In this spirit, we would recommend you enter some key details to help trigger your memory or for comparison to other Events at a later date.
LIGHTS, CAMERA, ACTION!
There are many ways this information can help you out. Here are just a few ideas:
GRADE INSTRUCTORS ON GRADING
Rubrics is one of those Tools that seems, for many Institutions, to be an opportunity greatly overlooked. So we thought we would have a go at giving it the awareness it deserves.
We created a Campaign from the Tool Adoption Report, which we ran with the Reporting Template of Instructor Detailed.
Using the dropdown selection next to the Rubrics Segment of the Tool Adoption Breakdown, we chose to target those instructors who had not triggered a Monitor connected to Rubrics during the time period for which we ran the report.
With a captive audience now set up, we started promoting.
Whenever we did anything related to promoting Rubrics, we added it as an Event in the Campaign.
When we created proactive messages, we applied this Campaign to the Assigned to field of the Help Item to make sure all the people in this Campaign got it.
A LESSON IN EVENT PLANNING
Now that we have performed a few activities to raise awareness around Rubrics, we can use the Campaign to measure the effectiveness of each one.
Updating the Tool Adoption section to display results for the period over which we promoted the Tool, we clicked on the first Event we recorded – a proactive message. This gives us a black dotted line showing how amazingly well-received this message was.
Hovering over the next Event, the On-site training session, we can see another rise in adoption.
We can add as many Event markers as we like to the graph to easily see what worked and what didn’t. From the results here, we can see that a proactive message is one of the most powerful tools in our arsenal, providing high impact with low effort. We will definitely do this again!
TYING UP LOOSE ENDS
We have certainly succeeded in raising awareness of Rubrics, but how is it now being used? Are there areas which users still aren’t accessing? Perhaps additional information is needed on specific aspects of the functionality or perhaps we just want to make sure that when we see a rise in adoption, it is the right kind of adoption.
By clicking on Rubrics in the Tool Adoption Breakdown, the graph has updated to provide results for the Sub Segments of Rubrics. We can now see exactly what aspects of Rubrics are being utilized and pick up any that need further promotion.
With the On-site training Event marker applied, we can see that users are creating and managing Rubrics but didn’t seem to take the leap to actually using them.
In general it appears that over a longer term, adding a Rubric to Assignments is still lagging behind. Perhaps we could use the Champions Report to identify some Faculty members to remind their peers about this.