facebookpixel

Performance Monitoring in Real Time

analytics

Performance Monitoring in Real Time

Real-time analytics allow businesses to quickly detect and address issues as they arise. It empowers your IT and network teams with faster decision-making capabilities and affords your business greater operational agility. In this article, we’ll show you how to monitor key performance metrics of your live events in real time using our advanced analytics platforms, Kollective IQ and Kollective Free Analytics .

This is our second article in a series of posts on real-time analytics. If you haven’t read the first article, explore How Real-Time Analytics Benefit Your Communications Strategy here .

Monitor Stream Quality in Real Time

Kollective IQ and Kollective Free Analytics provide several ways to track the stream quality of your event in real time. In the analytics dashboards, stream quality is represented by QoE (Quality of Experience). Start with the “Reach by QoE” tile in the views and experience dashboard. The donut chart displays the percentage of viewers experiencing each level of QoE, from excellent to bad.

Reach by QoE

In the example above, we notice that 1.35% of our audience has experienced bad streaming quality at some point in this event. Rather than waiting for our event to end, we can explore this data while our event is still in progress. Simply click on the section of the Reach by QoE chart you want to examine to bring up detailed statistics broken down by user. Clicking on the “bad” section of the chart reveals new data fields to help you diagnose potential issues (see below).

Reach by QoE analytics

While there are many columns in this report, highlighted are five of the most useful:

  1. Locality – The viewer’s country
  2. External IP – The viewer’s external IP address
  3. Number of Buffering Events – The number of separate buffering instances the viewer experienced
  4. Total Buffering Time – The amount of time spent buffering during playback
  5. Total Playback Time – The amount of playback time without buffering

Reviewing the detailed statistics on “bad” QoE scores reveals a series of users experiencing varying degrees of buffering. Some users are experiencing lengthy buffering delays, while it appears others abandoned the stream early perhaps in response to buffering problems. Looking at the most severe cases, we notice that most of these users are located in Canada and share the same external IP address (note: IP addresses have been obscured for privacy purposes).

In a few quick steps, we’ve determined that employees at a Canadian office are having buffering problems. Armed with this information, we can contact IT at this office to resolve the issue while our event is still running. We can also send the event as video on demand (VOD) to all employees at that location as soon as the event ends to ensure essential messaging isn’t missed.

Identify Buffering by Location in Real Time

The delivery and consumption dashboard in Kollective IQ and Kollective Free Analytics provides another method for monitoring stream quality in real time. In the previous example, you learned how to analyze groups of viewers that experienced the same QoE and identify potential geographic trends. In this example, we’ll start with geography and show how to quickly and easily detect issues.

Before diving into the example, let’s review the delivery and consumption dashboard. The primary areas of concern for this dashboard are the delivery map on the left and the four bar graphs on the right. The map contains a series of circles that represent event viewership for a given location (larger circles equal areas of greater viewership). The bar graphs list the top ten areas of viewership broken down by: external IP, locality, country, and city. Each field on the bar graphs has a corresponding QoE dot that represents the average streaming quality for that location.

Delivery Map Free Analytics for Microsoft Teams

Starting with a high-level overview, we see that all countries listed in the top ten have good QoE scores except China. Notice in the Views by City graph that the Shanghai office is performing poorly. Click on the Shanghai bar graph to explore this data or zoom into the delivery map to select the Shanghai office, excluding any nearby remote viewers.

Delivery Map City Example - Free Analytics

Since these graphs provide a quick QoE reference for the ten locations with the highest event viewership, it’s often the fastest way to detect buffering and stream quality issues for events in which ten or less offices are participating. However, with events streaming to more than ten locations it’s best to use this dashboard in conjunction with the “Reach by QoE” tile discussed in the first example of this article.

Track Microsoft 365 Video Performance in Real Time

Are you using Microsoft Teams or Stream to deliver live and on-demand video? Gain real-time insights into event performance and employee behaviors with Kollective Free Analytics today.

The post Performance Monitoring in Real Time appeared first on Kollective Technology .

To view our Partner blog, click here

Microsoft Teams Live Events vs. Teams for Webinar vs. Teams Meetings with Overflow: Which is Best for Internal Comms?

CMMA Blog

Microsoft Teams Live Events vs. Teams for Webinar vs. Teams Meetings with Overflow: Which is Best for Internal Comms?

Today’s solutions for corporate communications are more robust than ever and Microsoft remains a top player by continuously innovating the Microsoft Teams video platform . New product features are amazing but can often confuse the end user. Do you know when to use a Teams Live Event vs. Teams Meeting with Overflow vs. Teams Webinar? The Enterprise Video Strategy (EVS) team at Kollective will help you navigate the best solution for your particular use case.

Microsoft Teams Live Events

Teams Live Events are an extension of Teams meetings that allows users to deliver video and other content to large audiences. It’s Microsoft’s primary one-to-many communication tool and is ideal for events where the host needs complete control of the content being presented – like a CEO Town Hall or All Hands Meeting.

In a Teams Live Event, presenters and producers handle sharing audio, video, or their screen with the audience and only one presenter can be active at a time. The audience can interact with presenters via moderated Q&A sessions or in Yammer. Attendees who are unable to watch the event live can view the recording after in Teams, Stream or Yammer.

Another benefit of Teams Live Events is that they fully integrate with enterprise content delivery network (ECDN) technology. An ECDN enables organizations to scale high-quality live and on-demand video behind the corporate firewall by optimizing bandwidth consumption. This is especially important for enterprises and small and medium businesses (SMB) with offices challenged by network capacity, remote locations and/or bandwidth limitations.

What are the Pros and Cons of Microsoft Teams Live Events?

Pros

  • Host up to 20,000 attendees through December 31, 2021
  • High production value
  • Equal access of features
  • Full ECDN functionality

Cons

  • Limited interactivity
  • Takes some training to understand how to use

When to Use Microsoft Teams Live Events

Teams Live Events remain the gold standard for large-scale, one-to-many communications. Choose to host a Live Event for meetings where audience interactivity is not necessary and executive polish is required.

Microsoft Teams Meetings with Overflow

While typical Teams meetings allow you to host up to 250 participants, Teams Meetings with Overflow expands that, now enabling up to 10,000 attendees to join your meeting. The first 1,000 users that join get to enjoy the same Teams Meeting experience they know and expect: they can share their own audio and video, view shared content, and interact in chat. Attendees that join after the 1,000-user capacity is met enter in view-only mode with reduced interactive capabilities.

View-only attendees cannot take part in chat or view PowerPoint Live files, or files shared using individual application shares. They are also not included in the event analytics, making it difficult to gain full insight into meeting performance.

The only way to know more about your Overflow attendees and their quality of experience is by deploying an ECDN. When used during a Teams Meeting with Overflow, an ECDN scales content and collects analytics for all view-only users.

What are the Pros and Cons of Microsoft Teams Meetings with Overflow?

Pros

  • Higher attendance capacity than a standard Teams Meeting
  • Collaborative environment
  • Easiest set up of Teams video solutions

Cons

  • No analytics collected on overflow attendees without Kollective ECDN
  • ECDN only scales Overflow viewers
  • Technical limitations

When to Use Microsoft Teams Meetings with Overflow

Microsoft Teams Meetings with Overflow should only be used when you require the same level of interactivity as a standard Teams meeting with over 250 users. If your network does not have the capacity to scale live video to 1,000 employees, opt for a Teams Live Event instead.

Microsoft Teams Webinar

Micrsoft recently released its new Webinar tool for Microsoft Teams . Designed to compete with top virtual event platforms, Teams Webinar offers many of the same benefits, including event registration pages, breakout room configurability and a dashboard that displays attendance data relative to registration details.

Teams Webinar does support ECDN functionality, scaling video for viewers behind the corporate firewall. An ECDN also supplies advanced analytics for all attendees, so you know who, what, where and when your Webinar was consumed.

What are the Pros and Cons of Microsoft Teams for Webinars?

Pros

  • Host up to 1,000 attendees
  • Registration page integration
  • Disable/enable cameras and microphones (globally or individually)
  • Configuration of breakout rooms before the meeting
  • Breakout room timers, room retention, and attendee reassignment
  • Dashboard displays registration and attendance data

Cons

  • Focused on external customer engagement, not internal use

When to Use Microsoft Teams for Webinars

Microsoft Teams for Webinars is best for meetings where you want a high-level of interactivity and tracking for up to 1,000 attendees. While Webinars can be used internally, it is especially useful for external communications and marketing activities.

Choose the Right Tool for the Task

To determine which option in the Microsoft Teams ecosystem is right for you, consider the purpose of your event and how you want your attendees to engage. For events where a high-level of interactivity is needed, consider Webinars or Teams Meetings with Overflow. However, for one-to-many communications and large-scale internal broadcasts, Teams Live Events will serve you best.

Learn more about Microsoft Teams video solutions and virtual event best practices from our team of experts. Sign up for a FREE one-hour consultation with Kollective’s Enterprise Video Strategy team. We will review your requirements, help you navigate the platform and help you choose the right Microsoft Teams video solution.

The post Microsoft Teams Live Events vs. Teams for Webinar vs. Teams Meetings with Overflow: Which is Best for Internal Comms? appeared first on Kollective Technology .

To view our Partner blog, click here

Webinar Recap: What Great Analytics Reveal About Microsoft Teams Live Events

analytics

Microsoft Teams Live Events have become an indispensable tool for enterprise communications. From high production events like company-wide town halls to crisis communications requiring quick turnarounds, Teams Live Events can engage and connect distributed workforces. To ensure these communications are successful, Live Event reporting is crucial.

In a recent webinar, What Great Analytics Reveal About Microsoft Teams Live Events , Garrett Gladden, Director of Product Management at Kollective, outlined the importance of understanding Live Event reporting data, identifying key performance indicators (KPIs) for Live Events and how adding an advanced analytics platform provides those insights where and when you need them.

Let’s Talk Teams

Teams Live Events are an extension of Teams Meetings meant for one-to-many communications. With Live Events you can broadcast to up to 100,000 attendees no matter their location or device.

Garrett was joined by Raphael Barini, Microsoft Modern Workplace Technical Architect at the time of the recording, who ran a quick demo on creating and running a Teams Live Event.  In the demo he covered:

  • How to set-up a Live Event in Teams
  • A breakdown of the different options you have when creating your event
  • Best practices for inviting attendees
  • Starting and managing the event as a Producer

The ease and simplicity of Teams Live Events allows anyone in the organization to set-up an event to relay important messages efficiently and at scale.

Data Needs Meaning

Teams Live Events produce a large amount of data. To be of any value in running a successful event, that data needs meaning. Finding that meaning, Garrett explained, requires two things – recency and relevance. Recency requires accessing the data when you need it which, to be actionable, is during the event. To achieve relevance, that data needs to be surfaced where you need it, in a centralized and easy to use dashboard.

Meaningful (and Easy) KPIs

Teams Live Events provide Attendee Engagement reports you can download after the event but does not provide actionable data in a usable format while the event is in process. To access this data as well as additional insights into video performance and employee engagement in real-time Garrett recommended using an advanced analytics platform like Kollective IQ .

Using a Southeast Asia business strategy planning event as an example, Garrett detailed the metrics you can access from a Teams Live Event with Kollective IQ. The event was held during COVID-19 lockdowns with the majority of attendees joining the event from home. The high-level analytics pictured in the dashboard below show that the event was a success.

Teams Live Events metrics with Kollective IQ analytics

Quality of Experience (QoE) Score shows what the experience was for everybody receiving the event content. The score is a combination of two metrics – the bitrate or quality of the video they received and the time to first frame or how long they waited for the video to arrive.
Average View Duration measures whether viewers stayed for the duration of the broadcast or dropped off letting you know how much of the content was consumed.
Reach indicates the attendance rate for the event and is measured by unique viewers.
Bandwidth Savings is the amount of bandwidth saved by using Kollective’s Enterprise Content Delivery Network (ECDN) to deliver the live event.
Peering Efficiency is another indicator of the ECDN’s performance and in this example shows that high concentration regions were able to share content at the edge, pulling the Live Event from a peer rather than the network.
Geo Explorer shows where the content was consumed.

This data quickly answers the questions:

  • Did attendees have the experience that we wanted?
  • Did people watch for the duration showing that we effectively communicated with them?
  • Did we reach the number of people that we targeted?
  • Did we reduce strain on our network?
  • Did Kollective’s peering do the heavy lifting instead of our network?
  • Where and by whom was the content consumed?

For a deeper understanding of the data or specific users, Kollective IQ allows you to drill down into and explore each of these metrics.

Teams + Kollective IQ

Microsoft Teams lets you produce and distribute live events to your entire workforce no matter their location or device. Adding an advanced analytics platform to the mix lets you visualize your attendee experience and network performance and make real-time adjustments.

Kollective IQ offers you:

  • Persona-based workflows with stellar UX
  • Delivery of ALL data to clients, with data mining, exploration, and custom
  • calculations
  • Custom visualizations and dashboards
  • Data exportability with many formats to many destinations

Test out Kollective IQ’s valuable and actionable insights for Teams Live Events today.

The post Webinar Recap: What Great Analytics Reveal About Microsoft Teams Live Events appeared first on Kollective Technology .

To view our Partner blog, click here

Microsoft 365 Video Streaming Updates: What We Know Today

CMMA Blog

With a mission to “to empower every person and every organization on the planet to achieve more,” Microsoft is constantly updating their products and adding new features to make this empowerment a reality. And while these updates benefit the end user, it often causes a bit of confusion about what it means, who it is available to, when, how and more. After a few conversations with the Microsoft Teams and Stream product teams, we took a crack at answering the questions our customers might have when it comes to the Microsoft Teams Video Streaming updates.

What we know today

Microsoft Teams Live Events – Still the Gold Standard

Today, if our customers and prospects are looking to run a live event, or even a large one-to-many video-based meeting, a Teams Live Event is the best choice. Whether they are running it with a webcam and PowerPoint, or using an external encoder, this provides them with both the tools and the enterprise content delivery network (ECDN) integration to successfully deliver and scale their event. All workflows will remain the same, ensuring you still can take advantage of the delivery mechanism you know and trust.

Microsoft Teams Meetings with Overflow

Microsoft Teams has expanded its view-only meeting experience to 20,000 people. That means organizations with Office 365 E3/A3 and E5/A5 plans can host up to 300 interactive meeting attendees before the experience becomes view-only for new joiners. Interactive attendees enjoy all the same functionalities of a normal Teams Meeting, while overflow attendees can comment in chat, but do not have voice capabilities. At current, Teams Meetings with Overflow does not support ECDN capabilities, so Kollective’s recommendation here is that if scaling within your network or bandwidth is a concern, a Teams Live Event is still the right option for video events of this size. The good news is that Kollective will scale Teams Meetings with Overflow with the upcoming release of the Microsoft OnePlayer (see below).

Upcoming Changes

The Microsoft OnePlayer

Microsoft will be replacing Azure Media Player (AMP) with the new OnePlayer in the Teams and Stream client and web apps. OnePlayer’s advanced technology will further improve video playback and enable smarter integrations with ECDN applications. Anywhere you see video will take advantage of this new architecture and can be loaded the Kollective software development kit (SDK). When this is released, Teams Meetings with Overflow will be delivered for all attendees over the overflow threshold. In addition, the new player will load Kollective inside of the Teams Mobile App, giving as a larger footprint and allowing additional scale for our customers.

Microsoft Webinar

When it is released, Webinar will offer organizations another option to stream live video to view-only attendees. Like Teams Meetings with Overflow, these users can ask questions in chat but do not have voice or screenshare capabilities. Another Microsoft product leveraging OnePlayer, ECDN partners will deliver video to attendees at scale.

Microsoft Stream 2.0

Microsoft is breaking down the Stream silo and integrating it into the OneDrive/SharePoint ecosystem. Once rolled out, users can embed, manage and send a Stream video the same way you would any other file using the same M365 permissions. Although Stream will remain its own product with dedicated video interface, all recorded meetings will be stored in OneDrive and can be accessed by all participants. ECDN functionality stays the same.

The post Microsoft 365 Video Streaming Updates: What We Know Today appeared first on Kollective Technology .

To view our Partner blog, click here

How Comms and IT Can Work Together to Streamline High-Quality Video Distribution

Best Practices

Leading a Communications team at an enterprise organization means you work cross-functionally with multiple departments, including the IT team. Although your goals may be different, when it comes to corporate communications, you share a common objective: Achieving a high-quality meeting experience for all employees on your network and ensuring delivery of a clear and concise message to your organization. In order to meet those goals, Kollective Technology recommends that both teams work together to make a few important decisions when it comes to your tech stack.  

Using the Right Tools 

With so many innovative workplace communication tools to choose from, it can get overwhelming if you don’t know exactly what you’re looking for. From applications like Microsoft Teams, built for seamless collaboration and communication, to your basic email or instant messaging program, there’s quite a long list to choose from.  

Sometimes these tools can be more of a burden than a benefit, especially if they’re not streamlined. Your team may primarily communicate big updates with your organization via email platform A, but when it’s time for a company-wide all hands meeting, your team prefers to run communications on Platform B because it has a live video function. When you use multiple communication platforms, it’s easy for employees to miss messages and get frustrated. More than half of workers say they feel overwhelmed by having to use multiple communication platforms , which is something that can be easily avoided.  

Selecting a single tool like Microsoft Teams allows for inter-department collaboration. With a single tool, you can deliver your message in a high-quality format and meet the needs of both the Communications and IT teams. After you’ve done your research, get in touch with your organization’s lead network architect and work together to select the video communications tool that meets your organization’s needs.  

Setting Expectations 

Not all departments “speak the same language” but if you want your company-wide communication to be successful, you’re going to have to find a way to effectively work with your friends in IT. One way to do so is by setting expectations up front. 

Examine what kind of user experience (UX) you want for your employees. UX is critical to the success of video communications because it asks things like:  

  1. Was the viewer able to watch event with limited interruptions? 
  2. How was the video and audio quality of the meeting? 
  3. Did the viewer understand the message that was being communicated?  

When both your Communications and IT teams have to report back to executive sponsors on the success of the event, UX is something you’ll need to include. But level setting UX expectations can be tricky, which is why Kollective has a formula that will help cross-functional teams work together to manage executives’ expectations. Kollective takes variables like time zones, survey response rate, job title, family, and attendance history into consideration when calculating expectations.  

It’s important for the Communications and IT teams to collaborate on expectations for live video events, setting clear roles and responsibilities ensures the best live video event experience for your employees. After you’ve set expectations and executed your first event, it’s time to dive into analytics .  

Diving into Analytics 

Analytics are critical to successful enterprise video strategy because they identify both wins and opportunities for improvement. To get the most detailed look into live event performance, you want a tool that gives you real-time analytics. These are the metrics that will provide the greatest insight: 

  • REACH SCORE: Sum of the number of reported users who viewed the content and the number of anonymous viewing sessions. Reach score provides insight into the total number of unique individuals reached by a live event.  
  • AVERAGE VIEW DURATION: The average amount of time a viewer was reported to have watched the event. Average view duration helps gauge company engagement when compared to baseline metrics.  
  • QUALITY OF EXPERIENCE (QOE) SCORE: Time spent displaying video relative to the total time spent both displaying video and buffering. It quantifies the quality of a live event giving insight into buffering and network bottlenecks.  
  • PEERING EFFECIENCY: Normalized percentage of bytes delivered via peering measures how efficiently network-connected devices transmit live video. 
  • BANDWIDTH SAVINGS: Percentage of bytes delivered via peering highlights ECDN effectiveness and network capacity.  
  • GEOGRAPHIC CONSUMPTION: Country-specific video deliveries displayed as a percent of total deliveries for all content on a scale of 0% to 100%. This figure gives global enterprises the opportunity to see how messaging is received globally.  

For your Communications Team, analytics like reach score, geographic consumption and average view duration are most helpful when breaking down what content employees engaged with and how engaged they were based on location. For the IT team, learnings from QOE score, peering efficiency and bandwidth savings will help quantify how well the meeting tech worked and give insight on what improvements need to be made for next time.   

Set Your Enterprise Video Strategy 

Now that you’ve picked a platform, outlined expectations, and know which analytics are important, you’re ready to finetune your enterprise video strategy. Kollective offers organizations with 1,000+ employees a free one-hour virtual workshop with one of our Event Services Consultants. During this session, you’ll learn: 

  • Live event best practices to ensure success 
  • Advice and links to helpful live event resources 
  • And, if you are a Microsoft O365 customer, a copy of the Kollective Live Event Playbook for Microsoft Teams Live Event 

Streamlining your workplace communication tools and working with your IT team is imperative for curbing burnout and running an efficient business. Let Kollective show you how your Communications and IT teams can strategize and work together to deliver successful, high-quality live events today.  

The post How Comms and IT Can Work Together to Streamline High-Quality Video Distribution appeared first on Kollective Technology .

To view our Partner blog, click here

Pick the Right Bitrate for Your Next Live Video Event

bitrate

If you’ve spent any amount of time watching or participating in a live event over the last year, chances are you’ve noticed a difference in the level of engagement between events with clear video and perfect audio, and events where you can only hear every fifth word of what the presenter is saying.   

While it’s true that top-notch streaming equipment and high-speed Internet can lead to the perfect lag-free Live Event, there’s another factor that could be contributing to the quality of your steam — bitrate. 

WHAT IS BITRATE?  

To keep it simple, bitrate is the quality of the video or audio being streamed during your Live Event. It’s measured in kilobits per second (kbps), which means we’re looking at how many ‘bits’ of data you’re sending, and at what ‘rate’ (speed) they’re being sent. 

Higher bitrates typically use up more Internet bandwidth, so it makes sense that using a higher bitrate can improve video quality. However, selecting the highest bitrate without considering other factors like expected quality and video complexity is not the most efficient plan for your Live Event. Plus, if your network’s bandwidth is insufficient, most video streaming platforms will prioritize audio quality over video quality.  

SO, WHICH BITRATE IS RIGHT FOR MY LIVE EVENT?  

There are many factors that can impact your choice of bitrate. In addition to meeting the requirement dictated by whichever codec (software programs that encode or decode a video stream into a different type of stream) you’ve chosen, your decision will revolve around your organization’s preferred quality for your Live Event – the higher the bitrate, the better quality your Live Event will be. But the actual bandwidth consumption for every Live Event will vary based on video layout, video resolution, video frames per second, and whether you’re utilizing an Enterprise Content Delivery Network (ECDN), like Kollective . When more bandwidth is available, quality and usage will increase to deliver the best experience. 

Assess your organization’s quality expectation for your Live Event. This boils down to how advanced the culture of video is within your organization and will depend on how expectations around video have been set previously. Over the last 12 months with the rise of remote work and increased video communications, most organizations probably have a more robust video strategy, so their employees expect Netflix and Hulu-quality Live Event experiences. In order to hold a high-quality Live Event, you have to choose a high enough bitrate to support the video complexity and motion content of the source you’re pushing to viewers. 

Here’s a breakdown of Kollective’s recommended bitrate based on desired resolution and frame rate:

Screen Shot 2021 03 11 at 10.56.13 AM 300x156 1


WHAT CONTRIBUTES TO LIVE EVENT QUALITY? 

Live Event quality takes both resolution and frame rate into consideration. Resolution is how many horizontal lines a frame of video has from top to bottom. The more lines of video, the “clearer” the picture is. Frame rate is the number of frames in one second of video. The more frames per second (fps), the smoother the video’s motion.  

When you’re selecting the proper frame rate and resolution for your Live Event, think about the content and purpose of the event, specifically related to motion and video complexity. The more motion your video has, the higher frame rate you want. For example, if you watch a basketball game at 10 frames per second, it will look like a cartoon flip book or strobe light. If you have a group of very animated presenters, it’s nice to have a decent frame rate to keep up with their motion, usually around 30 fps or higher.  

Video complexity refers to the level of detail in the video, so if you have multiple speakers in different panels during your event, of if you’re showing a slide presentation with small font or moving pieces, your Live Event is going to require a higher degree of complexity in order to meet your organization’s quality expectation.  

START STREAMING 

Once you’ve selected your bitrate, you’re good to start streaming your Live Video Event. Just remember that choosing the right bitrate can be a bit of a trial-and-error process and can change with each Live Event your organization presents depending on your ECDN capabilities, quality expectation and video complexity.  

If you’d like to learn how an ECDN helps improve the quality of your internal communications, read our Browser-Based Peering Solution Brief.

The post Pick the Right Bitrate for Your Next Live Video Event appeared first on Kollective Technology .

To view our Partner blog, click here