Voice Biomarkers

overview voice biomarkers is in limited beta—it is not available to all jubileetv users voice biomarkers (powered by canary speech), uses ai to give the primary admin and contact admins additional reference points for evaluating the tv end user's wellness here's how it works the primary admin and contact admins can turn on voice biomarkers analysis during their video calls with the tv end user during video calls, acoustic and linguistic features of the tv end user's speech are analyzed in real time at the end of video calls, scores are assigned to 5 different categories (wellness, stress, mood, energy, and detection of mild cognitive impairment) these scores are plotted on graphs so admins can visualize trends at least 45 seconds of the tv end user's speech must be recorded before a video call can be analyzed permissions user permissions primary admin yes yes contact admin yes yes contact no no tv user yes yes enabling voice biomarkers voice biomakers has a two tiered consent structure tv user consent the tv end user must enable voice biomarkers directly on the tv during this process, they are asked to accept the https //canaryspeech com/legal/privacy policy/ app user consent once enabled on the tv, both the primary admin and contact admins may also provide consent if an app user consents, voice biomarkers becomes available during their video calls with the tv end user how to enable voice biomarkers for the tv end user during initial setup when setting up jubileetv for the first time, the tv end user is prompted to enable or disable voice biomarkers as part of console setup if you've already set up jubileetv and want to enable voice biomarkers from the tv access the console settings by pressing the guide button three times and then the blue j button one time select "general " scroll down and select "voice biomarkers (powered by canary speech) " follow the instructions to enable voice biomarkers if you've already set up jubileetv and want to enable voice biomarkers through telescope if the primary admin or a contact admin has power of attorney for the tv end user, they can enable voice biomarkers through telescope open telescope on the jubileetv app type "settings" into the command field select "general " scroll down and select "voice biomarkers (powered by canary speech) " follow the instructions to enable voice biomarkers how to enable voice biomarkers for the app user select the voice biomarkers card on the home screen of the app follow the instructions to consent to the canary speech privacy policy once consent is given, voice biomarkers is enabled on video calls between the app user and the tv end user how to use voice biomarkers note both the tv end user and the app user must agree to the https //canaryspeech com/legal/privacy policy/ before this feature becomes available see above for details start a video call with the tv end user select the voice biomarkers icon (a speech bubble with 3 vertical lines) on the video call screen in the app continue the video call long enough to gather 45 seconds of the tv end user's speech when the call ends, voice biomarkers automatically analyzes the recorded speech analysis takes about 2 minutes the app user receives both a push notification and in app notification when analysis is complete to view results, go to the voice biomarkers card on the home screen tap on any data point to see detailed results for a specific call how to interpret voice biomarkers the information below is provided by canary speech to help you understand of how voice biomarkers scores are calculated and what they might mean wellness the wellness score provides an overall vocal biomarker summary and composite score related to general emotional and mental well being mental wellness refers to how you feel about yourself and your life it's about having the emotional strength to handle stress, build positive relationships, and recover from setbacks when your mental well being is good, you feel more in control, can enjoy life, and are better equipped to face challenges it's not just the absence of mental illnessbut includes the presence of positive characteristics like happiness, contentment, and resilience this composite wellness score combines insights from various vocal biomarker scores—including mood, stress, and energy—to offer a holistic view of vocal wellness indicators changes in this metric over time can reflect improving or deteriorating mental resilience while not diagnostic, the wellness score serves as an early warning system to prompt further exploration when needed the mean wellness score is 54 low wellness is indicated with scores below 48 while high wellness is indicated by scores greater than 61 these scores come from statistical analysis of voice samples collected from about 10,000 u s adults we set the score ranges based on how those samples fell across the full distribution, ensuring our thresholds reflect real world variation for example, a score of 44 would be in the “low” category indicating that compared to the distribution of the general population, the individual’s vocal indicators are lower than the scores of the general population improving your mental wellness involves a combination of lifestyle choices and coping strategies such as connecting with others, staying physically active, learning new skills, giving to others, practicing mindfulness, maintaining a healthy diet and getting enough sleep sources national library of medicine – “ https //pmc ncbi nlm nih gov/articles/pmc10911315 ” nhs – “ https //www nhs uk/mental health/self help/guides tools and activities/five steps to mental wellbeing ” stress assesses physiological stress responses through voice by detecting tension, vocal strain, and irregular speech cadence voice is a sensitive indicator of stress, often reflecting autonomic arousal through features like increased pitch, irregular rhythm, and vocal effort canary speech’s stress detection algorithm uses these vocal biomarkers to score results as "low”, “medium”, or "high" canary speech scoring low to put a canary speech “low” stress score into context, we can look at the gad 7’s “low” range (scores of 0–4), which corresponds to minimal anxiety symptoms that rarely interfere with daily life in the same way, a low stress score from canary speech indicates a stable emotional state and effective coping, suggesting the individual is generally managing stress well medium to contextualize a canary speech “medium” stress score, we can reference the gad 7’s “mild” range (scores of 5–9), which corresponds to mild anxiety symptoms such as occasional worry or restlessness similarly, a medium stress score from canary speech suggests the individual may experience periodic stress that doesn’t significantly disrupt daily activities but could benefit from simple wellness practices—like short mindfulness breaks or increased social support—to prevent escalation high a canary speech “high” stress score aligns with a gad 7 score of 10–21, encompassing both the “moderate” (10–14) and “severe” (15–21) anxiety ranges this indicates the presence of significant anxiety symptoms—such as persistent worry, tension, or physical signs like heart palpitations—that may interfere with daily functioning in clinical practice, gad 7 scores at or above 10 generally prompt consideration of professional evaluation and targeted interventions the presence of elevated stress in speech may correlate with short term emotional strain or chronic tension this screening supports in contextualizing stress related concerns and monitoring longitudinal changes regular monitoring can be a valuable tool for individuals looking to balance their stress levels, especially those in high stress occupations or those with a history of cardiovascular issues stress management techniques such as mindfulness meditation, yoga, regular physical exercise, and adequate sleep play a vital role in maintaining a healthy stress index additionally, cognitive behavioral therapy and other forms of psychological counseling can be beneficial in managing psychological stressors for individuals with consistently high stress index values, it may be advisable to consult healthcare professionals for a comprehensive assessment and tailored management plan understanding and managing stress through these methods can significantly contribute to overall health and well being recent studies identified between nearly 32% of adults in mexico suffer from clinical anxiety or chronic stress can be as high as 63% source american psychological association " https //www apa org/topics/stress/body " mayo clinic " https //www mayoclinic org/healthy lifestyle/stress management/in depth/stress/art 20046037 " anxiety and depression association of america (adaa) – https //adaa org/sites/default/files/gad 7 anxiety updated 0 pdf university of washington hiv mental health screening – https //www hiv uw\ edu/page/mental health screening/gad 7 centers for disease control and prevention (cdc) – https //www cdc gov/nchs/products/databriefs/db378 htm spitzer et al (2006) – https //jamanetwork com/journals/jamainternalmedicine/fullarticle/410326 mood analyzes vocal features to assess indicators of mood state—such as signs of depression or emotional distress—through voice patterns mood refers to your general emotional state—how you feel over a period of time unlike emotions, which are often responses to specific events, moods are more diffuse and can last for hours or even days for example, you might feel cheerful or irritable without a clear reason moods can influence your thoughts, behaviors, and how you perceive the world around you while it's normal for moods to fluctuate, persistent or extreme changes in mood may indicate an underlying mood disorder mood disorders are conditions that impact how you feel emotionally, often leading to prolonged periods of sadness, emptiness, or excessive happiness common types include depression and bipolar disorder mood states can be inferred from voice via acoustic and linguistic features like intonation, rhythm, and pitch variability canary speech evaluates these patterns using machine learning models trained on clinical datasets scores are classified into categories such as 'excellent', 'good', or ‘low’ to support awareness and potential clinical follow up canary speech scoring excellent to contextualize a canary speech “excellent” mood score, we can look at the phq 9’s “none/minimal depression” range (scores of 0–4), which indicates minimal or no depressive symptoms and a very low probability of major depressive disorder likewise, an “excellent” mood score from canary speech reflects stable positive affect, minimal anhedonia, and a high level of emotional well being good to contextualize a canary speech “good” mood score, we can reference the phq 9’s “mild depression” range (scores of 5–9), which reflects mild depressive symptoms that seldom disrupt daily life similarly, a “good” mood score from canary speech indicates generally positive emotional health with occasional low moods—suggesting the individual may benefit from light wellness practices such as brief check ins or mental health management strategies low a canary speech “low” mood score corresponds to phq 9 scores of 10–27, covering moderate (10–14), moderately severe (15–19), and severe (20–27) depression—all of which fall within the range for possible major depressive disorder such scores reflect significant depressive symptoms—like pervasive low mood, anhedonia, and functional impairment—that typically prompt clinical evaluation and intervention to improve or maintain an excellent mood, regular exercise, healthy eating, and adequate sleep are recommended along with stress management techniques like mindfulness and relaxation exercises sources estimate that nearly 20% of all adults in mexico suffer from low mood and depression nearly 75% of those with moderate to severe depression receive no treatment sources psychology today – “ https //www psychologytoday com/us/blog/hot thought/201805/what are moods ” mayo clinic – “ https //www mayoclinic org/diseases conditions/mood disorders/symptoms causes/syc 20365057 ” nih “ https //pmc ncbi nlm nih gov/articles/pmc1495268/?utm source ” standford university “patient health questionnaire (phq 9)" energy evaluates speech characteristics that reflect energy and vitality, offering a breakdown across dynamics, speed, and power energy, in the context of mental health, encompasses both physical vitality and mental alertness it's what helps you feel motivated, focused, and emotionally balanced throughout the day factors like sleep quality, nutrition, stress levels, and physical activity significantly impact your energy when these areas are out of balance, you might experience fatigue, lack of motivation, or difficulty concentrating understanding and addressing these factors can help maintain or restore your energy levels, contributing to overall mental well being canary speech’s energy score is derived from three core vocal features dynamics reflects variation in speech energy over time; low dynamics can indicate monotone or low expressiveness speech dynamics measures the intentional changes in voice pitch that occur when we speak pitch refers to the highness or lowness of our voice, and we use it to emphasize words and convey emotions a higher dynamics score indicates a greater range of pitch variation, which can make our speech more engaging the mean dynamics score is 55 low dynamics is indicated with scores below 47 while high dynamics is indicated by scores greater than 62 these scores come from statistical analysis of voice samples collected from about 10,000 u s adults we set the score ranges based on how those samples fell across the full distribution, ensuring our thresholds reflect real world variation for example, a score of 41 would be in the “low” category indicating that compared to the distribution of the general population, the individual’s vocal indicators are lower than the scores of the general population using vocal variety is essential for engaging listeners and expressing emotions while speaking however, when emotions or mental health are affected, dynamics can decrease, resulting in a more monotone and less engaging voice speed captures words per minute, with very slow or very rapid speech potentially indicating fatigue or anxiety speed measures the rate at which we speak, represented by the number of words spoken per minute alertness, fatigue, medications, and mental health can all influence the rate at which we speak, typically between 75 125 words per minute changes in mental health can be observed through changes in speech rate the mean speed score is 53 low speed is indicated with scores below 48 while high speed is indicated by scores greater than 58 these scores come from statistical analysis of voice samples collected from about 10,000 u s adults we set the score ranges based on how those samples fell across the full distribution, ensuring our thresholds reflect real world variation for example, a score of 48 would be in the “low” category indicating that compared to the distribution of the general population, the individual’s vocal indicators are lower than the scores of the general population power measures vocal strength, related to respiratory effort and vocal fold engagement power measures the amount of air from the lungs that moves through the larynx a higher value indicates more airflow and a higher perceived loudness power measures the variations in vocal energy while speaking energy range is influenced by how much effort we put into making speech sounds, so louder voices tend to have more energy than softer voices the energy of sound is measured in decibels (db), and the energy range measures the extent to which energy changes while speaking typically, this measure will fall between 5 10 db (10 db is a doubling of loudness) the mean power score is 49 low power is indicated with scores below 41 while high power is indicated by scores greater than 58 these scores come from statistical analysis of voice samples collected from about 10,000 u s adults we set the score ranges based on how those samples fell across the full distribution, ensuring our thresholds reflect real world variation for example, a score of 39 would be in the “low” category indicating that compared to the distribution of the general population, the individual’s vocal indicators are lower than the scores of the general population vocal power plays a crucial role in emphasizing words and engaging listeners while speaking however, when we are disengaged, tired, or experiencing reduced mental health, our energy range can decrease, resulting in a less engaging and less impactful voice each component is scored on a 0–100 scale and contextualized against normative population data a higher energy score may reflect emotional engagement or mental alertness the mean energy score is 53 low energy is indicated with scores below 48 while high energy is indicated by scores greater than 57 these scores come from statistical analysis of voice samples collected from about 10,000 u s adults we set the score ranges based on how those samples fell across the full distribution, ensuring our thresholds reflect real world variation for example, a score of 43 would be in the “low” category indicating that compared to the distribution of the general population, the individual’s vocal indicators are lower than the scores of the general population managing and enhancing energy levels involves a combination of lifestyle adjustments and, when necessary, medical interventions lifestyle adjustments include regular physical activity, balanced nutrition, hydration, sleep hygiene, and stress management medical evaluation might be advisable to address persistent fatigue such as anemia, thyroid disorders or mental health conditions like depression sources university of alabama – “ https //www uab edu/news/health medicine/tired of being tired simple tips that can improve your physical and mental energy ” national institute of mental health – “ http //nimh nih gov/health/topics/caring for your mental health ” harvard medical school – “ https //www health harvard edu/topics/energy and fatigue ” mild cognitive impairment (mci) measures if a person is experiencing noticeable but not disabling problems with memory, thinking, or concentration mild cognitive impairment (mci) refers to subtle changes in a person’s ability to remember things, make decisions, or focus—changes that go beyond what is considered normal aging people with mci may notice that they forget appointments, lose their train of thought more often, or take longer to make decisions, but they are still able to carry out their usual daily activities independently while mci does not always lead to more serious conditions like dementia or alzheimer’s disease, it is considered a risk factor so regular monitoring and healthy lifestyle habits—like staying mentally active, exercising, and eating well—are important mci is not caused by intoxication, but alcohol or drug use can cause similar symptoms—such as memory lapses, confusion, or difficulty focusing these effects are usually temporary and linked to the substance’s impact on the brain subtle changes in speech patterns—such as delayed responses, abnormal pauses, or altered pitch—can be indicative of early cognitive decline the system uses these features to identify whether a user may be at risk for mci indications of mci may be the result of aging, drug induced impairment, or extreme fatigue early identification of root cause enables proactive care strategies results of the vocal biomarker analysis are intended to support, not replace, formal cognitive assessment tools used by healthcare professionals these are the most widely recommended and evidence supported treatments for mci physical activity regular aerobic exercise (like walking or swimming) has been shown to support brain health and memory mental stimulation engaging in puzzles, reading, learning new skills, or socializing helps keep the brain active healthy diet the mediterranean or mind diet (rich in vegetables, fruits, whole grains, fish, and healthy fats) is associated with better cognitive function sleep quality managing sleep disorders and maintaining good sleep hygiene is crucial stress reduction practices like mindfulness, yoga, or meditation may help with memory and focus recent studies estimate mci to be prevalent within approximately 6% of the senior population within mexico sources mayo clinic – “ https //mcpress mayoclinic org/alzheimers/what is mild cognitive impairment mci and how do you treat it/ ” national institute of aging https //www nia nih gov/health/memory loss and forgetfulness/what mild cognitive impairment pubmed – “ https //pubmed ncbi nlm nih gov/38261679/ ”