https://www.unite.ai/diagnosing-mental-disorders-through-ai-facial-expression-evaluation/ Unite.AI * News + Artificial General Intelligence + Artificial Neural Networks + Autonomous Vehicles + Brain Machine Interface + Data Science + COVID-19 + Cybersecurity + Deep Learning + Deepfakes + Education + Environment + Ethics + Facial Recognition + Healthcare + Investments + Manufacturing + Natural Language Processing + Quantum Computing + Regulation + Reinforcement Learning + Robotics + Speech Recognition + Startups + Surveillance + Virtual Assistants * AI 101 + Autoencoder + Backpropagation + Bayes Theorem + Big Data + Computer Vision + Confusion Matrix + Convolutional Neural Networks + Cybersecurity + Decision Tree + Data Science + Deepfakes + Deep Learning + Deep Reinforcement Learning + Dimensionality Reduction + Edge AI & Edge Computing + Ensemble Learning + Federated Learning + Few-Shot Learning + Generative Adversarial Network + Generative vs Discriminative Models + Gradient Boosting + Gradient Descent + Image Classification + K-Means Clustering + K-Nearest Neighbors + Linear Regression + Long Short-Term Memory (LSTM) + Machine Learning + Meta-Learning + Nanobots + Natural Language Processing + Natural Language Understanding + Neural Networks + Overfitting + Quantum Computers + Recurrent Neural Networks + Reinforcement Learning + Robotic Process Automation (RPA) + Structured vs Unstructured Data + Supervised vs Unsupervised + Support Vector Machines + Synthetic Data + Text Classification + Transfer Learning + Transformer Neural Networks + Turing Test * Certifications + Blockchain + Cloud + Cybersecurity + Data Science + Machine Learning + Natural Language Processing + Python + Robotic Process Automation + TensorFlow + Courses * Python Libraries + Data Science + Deep Learning + Image Processing + Machine Learning + Natural Language Processing * Conferences + AI Conferences + Cybersecurity Conferences + Robotics Conferences * Interviews * Thought Leaders * Newsletters * Organizations * Meet the Team * Our Charter * Contact Us Connect with us * * * * [Search ] Unite.AI Unite.AI Diagnosing Mental Health Disorders Through AI Facial Expression Evaluation * News + A - C o Artificial General Intelligence o Artificial Neural Networks o Autonomous Vehicles o Brain Machine Interface o COVID-19 o Cybersecurity + D - F o Data Science o Deepfakes o Deep Learning o Education o Ethics o Environment o Facial Recognition + G - Q o Healthcare o Investments o Manufacturing o Natural Language Processing o Quantum Computing + R - Z o Regulation o Reinforcement Learning o Robotics o Speech Recognition o Startups o Surveillance o Virtual Assistants * AI 101 + A - D o Autoencoder o Backpropagation o Bayes Theorem o Big Data o Computer Vision o Confusion Matrix o Convolutional Neural Networks o Cybersecurity o Data Science o Decision Tree o Deepfakes o Deep Learning o Deep Reinforcement Learning + D - K o Dimensionality Reduction o Edge AI o Ensemble Learning o Federated Learning o Few-Shot Learning o Generative Adversarial Network (GAN) o Generative vs. Discriminative Models o Gradient Boosting o Gradient Descent o Image Classification o K-Means Clustering o K-Nearest Neighbors + L - Q o Linear Regression o Long Short-Term Memory o Machine Learning o Meta-Learning o Nanobots o Natural Language Processing o Natural Language Understanding o Neural Networks o Overfitting o Quantum Computers o Recurrent Neural Networks + R - Z o Reinforcement Learning o Robotic Process Automation (RPA) o Structured vs Unstructured Data o Supervised vs Unsupervised Learning o Support Vector Machines o Synthetic Data o Text Classification o Transfer Learning o Transformer Neural Networks o Turing Test * Certifications + Blockchain + Cloud + Cybersecurity + Data Science + Machine Learning + Natural Language Processing + Python + Robotic Process Automation + TensorFlow * Conferences + Artificial Intelligence + Cybersecurity + Robotics * Interviews * Thought Leaders * VPNs + Atlas VPN Review + CyberGhost VPN Review + ExpressVPN Review + HotBot VPN Review + IPVanish Review + NordVPN Review + PrivadoVPN Review + PrivateVPN Review + Proton VPN Review + Surfshark Review * Contact Healthcare Diagnosing Mental Health Disorders Through AI Facial Expression Evaluation mm Updated 4 hours ago on August 3, 2022 By Martin Anderson Table Of Contents [disorder-MAIN] Researchers from Germany have developed a method for identifying mental disorders based on facial expressions interpreted by computer vision. The new approach can not only distinguish between unaffected and affected subjects, but can also correctly distinguish depression from schizophrenia, as well as the degree to which the patient is currently affected by the disease. The researchers have provided a composite image that represents the control group for their tests (on the left in the image below) and the patients who are suffering from mental disorders (right). The identities of multiple people are blended in the representations, and neither image depicts a particular individual: Source: https://arxiv.org/pdf/2208.01369.pdf Source: https://arxiv.org/pdf/2208.01369.pdf Individuals with affective disorders tend to have raised eyebrows, leaden gazes, swollen faces and hang-dog mouth expressions. To protect patient privacy, these composite images are the only ones made available in support of the new work. Until now, facial affect recognition has been primarily used as a potential tool for basic diagnosis. The new approach, instead, offers a possible method to evaluate patient progress throughout treatment, or else (potentially, though the paper does not suggest it) in their own domestic environment for outpatient monitoring. The paper states*: 'Going beyond machine diagnosis of depression in affective computing, which has been developed in previous studies, we show that the measurable affective state estimated by means of computer vision contains far more information than the pure categorical classification.' The researchers have dubbed this technique Opto Electronic Encephalography (OEG), a completely passive method of inferring mental state by facial image analysis instead of topical sensors or ray-based medical imaging technologies. The authors conclude that OEG could potentially be not just a mere secondary aide to diagnosis and treatment, but, in the long term, a potential replacement for certain evaluative parts of the treatment pipeline, and one that could cut down on the time necessary for patient monitoring and initial diagnosis. They note: 'Overall, the results predicted by the machine show better correlations compared to the pure clinical observer rating based questionnaires and are also objective. The relatively short measurement period of a few minutes for the computer vision approaches is also noteworthy, whereas hours are sometimes required for the clinical interviews.' However, the authors are keen to emphasize that patient care in this field is a multi-modal pursuit, with many other indicators of patient state to be considered than just their facial expressions, and that it is too early to consider that such a system could entirely substitute traditional approaches to mental disorders. Nonetheless, they consider OEG a promising adjunct technology, particularly as a method to grade the effects of pharmaceutical treatment in a patient's prescribed regime. The paper is titled The Face of Affective Disorders, and comes from eight researchers across a broad range of institutions from the private and public medical research sector. Data (The new paper deals mostly with the various theories and methods that are currently popular in patient diagnosis of mental disorders, with less attention than is usual to the actual technologies and processes used in the tests and various experiments) Data-gathering took place at University Hospital at Aachen, with 100 gender-balanced patients and a control group of 50 non-affected people. The patients included 35 sufferers from schizophrenia and 65 people suffering from depression. For the patient portion of the test group, initial measurements were taken at the time of first hospitalization, and the second prior to their discharge from hospital, spanning an average interval of 12 weeks. The control group participants were recruited arbitrarily from the local population, with their own induction and 'discharge' mirroring that of the actual patients. In effect, the most important 'ground truth' for such an experiment must be diagnoses obtained by approved and standard methods, and this was the case for the OEG trials. However, the data-gathering stage obtained additional data more suited for machine interpretation: interviews averaging 90 minutes were captured over three phases with a Logitech c270 consumer webcam running at 25fps. The first session comprised of a standard Hamilton interview (based on research originated around 1960), such as would normally be given on admission. In the second phase, unusually, the patients (and their counterparts in the control group) were shown videos of a series of facial expressions, and asked to mimic each of these, while stating their own estimation of their mental condition at that time, including emotional state and intensity. This phase lasted around ten minutes. In the third and final phase, the participants were shown 96 videos of actors, lasting just over ten seconds each, apparently recounting intense emotional experiences. The participants were then asked to evaluate the emotion and intensity represented in the videos, as well as their own corresponding feelings. This phase lasted around 15 minutes. Method To arrive at the mean average of the captured faces (see first image, above), emotional landmarks were captured with the EmoNet framework. Subsequently, correspondence between the face shape and the mean (averaged) face shape was determined through piecewise affine transformation. Dimensional emotion recognition and eye gaze prediction was carried out on each landmark segment identified in the previous stage. At this point, audio-based emotion inference has indicated that a teachable moment has arrived in the patient's mental state, and the task is to capture the corresponding facial image and develop that dimension and domain of their affect state. Automatic emotion analysis from faces in-the-wild Automatic emotion analysis from faces in-the-wild Watch this video on YouTube (In the video above, we see the work developed by the authors of the dimensional emotion recognition technologies used by the researchers for the new work). The shape geodesic of the material was computed for each frame of the data, and Singular Value Decomposition (SVD) reduction applied. The resultant time series data was eventually modeled as a VAR process, and then further reduced via SVD prior to MAP adaptation. Workflow for the geodesic reduction process. Workflow for the geodesic reduction process. The valence and arousal values in the EmoNet network were also similarly processed with VAR modelling and sequence kernel computation. Experiments As explained earlier, the new work is primarily a medical research paper rather than a standard computer vision submission, and we refer the reader to the paper itself for in-depth coverage of the diverse OEG experiments run by the researchers. Nonetheless, to summarize a selection of them: Affective Disorder Cues Here 40 participants (not from the control or patient group) were asked to rate the evaluated mean faces (see above) in respect to a number of questions, without being informed of the context of the data. The questions were: What is the gender of the two faces? Do the faces have an attractive appearance? Are these faces trustworthy persons? How do you assess the ability of these people to act? What is the emotion of the two faces? What is the skin appearance of the two faces? What is the impression of the gaze? Do the two faces have droopy mouth corners? Do the two faces have raised eye browns? Are these persons clinical patients? The researchers found that these blind evaluations correlated to the registered state of the processed data: Box plot results for the 'mean face' survey. Box plot results for the 'mean face' survey. Clinical Assessment To gauge the utility of OEG in initial assessment, the researchers first evaluated how effective standard clinical assessment is by itself, measuring levels of improvement between the induction and the second phase (by which time the patient is typically receiving drug-based treatments. The researchers concluded that status and symptom severity could be well-assessed by this method, achieving a correlation of 0.82. However, an accurate diagnosis of either schizophrenia or depression proved more challenging, with the standard method only obtaining a score of -0.03 at this early stage. The authors comment: 'In essence, the patient status can be determined relatively well using the usual questionnaires. However, that is essentially all that can be concluded from it. Whether someone is depressed or rather schizophrenic is not indicated. The same applies to the treatment response.' The results from the machine process were able to obtain higher scores in this problem area, and comparable scores for the initial patient evaluation aspect: Higher numbers are better. On the left, standard interview-based evaluation accuracy results across four phases of the testing architecture; on the right, machine-based results. Higher numbers are better. On the left, standard interview-based evaluation accuracy results across four phases of the testing architecture; on the right, machine-based results. Disorder Diagnosis Distinguishing depression from schizophrenia via static face images is not a trivial matter. Cross-validated, the machine process was able to obtain high accuracy scores across the various phases of the trials: [high-accuracy] In other experiments, the researchers were able to demonstrate evidence that OEG can perceive patient improvement through pharmacological treatment, and general treatment of the disorder: 'The causal inference over the empirical prior knowledge of the data collection adjusted the pharmacological treatment in order observe a return to the physiological regulation of the facial dynamics. Such a return couldn't be observed during the clinical prescription. 'At the moment it is not clear whether such a machine based recommendation would indeed result to a significant better success of therapy. Especially because it is known which side effects medications can have over a long period of time. 'However, [these kinds] of patient-tailored approaches would break the barriers of the common categorical classification schematic still dominantly used in daily life.' * My conversion of the authors' inline citations to hyperlinks. First published 3rd August 2022. Related Topics:Computer Visionhealthcaremental healthmental illness research Don't Miss Human-Computer Interfaces Could Provide New Insight into Alzheimer's mm Martin Anderson Writer on machine learning, artificial intelligence and big data. Personal site: martinanderson.ai Contact: contact@martinanderson.ai Twitter: @manders_ai [logoUNITE2] You may like * [cctv_MAIN] [cctv_MAIN] 'Degraded' Synthetic Faces Could Help Improve Facial Image Recognition * [nerf-relighting-MAIN] [nerf-relig] Relighting Neural Radiance Fields With Any Environment Map * [unused-property] [unused-pro] AI Offers Improved Tracking of Offshore Property Ownership in the UK * [gan-driving-simulator-MAIN] [gan-drivin] Improving the Photorealism of Driving Simulations with Generative Adversarial Networks * [mask-in-the-crowd2] [mask-in-th] Researchers Identify a Resilient Trait of Deepfakes That Could Aid Long-Term Detection * [thinking_MAIN] [thinking_M] DeepMind: AI May Inherit Human Cognitive Limitations, Could Benefit From 'Formal Education' [Search ] Recent Posts * Diagnosing Mental Health Disorders Through AI Facial Expression Evaluation * Farshad Kheir, Head of AI and Data Science at Legion - Interview Series * Computer Modeling Program Helps Coral Reef Conservation Efforts * Dave Excell, Founder of Featurespace - Interview Series * 7 "Best" AI Stock Trading Bots (August 2022) Interviews * Zayd Enam, Co-founder and CEO of Cresta * Zack Dvey-Aharon, Ph.D., CEO and Co-Founder of AEYE Health - Interview Series * Yohan Lee, Chief Strategy Officer at Riiid Labs - Interview Series * Yi Zou, Senior Director of Engineering, ASML Silicon Valley - Interview Series * Yasser Khan, CEO of ONE Tech - Interview Series * Yashar Behzadi, the CEO of Synthesis AI - Interview Series * Yaron Singer, CEO at Robust Intelligence & Professor of Computer Science at Harvard University - Interview Series * Wilson Pang, Co-Author of Real World AI - Interview Series * Wilson Pang, Chief Technology Officer at Appen - Interview Series * William Santana Li, CEO of Knightscope - Interview Series * Meet the Team * Our Charter * Press Tools * Contact Us Advertiser Disclosure: Unite.AI is committed to rigorous editorial standards to provide our readers with accurate information and news. We may receive compensation when you click on links to products we reviewed. * * * * Copyright (c) 2021 Unite.AI * Editorial Policy * Privacy Policy * Terms and Conditions [1]