Bidirectional feature selection with global and local structure preservation for small size samples

Collecting samples is a challenging task for face recognition, especially for some real-world applications such as law enhancement and ID card identification, where there is usually single sample per person (SSPS) used to train a face recognition system. To extract discriminative features from the small size samples, in this paper we propose virtual samples via bidirectional feature selection with global and local structure preservation (VS-BFS-GL) to augment the number of training samples. In VS-BFS-GL, bidirectional feature selection is developed, which introduces L_2,1 norm to explore the face variations from both horizontal and vertical directions. Further, to include more variations in the virtual images, the global structure information and sample-specified local structure information of the SSPP training set are considered. By integrating bidirectional feature selection, global and local structure, the limited training samples are fully utilized and more knowledge are mined. To further improve the effectiveness of VS-BFS-GL, an auxiliary database containing different face variations can be used to explore the local structure information. We extensively evaluated the proposed approach on AR and FERET database. The promising recognition results demonstrate that VS-BFS-GL is robust to expression, pose and partial occlusion variations in the faces.     

机器学习在抑郁症领域的应用

抑郁症患者疾病意识的不足以及早期筛查方法的缺乏导致患者在被诊断时大多已发展至重性抑郁障碍。为改善现状, 近年来机器学习被逐渐应用到抑郁症的早期预测、早期识别、辅助诊断和治疗决策中。在应用中, 机器学习模型准确性的影响因素包括样本集种类及规模、特征工程、算法类型等。建议未来将机器学习进一步融入医疗健康系统及移动应用程序等, 不断优化机器学习模型, 通过充分挖掘患者健康数据来改善抑郁症的预防、识别、诊断和治疗等相关问题。     

Cognitive computing models for estimation of reference evapotranspiration: A review

Irrigation practices can be advanced by the aid of cognitive computing models. Repeated droughts, population expansion and the impact of global warming collectively impose rigorous restrictions over irrigation practices. Reference evapotranspiration (ET₀) is a vital factor to predict the crop water requirements based on climate data. There are many techniques available for the prediction of ET₀. An efficient ET₀ prediction model plays an important role in irrigation system to increase water productivity. In the present study, a review has been carried out over cognitive computing models used for the estimation of ET₀. Review exhibits that artificial neural network (ANN) approach outperforms support vector machine (SVM) and genetic programming (GP). Second order neural network (SONN) is the most promising approach among ANN models.     

Perspective on “in the wild” movement analysis using machine learning

Recent advances in wearable sensing and machine learning have created ample opportunities for “in the wild” movement analysis in sports, since the combination of both enables real-time feedback to be provided to athletes and coaches, as well as long-term monitoring of movements. The potential for real-time feedback is useful for performance enhancement or technique analysis, and can be achieved by training efficient models and implementing them on dedicated hardware. Long-term monitoring of movement can be used for injury prevention, among others. Such applications are often enabled by training a machine learned model from large datasets that have been collected using wearable sensors. Therefore, in this perspective paper, we provide an overview of approaches for studies that aim to analyze sports movement “in the wild” using wearable sensors and machine learning. First, we discuss how a measurement protocol can be set up by answering six questions. Then, we discuss the benefits and pitfalls and provide recommendations for effective training of machine learning models from movement data, focusing on data pre-processing, feature calculation, and model selection and tuning. Finally, we highlight two application domains where “in the wild” data recording was combined with machine learning for injury prevention and technique analysis, respectively.     

如何利用开源工具分析fMRI数据：基于多体素模式的有监督机器学习算法介绍

摘要：目前,多体素模式分析（MVPA）日渐普遍地应用于脑影像研究。近些年,机器学习的模式分类等算法在MVPA方法中被广泛应用,因其具有能够抽取高维数据模式,提高数据利用率的优点。其中一种典型的应用是利用解码的思想来解决神经表征问题,本文主要介绍了利用基于Python语言的工具库中有监督学习算法分析数据的过程。除介绍Nilearn结合Scikit-learn分析数据的步骤外,还比较不同算法的效率,为算法的选择及参数设备提供具体参考。     

样例多样性和流畅性信念对类别学习判断的影响

目的:通过三个实验考查样例特征、流畅性和信念对类别学习及其元认知判断的影响。方法:实验1采用2(样例特征)×2(测试类型)的组内设计以检验样例特征的作用; 实验2采用2(样例特征)×2(测试类型)×2(流畅性)的组内设计以检验流畅性的作用; 实验3采用2(样例特征)×2(测试类型)×2(流畅性信念)的混合设计以检验信念对类别学习判断的作用。结果表明:样例特征影响学习成绩、类别学习判断和流畅感; 流畅性不会影响类别学习判断; 原理解释能够有效建立“关于流畅性的信念”,且“关于流畅性的信念”对类别学习判断起作用。即样例多样性和流畅性信念对类别学习判断起作用,支持信念假说。     

Deep learning based liver cancer detection using watershed transform and Gaussian mixture model techniques

ObjectivesLiver cancer is one of the leading cause of death in all over the world. Detecting the cancer tissue manually is a difficult task and time consuming. Hence, a computer-aided diagnosis (CAD) is used in decision making process for accurate detection for appropriate therapy. Therefore the main objective of this work is to detect the liver cancer accurately using automated method.MethodsIn this work, we have proposed a new system called as watershed Gaussian based deep learning (WGDL) technique for effective delineate the cancer lesion in computed tomography (CT) images of the liver. A total of 225 images were used in this work to develop the proposed model. Initially, the liver was separated using marker controlled watershed segmentation process and finally the cancer affected lesion was segmented using the Gaussian mixture model (GMM) algorithm. After tumor segmentation, various texture features were extracted from the segmented region. These segmented features were fed to deep neural network (DNN) classifier for automated classification of three types of liver cancer i.e. hemangioma (HEM), hepatocellular carcinoma (HCC) and metastatic carcinoma (MET).ResultsWe have achieved a classification accuracy of 99.38%, Jaccard index of 98.18%, at 200 epochs using DNN classifier with a negligible validation loss of 0.062 during the classification process.ConclusionsOur developed system is ready to be tested with huge database and can aid the radiologist in detecting the liver cancer using CT images.     

Motivated learning for the development of autonomous systems

A new machine learning approach known as motivated learning (ML) is presented in this work. Motivated learning drives a machine to develop abstract motivations and choose its own goals. ML also provides a self-organizing system that controls a machine’s behavior based on competition between dynamically-changing pain signals. This provides an interplay of externally driven and internally generated control signals. It is demonstrated that ML not only yields a more sophisticated learning mechanism and system of values than reinforcement learning (RL), but is also more efficient in learning complex relations and delivers better performance than RL in dynamically-changing environments. In addition, this paper shows the basic neural network structures used to create abstract motivations, higher level goals, and subgoals. Finally, simulation results show comparisons between ML and RL in environments of gradually increasing sophistication and levels of difficulty.     

Collaboration of Colorado Cancer Genetic Counselors to Integrate Next Generation Sequencing Panels into Clinical Practice

The recent introduction of clinically available next generation sequencing (NGS) cancer panels has presented new challenges for genetic counselors. Determining which patients are appropriate for NGS panel testing is complex. Due to the large number of genes included in the NGS panels, thorough and appropriate pre-test counseling and interpretation of NGS results can be a time-consuming and difficult process. Many of the genes associated with increased cancer risk lack published clinical management guidelines and estimates of cancer risk for individuals with deleterious mutations. In order to efficiently and effectively review the clinical utility of NGS panels, Colorado cancer genetic counselors formed a working group to gain a better understanding of the genes included in NGS cancer panels. This publication reports on the approach of this group, the process used to evaluate a selected NGS panel, future directions for this collaboration, and ideas for other genetic counselors to form similar groups to efficiently evaluate new technologies and improve practice.     

Adaptive sampling for active learning with genetic programming

Active learning is a machine learning paradigm allowing to decide which inputs to use for training. It is introduced to Genetic Programming (GP) essentially thanks to the dynamic data sampling, used to address some known issues such as the computational cost, the over-fitting problem and the imbalanced databases. The traditional dynamic sampling for GP gives to the algorithm a new sample periodically, often each generation, without considering the state of the evolution. In so doing, individuals do not have enough time to extract the hidden knowledge. An alternative approach is to use some information about the learning state to adapt the periodicity of the training data change. In this work, we propose an adaptive sampling strategy for classification tasks based on the state of solved fitness cases throughout learning. It is a flexible approach that could be applied with any dynamic sampling. We implemented some sampling algorithms extended with dynamic and adaptive controlling re-sampling frequency. We experimented them to solve the KDD intrusion detection and the Adult incomes prediction problems with GP. The experimental study demonstrates how the sampling frequency control preserves the power of dynamic sampling with possible improvements in learning time and quality. We also demonstrate that adaptive sampling can be an alternative to multi-level sampling. This work opens many new relevant extension paths.     

Worms under cover: relationships between performance in learning tasks and personality in great tits (Parus major)

In animals, individual differences in learning ability are common and are in part explained by genetic differences, developmental conditions and by general experience. Yet, not all variations in learning are well understood. Individual differences in learning may be associated with elementary individual characteristics that are consistent across situations and over time, commonly referred to as personality or temperament. Here, we tested whether or not male great tits (Parus major) from two selection lines for fast or slow exploratory behaviour, an operational measure for avian personality, vary in their learning performance in two related consecutive tasks. In the first task, birds had to associate a colour with a reward whereas in the second task, they had to associate a new colour with a reward ignoring the previously rewarded colour. Slow explorers had shorter latencies to approach the experimental device compared with fast explorers in both tasks, but birds from the two selection lines did not differ in accomplishing the first task, that is, to associate a colour with a reward. However, in the second task, fast explorers had longer latencies to solve the trials than slow explorers. Moreover, relative to the number of trials needed to reach the learning criteria in the first task, birds from the slow selection line took more trials to associate a new colour with a reward while ignoring the previously learned association compared with birds from the fast selection line. Overall, the experiments suggest that personality in great tits is not strongly related to learning per se in such an association task, but that birds from different selection lines might express different learning strategies as birds from the different selection lines were differently affected by their previous learning performance.     

Action unit classification using active appearance models and conditional random fields

In this paper, we investigate to what extent modern computer vision and machine learning techniques can assist social psychology research by automatically recognizing facial expressions. To this end, we develop a system that automatically recognizes the action units defined in the facial action coding system (FACS). The system uses a sophisticated deformable template, which is known as the active appearance model, to model the appearance of faces. The model is used to identify the location of facial feature points, as well as to extract features from the face that are indicative of the action unit states. The detection of the presence of action units is performed by a time series classification model, the linear-chain conditional random field. We evaluate the performance of our system in experiments on a large data set of videos with posed and natural facial expressions. In the experiments, we compare the action units detected by our approach with annotations made by human FACS annotators. Our results show that the agreement between the system and human FACS annotators is higher than 90% and underlines the potential of modern computer vision and machine learning techniques to social psychology research. We conclude with some suggestions on how systems like ours can play an important role in research on social signals.     

The effects on classifier performance of 2D discrete wavelet transform analysis and whale optimization algorithm for recognition of power quality disturbances

Power Quality (PQ) is becoming more and more important day by day in the electric network. Signal processing, pattern recognition and machine learning are increasingly being studied for the automatic recognition of any disturbances that may occur during the generation, transmission, and distribution of electricity. There are three main steps to identify the PQ disturbances. These include the use of signal processing methods to calculate the features representing the disturbances, the selection of those that are more useful than these feature sets to prevent the creation of a complex classification model, the creating a classification model that recognizes multiple classes using the selected feature subsets. In this study, one-dimensional (1D) PQ disturbances signals are transformed into two-dimensional (2D) signals, 2D discrete wavelet transforms (2D-DWT) are used to extract the features. The features are extracted by using the wavelet families such as Daubechies, Biorthogonal, Symlets, Coiflets and Fejer-Korovkin in 2D-DWT to analyze PQ disturbances. Whale Optimization Algorithm (WOA) and k-nearest neighbor (KNN) classifier determine the feature subsets. Then, WOA and k nearest neighbor (KNN) classifier are used to determine the feature group. By using KNN and Support Vector Machines (SVM) classification methods, Classifier models that distinguish PQ disturbances are formed. The main aim of the study is to determine the features derived from 2D wavelet coefficients for different wavelet families and to determine which of them has a better classification performance to distinguish PQ disturbances signals. At the same time, different classification methods are simulated and a model which can classify PQ disturbances signals with high performance is created. Also, the generated models are analysed for their performance in terms of different noise levels (40 dB, 30 dB, 20 dB). The result of this simulation study shows that the model developed to classify PQ disturbances is superior to conventional models and other 2D signal processing methods in the literature. In addition, it was concluded that the proposed method can cope better with noisy signals by low computational complexity and higher classification rate.     

Action unit classification using active appearance models and conditional random fields

In this paper, we investigate to what extent modern computer vision and machine learning techniques can assist social psychology research by automatically recognizing facial expressions. To this end, we develop a system that automatically recognizes the action units defined in the facial action coding system (FACS). The system uses a sophisticated deformable template, which is known as the active appearance model, to model the appearance of faces. The model is used to identify the location of facial feature points, as well as to extract features from the face that are indicative of the action unit states. The detection of the presence of action units is performed by a time series classification model, the linear-chain conditional random field. We evaluate the performance of our system in experiments on a large data set of videos with posed and natural facial expressions. In the experiments, we compare the action units detected by our approach with annotations made by human FACS annotators. Our results show that the agreement between the system and human FACS annotators is higher than 90% and underlines the potential of modern computer vision and machine learning techniques to social psychology research. We conclude with some suggestions on how systems like ours can play an important role in research on social signals.     

Feedback type as a moderator of the relationship between achievement goals and feedback reactions

The aim of the current study is to shed new light on the inconsistent relationship between performance‐approach (PAp) goals and feedback reactions by examining feedback type as a moderator. Results of a field experiment (N = 939) using a web‐based work simulation task showed that the effect of achievement‐approach goals was moderated by feedback type. Relative to individuals pursuing mastery‐approach goals, individuals pursuing PAp goals responded more negatively to comparative feedback but not to task‐referenced feedback. In line with the hypothesized mediated moderation model, the interaction between achievement goals and feedback type also indirectly affected task performance through feedback reactions. Providing employees with feedback is a key psychological principle used in a wide range of human resource and performance management instruments (e.g., developmental assessment centres, multi‐source/360° feedback, training, selection, performance appraisal, management education, computer‐adaptive testing, and coaching). The current study suggests that organizations need to strike a balance between encouraging learning and encouraging performance, as too much emphasis on comparative performance (both in goal inducement and in feedback style) may be detrimental to employees' reactions and rate of performance improvement.     

Generalization and similarity in exemplar models of categorization: Insights from machine learning

Exemplar theories of categorization depend on similarity for explaining subjects’ ability to generalize to new stimuli. A major criticism of exemplar theories concerns their lack of abstraction mechanisms and thus, seemingly, of generalization ability. Here, we use insights from machine learning to demonstrate that exemplar models can actually generalize very well. Kernel methods in machine learning are akin to exemplar models and are very successful in real-world applications. Their generalization performance depends crucially on the chosen similarity measure. Although similarity plays an important role in describing generalization behavior, it is not the only factor that controls generalization performance. In machine learning, kernel methods are often combined with regularization techniques in order to ensure good generalization. These same techniques are easily incorporated in exemplar models. We show that the generalized context model (Nosofsky, 1986) and ALCOVE (Kruschke, 1992) are closely related to a statistical model called kernel logistic regression. We argue that generalization is central to the enterprise of understanding categorization behavior, and we suggest some ways in which insights from machine learning can offer guidance.     

CBT对社交焦虑障碍有效干预的神经预测因子及机器学习应用

认知行为疗法（CBT）是社交焦虑障碍的标准疗法,对其疗效的神经预测因子研究有利于个性化诊疗方案选择。初步证据表明,干预前高级视皮层、背侧前扣带回、背内/外侧前额叶及眶额皮层的功能激活,杏仁核与情绪调节相关脑区的结构与功能连接,情绪性刺激诱发的晚期正成分与治疗后症状的改善有关,因而是潜在的预测因子。基于机器学习的个体化预测存在样本量小的突出问题。未来研究应考虑跨研究机构合作共享大数据,在多模态、多任务条件下收集数据,并在独立样本中验证预测的有效性。     

Convolutional neural network based Alzheimer’s disease classification from magnetic resonance brain images

Alzheimer’s disease, the most common form of dementia is a neurodegenerative brain order that has currently no cure for it. Hence, early diagnosis of such disease using computer-aided systems is a subject of great importance and extensive research amongst researchers. Nowadays, deep learning or particularly convolutional neural network (CNN) is getting more attention due to its state-of-the-art performances in variety of computer vision tasks such as visual object classification, detection and segmentation. Several recent studies, that have used brain MRI scans and deep learning have shown promising results for diagnosis of Alzheimer’s disease. However, most common issue with deep learning architectures such as CNN is that they require large amount of data for training. In this paper, a mathematical model P_FS_EC_TL based on transfer learning is used in which a CNN architecture, VGG-16 trained on ImageNet dataset is used as a feature extractor for the classification task. Experimentation is performed on data collected from Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. The accuracy of the 3-way classification using the described method is 95.73% for the validation set.