Rolling element bearing fault diagnosis using convolutional neural network and vibration image

Detecting in prior bearing faults is an essential task of machine health monitoring because bearings are the vital components of rotary machines. The performance of traditional intelligent fault diagnosis methods depend on feature extraction of fault signals, which requires signal processing techniques, expert knowledge, and human labor. Recently, deep learning algorithms have been applied widely in machine health monitoring. With the capacity of automatically learning complex features of input data, deep learning architectures have great potential to overcome drawbacks of traditional intelligent fault diagnosis. This paper proposes a method for diagnosing bearing faults based on a deep structure of convolutional neural network. Using vibration signals directly as input data, the proposed method is an automatic fault diagnosis system which does not require any feature extraction techniques and achieves very high accuracy and robustness under noisy environments.     

Application of deep transfer learning for automated brain abnormality classification using MR images

Magnetic resonance imaging (MRI) is the most common imaging technique used to detect abnormal brain tumors. Traditionally, MRI images are analyzed manually by radiologists to detect the abnormal conditions in the brain. Manual interpretation of huge volume of images is time consuming and difficult. Hence, computer-based detection helps in accurate and fast diagnosis. In this study, we proposed an approach that uses deep transfer learning to automatically classify normal and abnormal brain MR images. Convolutional neural network (CNN) based ResNet34 model is used as a deep learning model. We have used current deep learning techniques such as data augmentation, optimal learning rate finder and fine-tuning to train the model. The proposed model achieved 5-fold classification accuracy of 100% on 613 MR images. Our developed system is ready to test on huge database and can assist the radiologists in their daily screening of MR images.     

Risk assessment of knowledge fusion in an innovation ecosystem based on a GA-BP neural network

The risk assessment of knowledge fusion in innovation ecosystems is directly related to these ecosystems’ success or failure. A back-propagation (BP) neural network optimized by a genetic algorithm (GA) is thus proposed to evaluate the risk of knowledge fusion in innovation ecosystems. First, an index system is constructed for evaluating the risk of knowledge fusion in innovation ecosystems, and data are collected by questionnaire for use as training data for the neural networks. To realize machine learning, 84 datasets were generated, of which 60 were used to train the network, and 24 were used to test the network in MATLAB (R2014b). Evaluation models were then constructed by the BP neural network and GA-BP neural network, and their accuracy was judged by comparing the evaluation value with the target value. The comparison shows that the GA-BP neural network has faster convergence speed and higher stability, can achieve the goal more often, and reduces the possibility of the BP neural network falling into a local optimum instead of reaching global optimization. The GA-BP neural network model for the knowledge fusion risk assessment of innovation ecosystems provides a new method for practice.     

FNDNet – A deep convolutional neural network for fake news detection

With the increasing popularity of social media and web-based forums, the distribution of fake news has become a major threat to various sectors and agencies. This has abated trust in the media, leaving readers in a state of perplexity. There exists an enormous assemblage of research on the theme of Artificial Intelligence (AI) strategies for fake news detection. In the past, much of the focus has been given on classifying online reviews and freely accessible online social networking-based posts. In this work, we propose a deep convolutional neural network (FNDNet) for fake news detection. Instead of relying on hand-crafted features, our model (FNDNet) is designed to automatically learn the discriminatory features for fake news classification through multiple hidden layers built in the deep neural network. We create a deep Convolutional Neural Network (CNN) to extract several features at each layer. We compare the performance of the proposed approach with several baseline models. Benchmarked datasets were used to train and test the model, and the proposed model achieved state-of-the-art results with an accuracy of 98.36% on the test data. Various performance evaluation parameters such as Wilcoxon, false positive, true negative, precision, recall, F1, and accuracy, etc. were used to validate the results. These results demonstrate significant improvements in the area of fake news detection as compared to existing state-of-the-art results and affirm the potential of our approach for classifying fake news on social media. This research will assist researchers in broadening the understanding of the applicability of CNN-based deep models for fake news detection.     

Convolutional neural network based Alzheimer’s disease classification from magnetic resonance brain images

Alzheimer’s disease, the most common form of dementia is a neurodegenerative brain order that has currently no cure for it. Hence, early diagnosis of such disease using computer-aided systems is a subject of great importance and extensive research amongst researchers. Nowadays, deep learning or particularly convolutional neural network (CNN) is getting more attention due to its state-of-the-art performances in variety of computer vision tasks such as visual object classification, detection and segmentation. Several recent studies, that have used brain MRI scans and deep learning have shown promising results for diagnosis of Alzheimer’s disease. However, most common issue with deep learning architectures such as CNN is that they require large amount of data for training. In this paper, a mathematical model P_FS_EC_TL based on transfer learning is used in which a CNN architecture, VGG-16 trained on ImageNet dataset is used as a feature extractor for the classification task. Experimentation is performed on data collected from Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. The accuracy of the 3-way classification using the described method is 95.73% for the validation set.     

Twitter sentiment analysis with a deep neural network: An enhanced approach using user behavioral information

Sentiment analysis on social media such as Twitter has become a very important and challenging task. Due to the characteristics of such data—tweet length, spelling errors, abbreviations, and special characters—the sentiment analysis task in such an environment requires a non-traditional approach. Moreover, social media sentiment analysis is a fundamental problem with many interesting applications. Most current social media sentiment classification methods judge the sentiment polarity primarily according to textual content and neglect other information on these platforms. In this paper, we propose a neural network model that also incorporates user behavioral information within a given document (tweet). The neural network used in this paper is a Convolutional Neural Network (CNN). The system is evaluated on two datasets provided by the SemEval-2016 Workshop. The proposed model outperforms current baseline models (including Naive Bayes and Support Vector Machines), which shows that going beyond the content of a document (tweet) is beneficial in sentiment classification, because it provides the classifier with a deep understanding of the task.     

Application of improved BP neural network based on e-commerce supply chain network data in the forecast of aquatic product export volume

Aiming at the existing problems in the production and export scale prediction of aquaculture, a model of yield prediction based on BP Neural network algorithm is proposed, and a set of algorithms is proposed to optimize BP neural network (BPNN). Based on the traditional BP neural network, it is easy to get into the local optimal problem due to the long training time of the model. By using the simple Johnson algorithm, the dimensionality of the input neuron is reduced, and then the hidden layer neural network is determined by this method. At the same time, the data mining method is used to filter the Data.Particle swarm optimization algorithm is used to optimize the parameters. At the same time, based on the domestic e-commerce Sales network data, the results show that the average square root error of the model is less than the traditional BP neural network and the learning efficiency is higher than the traditional BP neural network. The results show that the model has a great advantage in building up a large number of historical data, and it can shorten the modeling time and get good prediction result by combining the sales data of e-commerce. It provides a new feasible method for the export prediction of aquatic products.     

The Ornstein-Uhlenbeck model for decision time in cognitive tasks: An example of control of nonlinear network dynamics

The Ornstein-Uhlenbeck (OU) model for human decision-making has been successfully applied to account for response accuracy and response time (RT) data in recent two-choice decision models. A variant of the OU model is shown to arise from the response dynamics of a nonlinear network consisting of randomly connected neural processing units. When feedback control of the network is effected by the stimulus onset, the average network response is an autocorrelated random signal satisfying the stochastic differential equation for the OU process. An alternative, more general, stimulus detection procedure is proposed which involves the use of an adaptive Kalman filter process to track any temporal change in autoregressive parameters. The predicted decision time distributions suggest that both the OU and the Kalman filter processes can serve as alternative models for RT data in experimental tasks. Received: 15 October 1998 / Accepted: 27 May 1999     

机器学习在自闭症儿童早期识别和诊断领域的应用

早发现、早诊断、早干预是开展自闭症儿童教育康复工作的共识, 但传统识别和诊断方法局限及专业人员缺乏常导致自闭症儿童错失最佳干预期。为改善现状, 近年来机器学习凭借其客观准确、简便灵活等方面的优势, 逐渐被应用到自闭症的早期预测、筛查、诊断和评估过程管理中, 积累了较为丰富的成果。但是机器学习也在研究对象选取、分类数据采集和理论模型应用等方面存在局限性。未来研究应推动构建孕产期和新生儿病理生理信息追踪数据库和标准化模型分类指标体系, 同时继续优化算法, 加快智能化自闭症识别和诊断理论成果向实践转化。     

Combining predictors for multi-layer architecture of adaptive fuzzy inference system

To solve problems with a Sugeno adaptive fuzzy neural network using training data, it is necessary to select the appropriate combination of input characteristics of the sub-adaptive neuro-fuzzy inference system (ANFIS) and to determine the appropriate topology. The multi-layer architecture of a sub-ANFIS (MLA-ANFIS) is a good model for prediction problems and solves them modularity. Since, the combination of several predictors is the current focus in the construction of hybrid intelligent systems; we created many solutions to combine machine learning methods, namely ANFIS, support vector machine (SVM), deep neural network (DNN), naive Bayes (NB), linear regression (LR), extreme learning machine (ELM), and decision tree (DT) mixed predictors, and ensemble bootstrap aggregation based on MLA-ANFIS in order to discover the optimal model of combined predictors based on the MLA-ANFIS with a combination of input features entered in the MLA-ANFIS. We implemented our approaches on 365-day concrete compressive strength, thoracic surgery, fertility diagnosis, breast, energy, and glass identification datasets from UCI. The experimental results prove that the combining predictors for the MLA-ANFIS show performance improvements compared to the pure MLA-ANFIS method.     

Race effects on students' track mobility in high school

Race effects on track mobility are hypothesized on the basis of racial differences in initial track placement, learning opportunities, course preferences, and academic guidance. Race differences in patterns of track mobility are observed in a large, longitudinal survey that follows students from ninth through twelfth grade. Initial track placements and changes in track over the school year and between school years are described. Multivariate analyses associate race with the likelihood of changing track and the direction of the track change. Black students are less likely than white students to move to Honors and advanced tracks in Mathematics but more likely than whites to move from the Basic to the Regular track in English. Black students are considerably more likely than whites to drop out of the tracking system in English and Mathematics, except for black students in Advanced English and in Honors and Advanced Mathematics. The results of this study point to tracking as an organizational characteristic of schools that can provide students with unequal access to the curriculum and, therefore, to learning opportunities by race. Close monitoring of track changes is recommended to insure that tracking promotes the academic achievement of all students. This research was funded by Grant #R117E10139-01 from the U.S. Department of Education, Office of Educational Research and Improvement and by National Science Foundation Grant No. RED-9311800. The author is grateful to these agencies for their support as well as to Warren Kubitschek for his contribution to the data analysis and to Ann Power for research assistance.     

Deep learning and punctuated equilibrium theory

Deep learning is associated with the latest success stories in AI. In particular, deep neural networks are applied in increasingly different fields to model complex processes. Interestingly, the underlying algorithm of backpropagation was originally designed for political science models. The theoretical foundations of this approach are very similar to the concept of Punctuated Equilibrium Theory (PET). The article discusses the concept of deep learning and shows parallels to PET. A showcase model demonstrates how deep learning can be used to provide a missing link in the study of the policy process: the connection between attention in the political system (as inputs) and budget shifts (as outputs).     

Proposal and evaluation of deep exploitation-oriented learning under multiple reward environment

Recently, deep reinforcement learning (DRL) has attracted considerable attention. The well-known deep Q-network (DQN) architecture successfully combines deep learning and Q-learning which is a representative reinforcement learning (RL) method. In general, RL and DRL require many trial-and-error searches. To overcome this limitation, alternative approaches called exploitation-oriented learning (XoL) and deep exploitation-oriented learning (DXoL) have been proposed.Although the effectiveness of DXoL for DQNs has been verified, its effectiveness in an environment where multiple types of rewards are present remains unclear. In this study, we apply the DXoL method to two applications with multiple reward types: the driver drowsiness determination system and the decision-making system. Our experimental results show that DXoL is more suitable for learning priorities among multiple rewards than DQNs in these applications.     

Learning multiple layers of representation

To achieve its impressive performance in tasks such as speech perception or object recognition, the brain extracts multiple levels of representation from the sensory input. Backpropagation was the first computationally efficient model of how neural networks could learn multiple layers of representation, but it required labeled training data and it did not work well in deep networks. The limitations of backpropagation learning can now be overcome by using multilayer neural networks that contain top-down connections and training them to generate sensory data rather than to classify it. Learning multilayer generative models might seem difficult, but a recent discovery makes it easy to learn nonlinear distributed representations one layer at a time.     

Application of two neural network paradigms to the study of voluntary employee turnover.

Two neural network paradigms--multilayer perceptron and learning vector quantization--were used to study voluntary employee turnover with a sample of 577 hospital employees. The objectives of the study were twofold. The 1st was to assess whether neural computing techniques offered greater predictive accuracy than did conventional turnover methodologies. The 2nd was to explore whether computer models of turnover based on neural network technologies offered new insights into turnover processes. When compared with logistic regression analysis, both neural network paradigms provided considerably more accurate predictions of turnover behavior, particularly with respect to the correct classification of leavers. In addition, these neural network paradigms captured nonlinear relationships that are relevant for theory development. Results are discussed in terms of their implications for future research.     

A study of the classification capabilities of neural networks using unsupervised learning: A comparison withK-means clustering

Several neural networks have been proposed in the general literature for pattern recognition and clustering, but little empirical comparison with traditional methods has been done. The results reported here compare neural networks using Kohonen learning with a traditional clustering method (K-means) in an experimental design using simulated data with known cluster solutions. Two types of neural networks were examined, both of which used unsupervised learning to perform the clustering. One used Kohonen learning with a conscience and the other used Kohonen learning without a conscience mechanism. The performance of these nets was examined with respect to changes in the number of attributes, the number of clusters, and the amount of error in the data. Generally, theK-means procedure had fewer points misclassified while the classification accuracy of neural networks worsened as the number of clusters in the data increased from two to five.Acknowledgements: Sara Dickson, Vidya Nair, and Beth Means assisted with the neural network analyses.     

Multilevel metric rank match for person re-identification

Metric learning is one of the important ways to improve the person re-identification (ReID) accurate, of which triplet loss is the most effect metric learning method. However, triplet loss only ranks the extracted feature at the end of the network, in this paper, we propose a multilevel metric rank match (MMRM) method, which ranks the extracted feature on multilevel of the network. At each rank level, the extracted features are ranked to find the hard sample pairs and the backward dissemination triplet loss. Each rank level has different penalize value to adjust the network, in which the value is bigger with the deeper level of the whole network. Experiment results on CUHK03, Market1501 and DukeMTMC datasets indicate that The MMRM algorithm can outperform the previous state-of-the-arts.     

A visual embedding for the unsupervised extraction of abstract semantics

Vector-space word representations obtained from neural network models have been shown to enable semantic operations based on vector arithmetic. In this paper, we explore the existence of similar information on vector representations of images. For that purpose we define a methodology to obtain large, sparse vector representations of image classes, and generate vectors through the state-of-the-art deep learning architecture GoogLeNet for 20 K images obtained from ImageNet. We first evaluate the resultant vector-space semantics through its correlation with WordNet distances, and find vector distances to be strongly correlated with linguistic semantics. We then explore the location of images within the vector space, finding elements close in WordNet to be clustered together, regardless of significant visual variances (e.g., 118 dog types). More surprisingly, we find that the space unsupervisedly separates complex classes without prior knowledge (e.g., living things). Afterwards, we consider vector arithmetics. Although we are unable to obtain meaningful results on this regard, we discuss the various problem we encountered, and how we consider to solve them. Finally, we discuss the impact of our research for cognitive systems, focusing on the role of the architecture being used.     

Conjunctive representations in learning and memory: principles of cortical and hippocampal function

The authors present a theoretical framework for understanding the roles of the hippocampus and neocortex in learning and memory. This framework incorporates a theme found in many theories of hippocampal function: that the hippocampus is responsible for developing conjunctive representations binding together stimulus elements into a unitary representation that can later be recalled from partial input cues. This idea is contradicted by the fact that hippocampally lesioned rats can learn nonlinear discrimination problems that require conjunctive representations. The authors' framework accommodates this finding by establishing a principled division of labor, where the cortex is responsible for slow learning that integrates over multiple experiences to extract generalities whereas the hippocampus performs rapid learning of the arbitrary contents of individual experiences. This framework suggests that tasks involving rapid, incidental conjunctive learning are better tests of hippocampal function. The authors implement this framework in a computational neural network model and show that it can account for a wide range of data in animal learning.