Cognitive Evaluation of Machine Learning Agents

Advances in applying statistical Machine Learning (ML) led to several claims of human-level or near-human performance in tasks such as image classification & speech recognition. Such claims are unscientific primarily for two reasons, (1) They incorrectly enforce the notion that task-specific performance can be treated as manifestation of General Intelligence and (2) They are not verifiable as currently there is no set benchmark for measuring human-like cognition in a machine learning agent. Moreover, ML agent’s performance is influenced by knowledge ingested in it by its human designers. Therefore, agent’s performance may not necessarily reflect its true cognition. In this paper, we propose a framework that draws parallels from human cognition to measure machine’s cognition. Human cognitive learning is quite well studied in developmental psychology with frameworks and metrics in place to measure actual learning. To either believe or refute the claims of human-level performance of machine learning agent, we need scientific methodology to measure its cognition. Our framework formalizes incremental implementation of human-like cognitive processes in ML agents with an implicit goal to measure it. The framework offers guiding principles for measuring, (1) Task-specific machine cognition and (2) General machine cognition that spans across tasks. The framework also provides guidelines for building domain-specific task taxonomies to cognitively profile tasks. We demonstrate application of the framework with a case study where two ML agents that perform Vision and NLP tasks are cognitively evaluated.     

Practical Implementation Science: Developing and Piloting the Quality Implementation Tool

According to the Interactive Systems Framework for Dissemination and Implementation, implementation is a major mechanism and concern in bridging research and practice. The growing number of implementation frameworks need to be synthesized and translated so that the science and practice of quality implementation can be furthered. In this article, we: (1) use the synthesis of frameworks developed by Meyers et al. (Am J Commun Psychol, 2012) and translate the results into a practical implementation science tool to use for improving quality of implementation (i.e., the Quality Implementation Tool; QIT), and (2) present some of the benefits and limitations of the tool by describing how the QIT was implemented in two different pilot projects. We discuss how the QIT can be used to guide collaborative planning, monitoring, and evaluation of how an innovation is implemented.     

Gender-related inequalities in the division of family work in close relationships: A social psychological perspective

We offer a social psychological perspective on gender-related inequalities in close relationships and integrate two lines of research that have focused on the intrapersonal perceptions and interpersonal consequences respectively of the gendered division of labour. We start with a brief summary of research on gender-related inequalities in the division of labour and discuss prior explanations and paradigms. We then address the extent to which spouses consider the division of labour as fair and the factors that contribute to perceptions of (un)fairness. Central to our argument is the distributive justice framework (<citeref rid="b76">Major, 1987</citeref>, <citeref rid="b77">1993</citeref>; <citeref rid="b113">Thompson, 1991</citeref>) which claims that fairness judgements are affected by people's wants and values, comparison standards, and justifications. In the following section, we address the question of whether dissatisfaction over the division of labour causes relationship conflict and how couples manage these conflicts. The main argument is that conflict over the division of labour generally comprises an asymmetrical conflict structure (with wives as complainants and husbands as defenders of the status quo), which elicits asymmetrical conflict interaction patterns (i.e., demand/withdraw interaction) that result in asymmetrical outcomes (i.e., status quo maintenance). Finally, we summarise the main conclusions and address contributions to theory and research as well as directions for further research.     

South African Adolescents' Career Development through the Lens of the Systems Theory Framework: An Exploratory Study

Adolescent career development has predominantly been studied in the context of middle class Eurocentric cultures and there have been calls for greater attention to the career development of non-dominant and disadvantaged groups. Further, there have been calls to explore career development in terms of its context and process. In this regard, the need for research measures and approaches sensitive to adolescents and particular cultures has been recognised. This is particularly the case in South African career psychology. The present study used a qualitative career assessment instrument, My System of Career Influences, to explore influences on the career development of disadvantaged South African adolescents living in a children's home. Consistent with previous international and national studies, parents were shown to be an important influence. Unlike previous studies, the influence of working overseas was also identified as an important influence. The MSCI was shown to be effective in providing insight into both the context and process of career development and as a research instrument that may be used with adolescents. Recommendations for future research are made.     

Making psychodynamic insights accessible to teachers as an integral part of their professional task

learning process, it analyses the new developments the government has begun to encourage in favour of high-quality professional development of teachers.     

Addressing social determinants of health: Supporting ex-offenders’ employment through use of the Systems Theory Framework

There remains a need for counselors well-prepared to work with ex-offenders. As counselors aim to meet ethical obligations toward advocacy, they often seek to address social determinants of health (SDOH) challenges. Those working with ex-offenders should be aware of unique employment challenges ex-offenders may face and possess a baseline knowledge of the justice system for pertinent collaboration. This paper provides an explanation of how the Systems Theory Framework may be used to address ex-offenders’ employment-related needs through addressing SDOH challenges and collaborating with the justice system. Implications for employment counselors, counselor educators, and supervisors and steps for future research conclude.