行为研究方法发表与实验心理学研究的方法、技术和仪器有关的文章。该杂志特别关注计算机技术在心理学研究中的应用。年度特刊专门针对这一领域。

The journal "Behavior Research Methods" focuses on publishing articles related to methods, techniques, and instruments in experimental psychology research. It particularly emphasizes the application of computer technology in psychological research and publishes annual special issues dedicated to this field.

《Behavior Research Methods》期刊专注于发表与实验心理学研究相关的方法、技术和仪器的文章。该杂志特别关注计算机技术在心理学研究中的应用，并每年出版专门针对这一领域的特刊。

Behavior Research Methods

The use of Internet panels to collect survey data is increasing because it is cost-effective, enables access to large and diverse samples quickly, takes less time than traditional methods to obtain data for analysis, and the standardization of the data collection process makes studies easy to replicate. A variety of probability-based panels have been created, including Telepanel/CentERpanel, Knowledge Networks (now GFK KnowledgePanel), the American Life Panel, the Longitudinal Internet Studies for the Social Sciences panel, and the Understanding America Study panel. Despite the advantage of having a known denominator (sampling frame), the probability-based Internet panels often have low recruitment participation rates, and some have argued that there is little practical difference between opting out of a probability sample and opting into a nonprobability (convenience) Internet panel. This article provides an overview of both probability-based and convenience panels, discussing potential benefits and cautions for each method, and summarizing the approaches used to weight panel respondents in order to better represent the underlying population. Challenges of using Internet panel data are discussed, including false answers, careless responses, giving the same answer repeatedly, getting multiple surveys from the same respondent, and panelists being members of multiple panels. More is to be learned about Internet panels generally and about Web-based data collection, as well as how to evaluate data collected using mobile devices and social-media platforms.

Ron D. Hays

Honghu Liu

Arie Kapteyn

Use of Internet panels to conduct surveys

We describe Ostracism Online, a novel, social media-based ostracism paradigm designed to (1) keep social interaction experimentally controlled, (2) provide researchers with the flexibility to manipulate the properties of the social situation to fit their research purposes, (3) be suitable for online data collection, (4) be convenient for studying subsequent within-group behavior, and (5) be ecologically valid. After collecting data online, we compared the Ostracism Online paradigm with the Cyberball paradigm (Williams & Jarvis Behavior Research Methods, 38, 174-180, 2006) on need-threat and mood questionnaire scores (van Beest & Williams Journal of Personality and Social Psychology 91, 918-928, 2006). We also examined whether ostracized targets of either paradigm would be more likely to conform to their group members than if they had been included. Using a Bayesian analysis of variance to examine the individual effects of the different paradigms and to compare these effects across paradigms, we found analogous effects on need-threat and mood. Perhaps because we examined conformity to the ostracizers (rather than neutral sources), neither paradigm showed effects of ostracism on conformity. We conclude that Ostracism Online is a cost-effective, easy to use, and ecologically valid research tool for studying the psychological and behavioral effects of ostracism.

Wouter Wolf

Ana Levordashka

Johanna R Ruff

Steven Kraaijeveld

Jan-Matthis Lueckmann

Kipling D Williams

Behavior research methods

Behav Res Methods

Ostracism Online: A social media ostracism paradigm.

在线排斥：社交媒体排斥范式。

G*Power (Erdfelder, Faul, & Buchner, 1996) was designed as a general stand-alone power analysis program for statistical tests commonly used in social and behavioral research. G*Power 3 is a major extension of, and improvement over, the previous versions. It runs on widely used computer platforms (i.e., Windows XP, Windows Vista, and Mac OS X 10.4) and covers many different statistical tests of thet, F, and χ2 test families. In addition, it includes power analyses forz tests and some exact tests. G*Power 3 provides improved effect size calculators and graphic options, supports both distribution-based and design-based input modes, and offers all types of power analyses in which users might be interested. Like its predecessors, G*Power 3 is free.

Franz Faul

Edgar Erdfelder

Albert-Georg Lang

Axel Buchner

G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences

G*Power 3：社会、行为和生物医学科学中的灵活统计功效分析程序

Textual analysis has been applied to various fields, such as discourse analysis, corpus studies, text leveling, and automated essay evaluation. Several tools have been developed for analyzing texts written in alphabetic languages such as English and Spanish. However, currently there is no tool available for analyzing Chinese-language texts. This article introduces a tool for the automated analysis of simplified and traditional Chinese texts, called the Chinese Readability Index Explorer (CRIE). Composed of four subsystems and incorporating 82 multilevel linguistic features, CRIE is able to conduct the major tasks of segmentation, syntactic parsing, and feature extraction. Furthermore, the integration of linguistic features with machine learning models enables CRIE to provide leveling and diagnostic information for texts in language arts, texts for learning Chinese as a foreign language, and texts with domain knowledge. The usage and validation of the functions provided by CRIE are also introduced.

Yao-Ting Sung

Tao-Hsing Chang

Wei-Chun Lin

Kuan-Sheng Hsieh

Kuo-En Chang

Behav Res

CRIE: An automated analyzer for Chinese texts

CRIE：一种中文文本自动化分析器

G*Power is a free power analysis program for a variety of statistical tests. We present extensions and improvements of the version introduced by Faul, Erdfelder, Lang, and Buchner (2007) in the domain of correlation and regression analyses. In the new version, we have added procedures to analyze the power of tests based on (1) single-sample tetrachoric correlations, (2) comparisons of dependent correlations, (3) bivariate linear regression, (4) multiple linear regression based on the random predictor model, (5) logistic regression, and (6) Poisson regression. We describe these new features and provide a brief introduction to their scope and handling.

Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses

使用G*Power 3.1进行统计功效分析：相关性和回归分析的检验

Abstract The Wisconsin Card Sorting Test (WCST) is a popular neuropsychological test that is complicated to score and interpret. In an attempt to make scoring of the WCST simpler, Berry (The Clinical Neuropsychologist 10, 117–121, 1996) developed a diagrammatic scoring procedure, particularly to aid scoring of perseverative responses. We identified key limitations of Berry’s diagram, including its unnecessary ambiguity and complexity, use of terminology different from that used in the standardized WCST manual, and lack of distinction between perseverative errors and perseverative responses. Our new diagrammatic scoring procedure scores each response one-by-one; we strongly suggest that the diagram is used in conjunction with the 1993 WCST manual. Our new diagrammatic scoring procedure aims to assist novice users in learning how to accurately score the task, prevent scoring errors when using the manual version of the task, and help scorers verify whether other existing computerized versions of the task (apart from the PAR version) conform to the Heaton et al. (1993) scoring method. Our diagrammatic scoring procedure holds promise to be incorporated into any future versions of the WCST manual.

Caitlin A Howlett

G Lorimer Moseley

An improved diagrammatic procedure for interpreting and scoring the Wisconsin Card Sorting Test: An update to Steve Berry’s 1996 edition

改进的威斯康星卡片分类测试图解程序：对Steve Berry 1996年版本的更新

Abstract Multinomial processing tree (MPT) models are prominent and frequently used tools to model and measure cognitive processes underlying responses in many experimental paradigms. Although MPT models typically refer to cognitive processes within single individuals, they have often been applied to group data aggregated across individuals. We investigate the conditions under which MPT analyses of aggregate data make sense. After introducing the notions of structural and empirical aggregation invariance of MPT models, we show that any MPT model that holds at the level of single individuals must also hold at the aggregate level when it is both structurally and empirically aggregation invariant. Moreover, group-level parameters of aggregation-invariant MPT models are equivalent to the expected values (i.e., means) of the corresponding individual parameters. To investigate the robustness of MPT results for aggregate data when one or both invariance conditions are violated, we additionally performed a series of simulation studies, systematically manipulating (1) the sample sizes in different trees of the model, (2) model parameterization, (3) means and variances of crucial model parameters, and (4) their correlations with other parameters of the respective MPT model. Overall, our results show that MPT parameter estimates based on aggregate data are trustworthy under rather general conditions, provided that a few preconditions are met.

Julian Quevedo Pütter

Martin Schnuerch

On aggregation invariance of multinomial processing tree models

关于多项处理树模型的聚合不变性

Abstract Closed-form (asymptotic) analytical power estimation is only available for limited classes of models, requiring correct model specification for most applications. Simulation-based power estimation can be applied in almost all scenarios where data following the model can be estimated. However, a general framework for calculating the required sample sizes for given power rates is still lacking. We propose a new model-implied simulation-based power estimation (MSPE) method for the z -test that makes use of the asymptotic normality property of estimates of a wide class of estimators, the M -estimators, and give theoretical justification for the approach. M -estimators include maximum-likelihood, least squares estimates and limited information estimators, but also estimators used for misspecified models, hence, the new simulation-based power modeling method is widely applicable. The MSPE employs a parametric model to describe the relationship between power and sample size, which can then be used to determine the required sample size for a specified power rate. We highlight its performance in linear and nonlinear structural equation models (SEM) for correctly specified models and models under distributional misspecification. Simulation results suggest that the new power modeling method is unbiased and shows good performance with regard to root mean squared error and type I error rates for the predicted required sample sizes and predicted power rates, outperforming alternative approaches, such as the naïve approach of selecting a discrete selection of sample sizes with linear interpolation of power or simple logistic regression approaches. The MSPE appears to be a valuable tool to estimate power for models without an (asymptotic) analytical power estimation.

Julien P Irmer

Andreas G Klein

Karin Schermelleh-Engel

Model-implied simulation-based power estimation for correctly specified and distributionally misspecified models: Applications to nonlinear and linear structural equation models

正确指定和分布误指定模型下的基于模拟的模型隐含功效估计：应用于非线性和线性结构方程模型

Abstract Accurately representing changes in mental states over time is crucial for understanding their complex dynamics. However, there is little methodological research on the validity and reliability of human-produced continuous-time annotation of these states. We present a psychometric perspective on valid and reliable construct assessment, examine the robustness of interval-scale (e.g., values between zero and one) continuous-time annotation, and identify three major threats to validity and reliability in current approaches. We then propose a novel ground truth generation pipeline that combines emerging techniques for improving validity and robustness. We demonstrate its effectiveness in a case study involving crowd-sourced annotation of perceived violence in movies, where our pipeline achieves a .95 Spearman correlation in summarized ratings compared to a .15 baseline. These results suggest that highly accurate ground truth signals can be produced from continuous annotations using additional comparative annotation (e.g., a versus b) to correct structured errors, highlighting the need for a paradigm shift in robust construct measurement over time.

Brandon M Booth

Shrikanth S Narayanan

People make mistakes: Obtaining accurate ground truth from continuous annotations of subjective constructs

人们会犯错：从主观构建的连续标注中获取准确的基本事实

Abstract Psychological science has thrived thanks to new methods and innovative practices. Journals, including Behavior Research Methods ( BRM ), continue to support the dissemination and evaluation of research assets including data, software/hardware, statistical code, and databases of stimuli. However, such research assets rarely allow for computational reproducibility, meaning they are difficult to reuse. Therefore, in this preregistered report, we explore how BRM ’s authors and BRM structures shape the landscape of functional research assets. Our broad research questions concern: (1) How quickly methods and analytical techniques reported in BRM can be used and developed further by other scientists; (2) Whether functionality has improved following changes to BRM journal policy in support of computational reproducibility; (3) Whether we can disentangle such policy changes from changes in reproducibility over time. We randomly sampled equal numbers of papers ( N = 204) published in BRM before and after the implementation of policy changes. Pairs of researchers recorded how long it took to ensure assets (data, software/hardware, statistical code, and materials) were fully operational. They also coded the completeness and reusability of the assets. While improvements were observed in all measures, only changes to completeness were altered significantly following the policy changes ( d = .37). The effects varied between different types of research assets, with data sets from surveys/experiments showing the largest improvements in completeness and reusability. Perhaps more importantly, changes to policy do appear to have improved the life span of research products by reducing natural decline. We conclude with a discussion of how, in the future, research and policy might better support computational reproducibility within and beyond psychological science.

短名	Behav. Res. Methods
Journal Impact	4.52
国际分区	PSYCHOLOGY, MATHEMATICAL(Q1)
期刊索引	SCI Q1中科院 2 区

ISSN	1554-351X, 1554-3528
h-index	171
国内分区	心理学(2区)心理学心理学数学(1区)心理学心理学实验(2区)
Top 期刊	是

涉及主题	计算机科学心理学数学人工智能生物医学物理哲学统计程序设计语言工程类操作系统经济神经科学量子力学语言学认知心理学认识论机器学习精神科
出版信息	出版商: Springer Nature，出版周期: 6 issues per year，期刊类型: journal，开源期刊: 否
基本数据	创刊年份: 2004，原创研究文献占比: 98.21%，自引率:8.70%， Gold OA占比: 52.53%

Behavior Research Methods

期刊引文格式

有 1 位以上作者的期刊

有 2 位作者的期刊

有 3 位作者的期刊

有 5 位以上作者的期刊

书籍引用格式

学位论文引用格式

网页引用格式

专利引用格式

手工熬夜修改参考文献？研飞自动匹配期刊，一键轻松成稿，支持 Word/WPS

投稿经验分享