行为研究方法发表与实验心理学研究的方法、技术和仪器有关的文章。该杂志特别关注计算机技术在心理学研究中的应用。年度特刊专门针对这一领域。

The journal "Behavior Research Methods" focuses on publishing articles related to methods, techniques, and instruments in experimental psychology research. It particularly emphasizes the application of computer technology in psychological research and publishes annual special issues dedicated to this field.

《Behavior Research Methods》期刊专注于发表与实验心理学研究相关的方法、技术和仪器的文章。该杂志特别关注计算机技术在心理学研究中的应用，并每年出版专门针对这一领域的特刊。

Behavior Research Methods

A Web-based interface has been developed to facilitate researchers in collecting language history information online. Most researchers use their own versions of language history questionnaires for specific studies in second language acquisition. Although these versions of questionnaires all differ from one another in some respects, there is a significant amount of overlap between them. Here we identify the crucial dimensions that most investigators consider important to include in such a questionnaire. We have examined the most commonly asked questions in 41 published questionnaires, and on the basis of our analyses we propose a general L2 language history questionnaire. Subjects can enter some or all of the information on the Web, and the results are automatically generated as an RTF output file on the user's desktop.

Ping Li

Sara Sepanski

Xiaowei Zhao

Behavior research methods

Behav Res Methods

Language history questionnaire: A web-based interface for bilingual research.

语言历史问卷：基于网络的双语研究界面。

The usage of psychological networks that conceptualize behavior as a complex interplay of psychological and other components has gained increasing popularity in various research fields. While prior publications have tackled the topics of estimating and interpreting such networks, little work has been conducted to check how accurate (i.e., prone to sampling variation) networks are estimated, and how stable (i.e., interpretation remains similar with less observations) inferences from the network structure (such as centrality indices) are. In this tutorial paper, we aim to introduce the reader to this field and tackle the problem of accuracy under sampling variation. We first introduce the current state-of-the-art of network estimation. Second, we provide a rationale why researchers should investigate the accuracy of psychological networks. Third, we describe how bootstrap routines can be used to (A) assess the accuracy of estimated network connections, (B) investigate the stability of centrality indices, and (C) test whether network connections and centrality estimates for different variables differ from each other. We introduce two novel statistical methods: for (B) the correlation stability coefficient, and for (C) the bootstrapped difference test for edge-weights and centrality indices. We conducted and present simulation studies to assess the performance of both methods. Finally, we developed the free R-package bootnet that allows for estimating psychological networks in a generalized framework in addition to the proposed bootstrap methods. We showcase bootnet in a tutorial, accompanied by R syntax, in which we analyze a dataset of 359 women with posttraumatic stress disorder available online.

Sacha Epskamp

Denny Borsboom

Eiko I. Fried

Behav Res

Estimating psychological networks and their accuracy: A tutorial paper

心理网络的估计及其准确性：一篇教程论文

In the present study, we collected valence, arousal, concreteness, familiarity, imageability, and context availability ratings for a total of 1,100 Chinese words. The ratings for all variables were collected with 9-point Likert scales. We tested the reliability of the present database by comparing it to the extant Chinese Affective Word System, and performed split-half correlations for all six variables. We then evaluated the relationships between all variables. Regarding the affective variables, we found a typical quadratic relation between valence and arousal, in line with previous findings. Likewise, significant correlations were found between the semantic variables. Importantly, we explored the relationships between ratings for the affective variables (i.e., valence and arousal) and concreteness ratings, suggesting that valence and arousal ratings can predict concreteness ratings. This database of affective norms will be a valuable source of information for emotion research that makes use of Chinese words, and will enable researchers to use highly controlled Chinese verbal stimuli to more reliably investigate the relation between cognition and emotion.

Zhao Yao

Jia Wu

Yanyan Zhang

Zhenhong Wang

Norms of valence, arousal, concreteness, familiarity, imageability, and context availability for 1,100 Chinese words.

1,100个中文词汇的效价、唤醒度、具体性、熟悉度、形象性和语境可用性规范。

Abstract Investigation of affective and semantic dimensions of words is essential for studying word processing. In this study, we expanded Tse et al.’s (Behav Res Methods 49:1503–1519, 2017; Behav Res Methods 55:4382–4402, 2023) Chinese Lexicon Project by norming five word dimensions (valence, arousal, familiarity, concreteness, and imageability) for over 25,000 two-character Chinese words presented in traditional script. Through regression models that controlled for other variables, we examined the relationships among these dimensions. We included ambiguity, quantified by the standard deviation of the ratings of a given lexical variable across different raters, as separate variables (e.g., valence ambiguity) to explore their connections with other variables. The intensity–ambiguity relationships (i.e., between normed variables and their ambiguities, like valence with valence ambiguity) were also examined. In these analyses with a large pool of words and controlling for other lexical variables, we replicated the asymmetric U-shaped valence–arousal relationship, which was moderated by valence and arousal ambiguities. We also observed a curvilinear relationship between valence and familiarity and between valence and concreteness. Replicating Brainerd et al.’s (J Exp Psychol Gen 150:1476–1499, 2021; J Mem Lang 121:104286, 2021) quadratic intensity–ambiguity relationships, we found that the ambiguity of valence, arousal, concreteness, and imageability decreases as the value of these variables is extremely low or extremely high, although this was not generalized to familiarity. While concreteness and imageability were strongly correlated, they displayed different relationships with arousal, valence, familiarity, and valence ambiguity, suggesting their distinct conceptual nature. These findings further our understanding of the affective and semantic dimensions of two-character Chinese words. The normed values of all these variables can be accessed via https://osf.io/hwkv7 .

Yuen-Lai Chan

Chi-Shing Tse

Decoding the essence of two-character Chinese words: Unveiling valence, arousal, concreteness, familiarity, and imageability through word norming

解码双字中文词的本质：通过词规范揭示情感、唤醒、具体性、熟悉度和图像性

The present work collected familiarity norms for 20,275 two-character, 1231 three-character, and 2819 four-character simplified Chinese words from 1300 native speakers of Mandarin Chinese. The familiarity of each word was rated on a 7-point scale by at least 21 participants. The results supported the reliability and validity of the present familiarity ratings, which is the first large familiarity database for Chinese in the field. These familiarity norms can be downloaded from the supplemental materials. Furthermore, the contribution of familiarity to Chinese lexical processing was investigated using the present familiarity ratings and previous data (lexical features and visual lexical decision), mainly from two major Chinese lexicon projects, MELD-SCH and CLP. Regression analysis suggests that familiarity explained a substantial percentage of the variance in lexical processing of both simplified and traditional Chinese words, over and above the effects of word frequency and other lexical features, including age of acquisition (AoA). Further analysis identified a significantly greater familiarity effect for lower-frequency words than that for higher-frequency words. Together, among the first, our findings support the important contribution of familiarity with Chinese words to lexical processing, especially for low-frequency words.

Yongqiang Su

Yixun Li

Hong Li

Familiarity ratings for 24,325 simplified Chinese words.

24,325个简体中文字的熟悉度评分。

Abstract The study of large language models (LLMs) and LLM-powered chatbots has gained significant attention in recent years, with researchers treating LLMs as participants in psychological experiments. To facilitate this research, we developed an R package called “MacBehaviour “ ( https://github.com/xufengduan/MacBehaviour ), which interacts with over 100 LLMs, including OpenAI's GPT family, the Claude family, Gemini, Llama family, and other open-weight models. The package streamlines the processes of LLM behavioural experimentation by providing a comprehensive set of functions for experiment design, stimuli presentation, model behaviour manipulation, and logging responses and token probabilities. With a few lines of code, researchers can seamlessly set up and conduct psychological experiments, making LLM behaviour studies highly accessible. To validate the utility and effectiveness of “MacBehaviour,“ we conducted three experiments on GPT-3.5 Turbo, Llama-2-7b-chat-hf, and Vicuna-1.5-13b, replicating the sound-gender association in LLMs. The results consistently demonstrated that these LLMs exhibit human-like tendencies to infer gender from novel personal names based on their phonology, as previously shown by Cai et al. (2024). In conclusion, “MacBehaviour” is a user-friendly R package that simplifies and standardises the experimental process for machine behaviour studies, offering a valuable tool for researchers in this field.

Xufeng Duan

Shixuan Li

Zhenguang G. Cai

MacBehaviour: An R package for behavioural experimentation on large language models

MacBehaviour：一个用于大型语言模型行为实验的R包

Abstract This article develops a comprehensive database comprising 5956 German affective norms specifically tailored for the study of organizational atmospheres through computational verbal language analysis. This dictionary adopts both dimensional and categorical approaches. The theoretical foundation of this study is the circumplex model of affective atmospheres. Similar to established methodologies, each word is rated based on the dimensions of valence and arousal. Going beyond the dimensional approach, this article introduces a classification system with 11 distinct atmospheric categories, assigning the words to their corresponding categories. This dictionary represents the first attempt to apply computer-aided text analysis (CATA) to the study of organizational atmospheres, providing a practical tool to support research in this developing area.

Anna Eifert

Christian Julmi

5956 German affective norms for atmospheres in organizations (GANAiO)

5956 德国组织氛围情感规范 (GANAiO)

Abstract In the field of psychological science, behavioral performance in computer-based cognitive tasks often exhibits poor reliability. The absence of reliable measures of cognitive processes contributes to non-reproducibility in the field and impedes the investigation of individual differences. Specifically in visual search paradigms, response time-based measures have shown poor test–retest reliability and internal consistency across attention capture and distractor suppression, but one study has demonstrated the potential for oculomotor measures to exhibit superior reliability. Therefore, in this study, we investigated three datasets to compare the reliability of learning-dependent distractor suppression measured via distractor fixations (oculomotor capture) and latency to fixate the target (fixation times). Our findings reveal superior split-half reliability of oculomotor capture compared to that of fixation times regardless of the critical distractor comparison, with the reliability of oculomotor capture in most cases falling within the range that is acceptable for the investigation of individual differences. We additionally find that older adults have superior oculomotor reliability compared with young adults, potentially addressing a significant limitation in the aging literature of high variability in response time measures due to slower responses. Our findings highlight the utility of measuring eye movements in the pursuit of reliable indicators of distractor processing and the need to further test and develop additional measures in other sensory domains to maximize statistical power, reliability, and reproducibility.

Andy J. Kim

Laurent Grégoire

Brian A. Anderson

Reliably measuring learning-dependent distractor suppression with eye tracking

可靠地使用眼动追踪测量学习依赖的分心抑制

Abstract Research involving brands has increased substantially in recent decades. However, no extensive and free dataset of consumer responses to branding stimuli exists. The present research develops and validates such a dataset, which we call the Brand Recognition and Attitude Norms Database ( BRAND ). BRAND is the most comprehensive set of methodologically transparent, freely available, research-relevant consumer responses to branding stimuli, with measures of familiarity (awareness), liking (attitudes), and memory (recognition) of more than 500 top brands and their logos, spanning 32 industries. BRAND includes 5,356 primary datapoints aggregated from 244,400 raw datapoints (i.e., individual familiarity, liking, and memory responses) collected from 2000 US-resident consumers in 2 years (i.e., 2020 and 2024). The data exhibit good reliability, face validity, external validity, robustness across samples and time, cross-validity, and discriminant validity. BRAND can be broadly useful for testing hypotheses involving responses to brands, and for selecting stimuli in any study involving brands or logos. Thus, BRAND can facilitate research not only in consumer behavior and psychology but also in several related academic disciplines (e.g., economics, management, marketing).

Carolina Raffaelli

Elena Bocchi

Zachary Estes

James S. Adelman

BRAND: Brand recognition and attitude norms database

品牌：品牌识别与态度规范数据库

Abstract Eye tracking technology has become increasingly prevalent in scientific research, offering unique insights into oculomotor and cognitive processes. The present article explores the relationship between scientific theory, the research question, and the use of eye-tracking technology. It aims to guide readers in determining if eye tracking is suitable for their studies and how to formulate relevant research questions. Examples from research on oculomotor control, reading, scene perception, task execution, visual expertise, and instructional design are used to illustrate the connection between theory and eye-tracking data. These examples may serve as inspiration to researchers new to eye tracking. In summarizing the examples, three important considerations emerge: (1) whether the study focuses on describing eye movements or uses them as a proxy for e.g., perceptual, or cognitive processes, (2) the logical chain from theory to predictions, and (3) whether the study is of an observational or idea-testing nature. We provide a generic scheme and a set of specific questions that may help researchers formulate and explicate their research question using eye tracking.

Roy S. Hessels

Antje Nuthmann

Marcus Nyström

Richard Andersson

Diederick C. Niehorster

Ignace T. C. Hooge

The fundamentals of eye tracking part 1: The link between theory and research question

眼动追踪基础 第1部分：理论与研究问题之间的联系

Abbreviation	Behav. Res. Methods
Journal Impact	4.52
Quartiles(Global)	PSYCHOLOGY, MATHEMATICAL(Q1)

ISSN	1554-351X, 1554-3528
h-index	171
Top Journals	Yes

Publication Information	Publisher: Springer Nature，Publishing cycle: 6 issues per year，Journal Type: journal，Open Access Journals: No
Basic data	Year of publication: 2004，Proportion of original research papers: 98.21%，Self Citation Rate:8.70%， Gold OA Rate: 52.53%

Behavior Research Methods

Journal Citation Format

A journal article with 1 author

A journal article with 2 authors

A journal article with 3 authors

A journal article with 5 or more authors

Books Citation Format

Thesis Citation Format

Web sites Citation Format

Patent Citation Format

Staying up late manually editing references? ivySCI automatically matches journals and helps you generate references with a single click.

Share Submission Experience