Reliability and Validity of Ecological Momentary Assessment Response Time–Based Measures of Emotional Clarity: Secondary Data Analysis


IntroductionBackground

Emotion regulation is highly relevant to subjective well-being from both hedonic and eudaimonic perspectives. According to the hedonic perspective, well-being is the experience of happiness or the occurrence of positive affect (PA) and absence of negative affect (NA) []. In the eudaimonic perspective, well-being arises when individuals live with a sense of growth, meaningfulness, and purpose []. People often engage in emotion regulation to obtain hedonic benefits (eg, feel more PA and reduce NA) [], but eudaimonic motivations have been found to be important as well [] (eg, downregulation of negative emotions to achieve a sense of growth in one’s ability to handle daily stressors).

An important aspect of emotion regulation is emotional clarity, a person’s ability to lucidly identify the type of emotion they are experiencing []. Emotional clarity is highly relevant to the James Gross Model of Emotion Regulation []. The model consists of emotion regulation strategies that are either “antecedent-focused” or “response-focused,” which refers to whether the strategy is used before or after an emotional response fully develops. In the updated emotion regulation model of Gross, understanding and identifying one’s emotions accurately (ie, emotional clarity) are precursors to both these types of emotion regulation strategies []. Therefore, individuals with low emotional clarity are less likely to use emotion regulation strategies (as they are failing to identify the need for them), which can negatively impact well-being. Lower emotional clarity has often been associated with reduced mental health [-], although there are exceptions. For instance, prior research has suggested that higher emotional clarity may be adaptive primarily for individuals who do not have very frequent and strong experiences of negative emotions but maladaptive for those who frequently have strong feelings of NA [].

Both direct and indirect measures of emotional clarity have been developed [,]. Direct assessments involve the metacognitive task of reflecting on one’s emotional clarity level, while indirect assessments measure the performance of a task relevant to emotional clarity (ie, answering emotion items) and do not require self-insight []. Emotional clarity is commonly directly assessed with cross-sectional self-report measures such as the clarity subscales of the Trait Meta-Mood Scale [] and the Difficulties in Emotion Regulation Scale (DERS) [], but indirect measures have been argued to have potential advantages over self-report assessments [,]. For instance, they could help avoid possible issues with subjective reports, including poor insight into emotional clarity and the possibility of social desirability bias (ie, participants not wanting to report uncertainty about their feelings) [,]. However, for the potential utility to be realized, further investigations of the validity of indirect measures of emotional clarity are needed.

Assessing Emotional Clarity With Item Response Times

Response times (RTs) to emotion questions in ecological momentary assessments (EMAs) have been argued to be indirect measures of emotional clarity at the momentary (within-person) level []. Theoretically, the greater an individual’s momentary affective clarity, the less time should be needed to provide a rating of momentary affect [], whereas longer RTs to affect items should be indicative of lower emotional clarity. Evidence supporting this theory has been found, such as shorter RTs to affect items being associated with better momentary emotion regulation and mood []. However, emotional clarity may be confounded with emotional intensity [], and evidence suggests the validity of RTs as a measure of affective clarity is enhanced by controlling for emotional intensity at the within-person (and not between-person) level [].

There was no strong evidence that the study-long aggregates of emotion item RTs (between-person level) could act as indicators of trait emotional clarity [,]. These aggregates were found to not have significant relationships with global measures of emotional clarity and have inconsistent relationships with global emotion regulation measures [,]. Suggested reasons for the lack of a relationship between global measures of emotional clarity and the aggregate of emotion item RTs include a modality difference (ie, self-report vs indirect behavior-based assessment), low conceptual correspondence (ie, different forms of emotional clarity are being assessed), and difference in assessment timing (ie, 1 time vs repeated EMA measurements) [,]. The relationships between the study-long aggregate of emotion item RTs and subjective well-being variables of relevance to emotional clarity (eg, depression and anxiety) [,] were not examined, which could have served as useful additional convergent validity tests. Finally, the possibility that processing speed had a confounding effect on correlations between study-long aggregates of emotion item RTs and other variables was not investigated. In prior research, RTs to emotion EMA items have been found to have moderate correlations with processing speed measures [], suggesting that individual differences in emotion item RTs may at least in part be attributable to processing speed.

Assessing Emotional Clarity With the Drift Rate Parameter

Another indirect measure of emotional clarity was recently proposed, drift rate, which is computed using the drift-diffusion model []. This model, which is often used in cognitive psychology, was explicitly developed to disentangle different components of RTs []. The drift-diffusion model proposes that decisions (eg, choosing responses on EMA items) are made through the accumulation of information until a threshold of sufficient information (as determined by the individual) is reached []. Decisions can be fast if the speed of information accumulation (ie, drift rate) is fast, if the threshold for a decision (ie, boundary separation or response caution) is low, or both. The D-diffusion item response theory (IRT) model is an IRT version of the drift-diffusion model that was specifically designed for the analysis of self-report ratings, such as emotion ratings []. In the context of answering mood questions, the D-diffusion IRT model additionally considers that RTs may also be fast if extremes of the emotion are experienced (ie, very high or low levels), making the provision of ratings more straightforward []. When the D-diffusion model is applied to EMA responses and their RTs, it can take into account all the aforementioned influences on RTs and output drift rate. In the EMA context, drift rate can be interpreted as the speed of access to information relevant to the question being asked [,], which here is information regarding emotions. A more detailed description of how the drift rate parameter was computed can be found in the Emotional Clarity Measure 2: Drift Rate From the Drift-Diffusion Model subsection in the Methods section.

A person would be considered to have high emotional clarity when responding both fast and carefully to emotion items, which differs from how emotional clarity assessed via RTs considers only speed. As the absolute difference between a person’s NA level and the level of NA captured by an item increases, the D-diffusion model assumes that an individual would be expected to have faster RTs as a result of the so-called “distance-difficulty” principle, a well-established phenomenon in the RT literature [], whereby the more items contrast with a person’s state, the easier they are. For instance, an individual with a very low NA would be expected to quickly respond to an item asking about being scared (an item often associated with a high NA) [], whereas the same individual would be expected to require a longer RT for an item asking about irritability (which has been associated with a low NA) []. According to the D-diffusion model, response caution is low when a person responds similarly quickly (or slowly) to all items regardless of their content (an indication that the person did not answer carefully). Assuming a particular observed item RT, when response caution is lower (ie, less information is gathered), drift rate (ie, the rate of information accumulation or information divided by time) would also be lower. Conversely, for a person with a higher response caution, the estimated drift rate (and emotional clarity) would be greater for the same RT.

Our initial evidence suggested that the drift rate parameter derived from EMA NA items may be an indicator of emotional clarity of low versus high NA, including expected relationships (ie, negative associations) at the between-person level with neuroticism and depression [], but we did not account for factors aside from emotional clarity that could impact drift rate. For instance, drift rate could be impacted by individual differences in the general speed of responding to questionnaires (eg, due to reading speed, motor behavior, and familiarity with computer use). Studies on emotional clarity measured by survey item RTs had accounted for individual differences in this baseline speed of responding by adjusting for it [], but this was not done in our prior study []. Cognitive processing speed was hypothesized to also potentially impact drift rate but was also not adjusted for, as the measure was not available in the prior study [].

ObjectivesTrait Emotional Clarity

There has been substantial prior research and interest in examining emotional clarity as a trait [,,], but further research on the indirect (instead of direct) measurement of individual differences in emotional clarity via EMA data is needed. Compared to traditional cross-sectional self-report measures, indirect measurement of individual differences in emotional clarity potentially has the advantage of less susceptibility to self-report biases stemming from causes such as social desirability and poor insight [,]. Furthermore, if an emotion is being assessed via EMA, indirect assessment of emotional clarity via emotion items affords the possibility of capturing individual differences in emotional clarity without burdening participants with additional items. The use of EMA methodology is ubiquitous in a broad range of fields [-], and the use of EMA emotion items is commonplace []. Indirect assessment of trait emotional clarity would, therefore, make the investigation of emotional clarity possible for a large number of EMA data sets without additional emotional clarity items.

The focus of this paper was to examine the reliability and validity of 2 RT-based indirect indicators of individual differences in emotional clarity among adults with type 1 diabetes (T1D). One indicator was the average of repeated measures of RTs to emotion items, and the other was the average of repeated measures of drift rate (ie, the speed of accessing information about one’s current affect) derived from emotion items. In validity testing, in contrast to prior work [], individual differences in the baseline speed of responding and processing speed were controlled for. We examined data from an EMA study of adults with T1D []. EMA surveys (which included emotion items) were completed 5 to 6 times a day (depending on the participants’ sleep schedule) for 2 weeks, and the RTs for each item were recorded. Notably, RT-based metrics can vary within people, and their study-long averages can vary across people. Multilevel modeling was used to account for both these potential sources of variance.

Emotional clarity may be of particular relevance for adults with T1D. Compared to the general population, adults with T1D may be exposed to stressors more frequently, specifically emotional distress related to the daily care of diabetes. A prior study estimated that performing all recommended diabetes self-management activities would require >2 hours daily []. Given such burden and associated diabetes distress (emotional distress specific to the daily care of diabetes), individuals with diabetes are more likely to experience lower subjective well-being, such as more symptoms of depression, compared to healthy populations []. Diabetes distress has been found to be negatively associated with emotion regulation ability []. Therefore, emotional clarity, a possible precursor to emotion regulation [], may be integral for adults with T1D to cope with the burden of the condition. Poor coping with diabetes can lead to the neglect of diabetes self-management behaviors, which can amplify the health consequences of diabetes. Greater diabetes distress has been associated with lower adherence to insulin regimens [,], while greater depressive symptoms have been associated with lower adherence to diet, exercise, and glucose testing recommendations [].

Reliability

The reliability of the proposed measures for emotional clarity was investigated by examining the test-retest stability of the measures across EMA measurement occasions.

Validity

The validity of the RT-based indicators of emotional clarity was tested by examining their associations with well-validated measures of relevance to emotional clarity. In forming our hypotheses (summarized in ), we made a distinction between the clarity of PA and the clarity of NA because of prior research suggesting that the latter had associations with mental health while the former did not []. Therefore, we speculated that the awareness of NA is a more direct precursor to the application of coping strategies and successful coping than the awareness of PA.

Table 1. Hypothesized associations of the negative affect (NA) and positive affect (PA) clarity indicators with subjective well-being and emotion regulation.
Emotional clarity indicator
NA drift ratePA drift rateRTa for NA itemsbRT for PA itemsSubjective well-being
Satisfaction with lifePositiveNullPositiveNull
NeuroticismNegativeNullNegativeNull
DepressionNegativeNullNegativeNull
AnxietyNegativeNullNegativeNull
Diabetes distressNegativeNullNegativeNullEmotion regulation and its 6 components
Emotion regulation difficulties (overall)NegativeNullNegativeNull
Limited strategiesNegativeNullNegativeNull
NonacceptanceNegativeNullNegativeNull
Impulse control difficultiesNegativeNullNegativeNull
Difficulties with goal directednessNegativeNullNegativeNull
Lack of awarenessNegativeNegativeNegativeNegative
Lack of emotional clarityNegativeNegativeNegativeNegative

aRT: response time.

bMultiplied by –1 so that higher values indicate greater emotional clarity.

Hypothesized Associations With Subjective Well-Being

Past literature has found that increased emotional clarity and emotion regulation ability, as assessed by questionnaires or RTs to emotion items, were associated with greater subjective well-being, including greater life satisfaction [], lower neuroticism [], lower depression [], fewer anxiety symptoms [], and less diabetes distress []. However, following the results of the study by Thompson et al [], we hypothesized that these relationships should hold only for indicators of NA clarity, not PA clarity.

Hypothesized Associations With Emotion Regulation

We considered the valence of emotions in the generation of our hypotheses regarding associations between passively collected indicators of emotional clarity and emotion regulation, given previous work showing that the clarity of positive emotions had different associations with other measures (eg, neuroticism and depression) compared to the clarity of negative emotions []. The DERS [] has 6 subscales representative of emotion regulation components (listed in ), as well as an overall score. Of the 6 DERS subscales, 4 (67%) specifically assess problems with regulating NA (ie, limited access to emotion regulation strategies when upset, nonacceptance of negative emotional responses, impulse control difficulties when upset, and difficulties with goal-directed behaviors when upset); we hypothesized that greater difficulties indicated on each of these component scales would be associated with lower NA clarity on the proposed RT-based measures [], whereas we did not expect them to be associated with PA clarity on the RT-based measures (). That is, we expected NA clarity to precede and hence be more relevant to NA regulation than PA clarity, consistent with prior findings of associations between neuroticism and NA clarity, but not PA clarity []. The remaining 2 (33%) components of emotion regulation (ie, a lack of emotional awareness and lack of emotional clarity) are not specific to the regulation of NA []; therefore, we hypothesized that they would be associated with the clarity of both NA and PA using the RT-based measures. Notably, 1 of these 2 components assesses self-reported emotional clarity; we expected that this component would have associations of a greater magnitude with RT-based measures of NA and PA clarity compared to other emotion regulation subscales. Finally, we hypothesized an association between the DERS total score and indicators of NA clarity but not indicators of PA clarity because 4 (67%) of the 6 DERS subscales were relevant to emotion regulation when experiencing NA.

Adjustment by Individual Differences in RT and Processing Speed

We examined whether adjusting the RT-based emotional clarity indicators by individual differences in RT and participant processing speed would affect the results of the convergent or divergent validity tests. Both RTs to survey items and drift rate were expected to not be purely indicators of emotional clarity but likely also be impacted by processing speed [,,] and differences in the baseline speed of responding []. Therefore, we examined the robustness of the results of validity testing when statistically adjusting for both these variables.


MethodsOverview

The analyzed data were from an EMA study focused on investigating the relationships among momentary blood glucose level, emotional state, and functioning in adults with T1D []. Participants were recruited from 3 clinical sites through health care provider referrals, mailings, flyers, and emails. Inclusion criteria were having a diagnosis of T1D, being able to speak and read English or Spanish, and the ability and willingness to carry out study procedures (eg, completion of EMAs and cognitive tests on smartphones). Study procedures included the completion of baseline surveys, training in the use of study devices, 2 weeks of 5 to 6 EMAs and ambulatory cognitive tests daily, and follow-up surveys. EMA surveys began at participants’ selected wake-up time each day and were administered at 3-hour intervals after that until sleep time. If a participant reported that they would likely be sleeping by the time of the sixth survey (ie, 15 hours after the first survey), then they were given the option to complete 5 surveys daily instead of 6. To encourage EMA compliance, 3 brief check-in emails or calls were scheduled with study staff. In addition, if EMA survey completion was low, then study staff would contact the participant to query if any support was required. The study procedures are described in greater depth in a protocol paper [].

Ethical Considerations

All study procedures were approved by the University of Southern California’s Institutional Review Board (proposal #HS-18-01014). Informed consent was provided before study participation. Participants were compensated US $200 via a reloadable debit card for completion of all study procedures. Study data were deidentified before analysis.

MeasuresRT-Based Measures of Emotional Clarity

The clarity of PA was assessed with RTs to EMA items about how happy, content, enthusiastic, or excited participants felt “right now,” while the clarity of NA was assessed with RTs to EMA items asking how tense, upset, sad, or disappointed participants felt in the moment. These emotion adjectives were taken from the “Stress and Working Memory” study [] and were chosen because they mapped neatly onto the circumplex model of affect []. That is, there were 2 items in each of the 4 circumplex dimensions (ie, unpleasant and activated, unpleasant and deactivated, pleasant and activated, and pleasant and deactivated), thereby ensuring that a range of emotion types was represented. The responses were all given on slider scales from 0 (not at all) to 100 (extremely). These emotion items were administered at every EMA prompt using the mobile EMA app (ilumivu []). Items were presented one at a time on study-provided smartphones. For each item, RTs were recorded in milliseconds. RTs that were deemed too fast (ie, <0.2 seconds) or too slow (ie, >30 seconds) were set to missing for analyses (5979/461,896, 1.29% of the observations) because such outliers could be indicative of careless responding or distractions during survey completion [,].

Emotional Clarity Measure 1: Median RTs

NA and PA clarity were computed as the median RT of the 4 NA items and the 4 PA items at each EMA prompt [,] (RTs were multiplied by –1 such that higher values indicate greater clarity). In this paper, median RT for NA items will be referred to as NA RT and median RT for PA items as PA RT.

Following prior research, the median RTs were adjusted for the baseline speed of responding to partial out individual differences in RT stemming from factors such as reading and screen tapping speed [,]. We assessed participants’ baseline speed by taking the median RT across all EMA occasions on a multiple-choice question asking what they were doing immediately before the survey.

Emotional Clarity Measure 2: Drift Rate From the Drift-Diffusion Model

Drift rates for both NA and PA items were calculated for each EMA following procedures described in detail in a prior study [] with software code available []. In brief, we estimated the drift rates for each person and EMA measurement occasion using the IRT based-variant of the drift-diffusion model that was specifically developed for use with self-report (eg, EMA) items. Because the IRT model requires binary variables, responses to PA and NA items were converted into dichotomous variables such that responses below the midpoint of the scale were coded as 0, while responses at or above the midpoint of the scale were coded as 1. Previous analyses have shown that drift rate measures derived from continuous items that were dichotomized demonstrate convergent validity with items that were already presented to respondents in a binary response format []. Next, we examined whether the dichotomized PA and NA item sets were unidimensional, a condition necessary for the calculation of drift rate; we conducted a confirmatory factor analysis in Mplus (version 8.8; Muthén & Muthén) [] using the weighted least square mean and variance adjusted estimator, using cluster-robust SEs to account for the nesting of multiple EMA measurement occasions within individuals. We examined whether fit indices were within the traditional ranges for acceptable model fit, including a root mean square error of approximation (RMSEA) of at least <0.08, comparative fit index (CFI) and Tucker-Lewis Index (TLI) of at least >0.90, and standardized root mean square residual (SRMR) of <0.08 []. Within and between-person reliability (McDonald omega) coefficients were also computed for the dichotomized and nondichotomized NA and PA items [].

A drift-diffusion model was then applied to the RTs and dichotomized response values for PA and NA items using the diffIRT package in R (R Foundation for Statistical Computing) [], where drift rate and RTs were modeled as latent factors. Factor score estimates for the drift rate parameter were then calculated for each EMA occasion, separately for NA and PA. To examine the fit of the drift-diffusion model on the PA and NA item sets, we examined the level of consistency between the observed and diffusion model–predicted RT distributions with histograms and density plots.

The drift rate parameters used in our primary analyses are a processed version of the drift rate parameters from the diffusion IRT models referred to as the absolute drift rate, computed as the mean absolute difference between the drift rate parameter factor scores and the item difficulty levels. The drift rate parameter is an estimation of a person’s tendency to report high NA (or PA) in a moment after taking into account both a person’s responses and item RTs. However, emotional clarity should be indicated by the speed in carefully accessing one’s mood regardless of its valence (eg, high or low NA). Therefore, following the distance-difficulty hypothesis-informed formula for the speed of information accumulation in the D-diffusion model [], we found the absolute value of the difference between the drift rate parameter and average item difficulty and operationalized this absolute drift rate as emotional clarity. These absolute drift rates were then log transformed to normalize their distributions. When used in analyses, drift rates were also adjusted by baseline speed.

Other Measures

The measures used for convergent or divergent validity testing were completed before (“baseline”) or after (“follow-up”) the EMA study period. Life satisfaction was assessed with the Satisfaction with Life Scale [], neuroticism with the Ten-Item Personality Inventory [], depression with the Patient Health Questionnaire [], anxiety with the Generalized Anxiety Disorder Scale [], diabetes distress with the Problem Areas in Diabetes Scale short form [], and emotion regulation with the DERS short form (DERS-SF) []. The Ten-Item Personality Inventory, Patient Health Questionnaire, Generalized Anxiety Disorder Scale, and DERS-SF were administered at baseline, while the Satisfaction with Life Scale and Problem Areas in Diabetes Scale short form were completed at follow-up [].

Processing speed was assessed with the Symbol Search task [], an ambulatory cognitive test administered as part of every EMA prompt []. The Symbol Search task captured perceptual speed, which is a component of processing speed [,]. Participants were presented with 2 cards at the top and 2 cards at the bottom of the phone screen, each with 2 symbols. As quickly as they could, they were asked to choose the card at the bottom of the screen that matched with one of the cards on top. The task consisted of 20 trials, and processing speed was measured as the median RT in accurate trials, only for sessions with at least 70% (14/20) matching accuracy []. Symbol Search RTs were calculated such that higher values indicate faster processing speed.

Statistical AnalysesReliability

Reliability was assessed for each of the emotional clarity indicators: NA drift rate, PA drift rate, NA RT, and PA RT. It was calculated using the following formula: between-person reliability=variance (between-person)/(variance [between-person] + variance [within-person]/n) [], where between-person variance is the variance in the average of scores across measurement occasions (ie, EMA prompts), within-person variance is the variance of scores across measurement occasions within a person, and n is the number of measurement occasions. Between and within-person variance were calculated with multilevel models, with EMA prompts nested in individuals, where the measure of interest (eg, the NA drift rate) was specified at both levels 1 and 2. To examine how many measurement occasions would be needed to obtain acceptable reliability (≥0.7) for each emotional clarity indicator, we estimated how reliability changed as a function of the number of measurement occasions, moving from 2 EMA prompts to a maximum of 70 prompts. Mplus (version 8.10) [] was used for reliability analyses via the package MplusAutomation [] in the statistical software R (The R Foundation) [].

Validity

Validity testing was performed for average NA drift rate, PA drift rate, NA RT, and PA RT. To account for the nested data structure, with multiple EMA prompts nested in individuals, we estimated correlation coefficients between the emotional clarity indicators and other measures using multilevel structural equation models (MSEMs). Multilevel variables with both within- and between-person variance (NA drift rate, PA drift rate, NA RT, PA RT, and processing speed) were specified at both level 1 (within-person) and level 2 (between-person), with latent means estimated at level 2 of the MSEM. As all cross-sectional measures only contained between-person variance, they were entered into the MSEM at level 2 and allowed to correlate with the NA drift rate, PA drift rate, NA RT, and PA RT variables. To adjust for individual differences in baseline speed, NA drift rate, PA drift rate, NA RT, and PA RT were regressed on baseline speed at level 2 of the MSEM. In addition, covariances were specified between baseline speed and all other level-2 variables. Prior research indicated that RTs to tasks were affected by the time of day [,]. Therefore, at level 1, all the RT-based metrics were adjusted for (ie, regressed on) the time of day, coded as a categorical variable, where a participant’s first survey per day was categorized as taking place in the morning, their final scheduled survey of the day as taking place in the evening, and all their surveys in between as taking place midday. The reference group was “midday,” meaning that at level 2, the latent means for the RT-based metrics were for midday surveys.

Various sensitivity tests were also conducted. Separate multilevel regression models explored whether adjustment for emotional intensity impacted the relationships between RT and each cross-sectional measure, such that NA RT and PA RT were additionally regressed on linear and quadratic terms of overall NA and PA ratings (ie, average rating across NA or PA items within an EMA survey), respectively. In supplemental analyses in which all the proposed emotional clarity indicators were controlled for processing speed, they were all regressed on processing speed at level 2. Finally, we tested whether the association between NA and PA drift rate and other measures would differ if the drift metrics were computed from mood items that were dichotomized at each person’s mean NA and PA response rather than the scale midpoint. For all analyses, data from all participants were included regardless of completion rates because MSEMs estimate latent averages of variables at level 1 that account for potential unreliability stemming from sparse participant data []. All validity analyses were conducted in Mplus (version 8.10) [] using maximum likelihood with robust SEs. Code for both the reliability and validity analyses is provided [].


ResultsDescriptive Statistics

Characteristics of the study sample, 196 adults with T1D, are shown in . The median EMA completion rate over the 2-week study period was 92% (IQR 11%).

Descriptive statistics for the EMA variables are presented in . Distributions for RTs to individual NA and PA items are shown in Figures S1 and S2 in , respectively. Tables S1 and S2 in show the between-person correlations between (unadjusted) study measures.

A unidimensional model was found to fit both the (dichotomized) 4 NA and 4 PA items acceptably, justifying the calculation of drift rates for both types of items. For NA, χ22=10.6, P=.005; CFI=0.998; TLI=0.994; RMSEA=0.018; and SRMR=0.018, while for PA, χ22=53.3, P<.001; CFI=0.989; TLI=0.966; RMSEA=0.044; and SRMR=0.031. All these values were within commonly suggested ranges for acceptable model fit []. The within-person omega estimate for the 4 dichotomized NA items was 0.710, while the between-person omega estimate was 0.938. For the 4 dichotomized PA items, the within-person omega estimate was 0.674, and the between-person omega estimate was 0.939. The within-person omega estimate for the 4 nondichotomized NA items was 0.793, while the between-person omega estimate was 0.955. For the 4 nondichotomized PA items, the within-person omega estimate was 0.773, and the between-person omega estimate was 0.937. For all PA and NA items, the observed RT distributions (histograms) were consistent with the drift-diffusion model–predicted RT distributions as per density plots of these RTs (Figures S1 and S2 in ), indicating a good fit overall for the D-diffusion IRT model [].

Table 2. Participant characteristics (N=196).CharacteristicValuesAge (y), mean (SD; range)39.6 (14.3; 18-75)Sex n (%)
Male88 (44.9)
Female108 (55.1)
Other0 (0)Ethnicity, n (%)
African American29 (14.8)
Asian7 (3.6)
Latino80 (40.8)
White56 (28.6)
Multiethnic14 (7.1)
Other6 (3.1)
Not reported4 (2)Employment status, n (%)
Full time69 (35.2)
Part time23 (11.7)
Full-time homemaker9 (4.6)
Student18 (9.2)
Unemployed27 (13.8)
Retired15 (7.7)
Disabled23 (11.7)
Other8 (4.1)
Not reported4 (2)Annual household income (US $), n (%)
<25,00047 (24)
25,000-49,99943 (21.9)
50,000-74,99915 (7.7)
≥75,00040 (20.4)
Not provided51 (26)Mental healtha
SWLSb score, mean (SD; range)22.0 (7.5; 5-35)
TIPIc neuroticism score, mean (SD; range)3.2 (1.3; 1-7)
PHQd score, mean (SD; range)5.4 (4.3; 0-24)
PHQ score≥9 (moderate or higher depression), n (%)30 (15.3)
GADe score, mean (SD; range)4.6 (3.8; 0-21)
GAD score≥9 (moderate or higher anxiety), n (%)19 (9.7)
PAIDf score, mean (SD; range)8.0 (5.5; 0-20)
DERSg score, mean (SD; range)1.9 (0.6; 1-5)

aPossible score ranges for the surveys were listed. Only for the Generalized Anxiety Disorder Scale, the observed score range (0-19) was different from the possible range.

bSWLS: Satisfaction with Life Scale.

cTIPI: Ten-Item Personality Inventory.

dPHQ: Patient Health Questionnaire.

eGAD: Generalized Anxiety Disorder Scale.

fPAID: Problem Areas in Diabetes Scale assessing diabetes distress.

gDERS: Difficulties in Emotion Regulation Scale.

Table 3. Summary statistics for ecological momentary assessment (EMA) variables.EMA variableAll observations, mean (SD; range)Between-person varianceAverage within-person varianceICCaBetween-person variance of log within-person variancesNAb drift rate–0.05 (0.84; –2.43 to 2.31)0.190.540.270.27PAc drift rate–0.53 (0.83; –1.68 to 2.05)0.190.510.280.18NA RTd2.22 (1.70; 0.31 to 24.20)0.701.950.261.00PA RT2.39 (1.83; 0.22 to 28.24)0.842.020.290.89Sum of 4 NA items19.69 (20.26; 0 to 100)247.10243.150.501.60Sum of 4 PA items49.78 (23.87; 0 to 100)338.85327.010.511.40Sum of dichotomized NA items0.71 (1.21; 0 to 4)0.751.950.283.27Sum of dichotomized PA items2.43 (1.50; 0 to 4)1.051.880.361.64

aICC: intraclass correlation coefficient.

bNA: negative affect.

cPA: positive affect.

dRT: response time.

Reliability

Figure S3 in shows the between-person reliabilities as a function of the number of EMA prompts completed for each proposed emotional clarity indicator. For all indicators, reliability increased with more prompts, but each of the proposed emotional clarity indicators demonstrated acceptable reliability (ie, ≥0.70) with a relatively small number of EMA occasions. NA RT required 5 EMA prompts for acceptable reliability, and PA RT required 4 prompts. Both average NA and PA drift rates showed 0.70 reliability when 7 EMA prompts were completed.

Validity

Relationships between NA RT and other measures were not consistent with our hypotheses. No significant associations were found with subjective well-being or emotion regulation measures (; P values ranging from .08 to .98). PA RT was not significantly associated with any well-being or emotion regulation variable (; P values ranging from 25 to 93), except, unexpectedly, for diabetes distress (r=0.17; P=.009). After adjustment for processing speed, the associations between both NA RT and PA RT and diabetes distress were unexpectedly significant in a positive direction (r=0.14; P=.03 and r=0.20; P=.002, respectively). Adjustment for emotional intensity changed effects very minimally at the between-person level, consistent with the findings of a prior study [], so the results from that model were not reported here. Both NA RT and PA RT had significant associations with processing speed (r=0.25; P<.001 and r=0.21; P=.001, respectively).

The associations between NA drift rate and other measures were consistent with our hypotheses overall. Unexpectedly, NA drift rate was not related to the lack of emotional clarity (P=.13) or 3 of the other DERS subscales (; P values from .18 to .76). It was also not associated with life satisfaction (P=.17). However, a greater NA drift rate was significantly associated with lower neuroticism (r=–0.18; P=.01), depression (r=–0.27; P<.001), anxiety (r=–0.27; P<.001), and diabetes distress (r=–0.17; P=.005); lower overall difficulties with emotion regulation (total DERS score; r=–0.15; P=.03); less limited emotion regulation strategies (r=–0.15; P=.048); and lower lack of emotion awareness (r=–0.18; P=.009). Adjustment by processing speed resulted in minimal changes. When NA and PA drift rates were computed from mood items that were dichotomized at each person’s mean NA and PA ratings (rather than at the scale midpoint), the results showed mostly nonsignificant correlations with other measures (refer to Table S3 in ).

Table 4. Between-person correlations between emotional clarity indices and other measures. All correlations were adjusted for the baseline speed of responding and time of day, but only columns with adjusted values additionally had processing speed as a control variable.
NAa drift rateNA drift rate, adjustedbPAc drift ratePA drift rate, adjustedbNA RTd,eNA RT, adjustedb,ePA RTePA RT, adjustedb,eSubjective well-being
Satisfaction with life

r0.10.1–0.1–0.1–0.03–0.04–0.04–0.05

P value.17.18.09.09.67.57.51.45
Neuroticism

r–0.18–0.18–0.08–0.08–0.06–0.06–0.01–0.01

P value.01f.01f.29.29.51.44.91.85
Depression

r–0.27–0.270.030.03000.060.06

P value<.001f<.001f.73.73.98.99.47.45
Anxiety

r–0.27–0.27–0.09–0.09–0.09–0.09–0.03–0.03

P value<.001f<.001f.21.22.34.28.77.74
Diabetes distress

r–0.17–0.160.170.170.090.140.170.2

P value.005f.008f.009f.008f.14.03f.009f.002fEmotion regulation
DERSg (total)

r–0.15–0.160.030.030.030.010.050.03

P value.03f.01f.78.78.64.92.39.58

Limited strategies


r–0.15–0.150.030.03–0.04–0.04–0.03–0.03


P value.048f.04f.76.76.59.59.66.67

Nonacceptance


r–0.1–0.110.040.03–0.01–0.030–0.01


P value.18.13.64.66.87.61.93.85

Impulse control difficulties


r0.020.030.130.130.020.040.020.05


P value.76.65.18.18.79.39.67.33

Difficulties with goal directedness


r–0.07–0.08–0.11–0.110.110.090.080.06


P value.32.26.20.18.08.13.25.36

Lack of awareness


r–0.18–0.18–0.09–0.09–0.07–0.1–0.01–0.03


P value.009f.005f.20.18.35.19.84.64

Lack of emotional clarity


r–0.11–0.120.040.040–0.03

Comments (0)

No login
gif