230801_100946 taskus study 3 results

- see [[230220_230732 study 2 results|previous study results]] - [prereg](https://docs.google.com/document/d/1LAmkPtezuAv7a73NVAkrB5UOsuNA7Zc6XCT7wqNcGiQ/edit) # descriptives - excluded 3 users with repeated attempts ```r condition N 1: control 134 # previous study n = 199 2: treatment 105 ``` ![[results 2.png]] see [[230220_230732 study 2 results#plot|previous study figure]] below ![[fig2.png]] # models - [prereg](https://docs.google.com/document/d/1LAmkPtezuAv7a73NVAkrB5UOsuNA7Zc6XCT7wqNcGiQ/edit) ## H2 (false headlines only): truth ~ repetition * condition (barely significant interaction!) Preg model: We will begin by testing Hypothesis 2 by ﬁtting this model to only false headlines: `accuracy_rating ~ repetition * condition`. As robustness checks, we will ﬁt this model: `accuracy_rating ~ repetition * (condition + covariates)` (covariates are deﬁned below). - repetition: dummy centered -0.5/0.5 - condition dummy: 0/1 ```r # false headlines only # frequentist term results 1: (Intercept) b = 3.34, SE = 0.10, t(165) = 32.74, p < .001, r = 0.93 2: repetitionC b = 0.09, SE = 0.04, t(258) = 2.12, p = .035, r = 0.13 # barely! 3: conditionD b = −0.38, SE = 0.13, t(237) = −2.89, p = .004, r = 0.18 # sig 4: repetitionC:conditionD b = −0.15, SE = 0.07, t(258) = −2.25, p = .025, r = 0.14 # barely! # with covariates term results 1: (Intercept) b = 3.32, SE = 0.11, t(155) = 30.94, p < .001, r = 0.93 2: repetitionC b = 0.10, SE = 0.05, t(175) = 1.89, p = .060, r = 0.14 # ns 3: conditionD b = −0.25, SE = 0.15, t(156) = −1.70, p = .090, r = 0.14 4: ageZ b = 0.005, SE = 0.07, t(158) = 0.07, p = .945, r = 0.006 5: genderZ b = 0.03, SE = 0.07, t(156) = 0.39, p = .696, r = 0.03 6: aotZ b = −0.36, SE = 0.07, t(156) = −4.91, p < .001, r = 0.37 7: covidconcernZ b = −0.06, SE = 0.08, t(156) = −0.82, p = .414, r = 0.07 8: sesZ b = 0.12, SE = 0.07, t(155) = 1.63, p = .104, r = 0.13 9: attentionZ b = −0.03, SE = 0.07, t(156) = −0.43, p = .667, r = 0.03 10: educationZ b = −0.05, SE = 0.07, t(156) = −0.74, p = .461, r = 0.06 11: godZ b = −0.05, SE = 0.06, t(157) = −0.75, p = .456, r = 0.06 12: hireZ b = −0.14, SE = 0.07, t(155) = −1.93, p = .055, r = 0.15 # almost sig 13: repetitionC:conditionD b = −0.21, SE = 0.08, t(180) = −2.53, p = .012, r = 0.19 # more sig 14: repetitionC:ageZ b = −0.01, SE = 0.04, t(220) = −0.30, p = .767, r = 0.02 15: repetitionC:genderZ b = −0.02, SE = 0.04, t(166) = −0.56, p = .577, r = 0.04 16: repetitionC:aotZ b = −0.12, SE = 0.04, t(173) = −3.00, p = .003, r = 0.22 # significant!?! 17: repetitionC:covidconcernZ b = 0.01, SE = 0.04, t(157) = 0.36, p = .723, r = 0.03 18: repetitionC:sesZ b = −0.09, SE = 0.04, t(152) = −2.39, p = .018, r = 0.19 # sig 19: repetitionC:attentionZ b = −0.002, SE = 0.04, t(175) = −0.06, p = .953, r = 0.004 20: repetitionC:educationZ b = −0.03, SE = 0.04, t(158) = −0.68, p = .495, r = 0.05 21: repetitionC:godZ b = 0.006, SE = 0.04, t(186) = 0.16, p = .871, r = 0.01 22: repetitionC:hireZ b = −0.07, SE = 0.04, t(150) = −1.85, p = .066, r = 0.15 # almost sig term results term results 1: (Intercept) b = 3.31, SE = 0.11, t(151) = 30.48, p < .001, r = 0.93 2: repetitionC b = 0.10, SE = 0.05, t(173) = 1.92, p = .056, r = 0.14 # almost sig 3: conditionD b = −0.23, SE = 0.15, t(147) = −1.55, p = .124, r = 0.13 # ns 4: ageZ b = 0.01, SE = 0.09, t(149) = 0.17, p = .865, r = 0.01 5: genderZ b = 0.06, SE = 0.10, t(147) = 0.63, p = .532, r = 0.05 6: aotZ b = −0.43, SE = 0.10, t(147) = −4.24, p < .001, r = 0.33 7: covidconcernZ b = −0.04, SE = 0.09, t(147) = −0.43, p = .666, r = 0.04 8: sesZ b = 0.11, SE = 0.09, t(147) = 1.22, p = .224, r = 0.10 9: attentionZ b = −0.04, SE = 0.10, t(148) = −0.39, p = .698, r = 0.03 10: educationZ b = −0.01, SE = 0.09, t(147) = −0.13, p = .896, r = 0.01 11: godZ b = −0.15, SE = 0.09, t(149) = −1.70, p = .091, r = 0.14 12: hireZ b = −0.11, SE = 0.10, t(147) = −1.11, p = .269, r = 0.09 13: repetitionC:conditionD b = −0.19, SE = 0.08, t(177) = −2.34, p = .020, r = 0.17 # sig 14: repetitionC:ageZ b = −0.05, SE = 0.05, t(220) = −1.06, p = .291, r = 0.07 15: repetitionC:genderZ b = 0.04, SE = 0.05, t(161) = 0.68, p = .497, r = 0.05 16: repetitionC:aotZ b = −0.07, SE = 0.05, t(155) = −1.28, p = .201, r = 0.10 17: repetitionC:covidconcernZ b = 0.006, SE = 0.05, t(153) = 0.13, p = .894, r = 0.01 18: repetitionC:sesZ b = −0.07, SE = 0.05, t(163) = −1.42, p = .157, r = 0.11 19: repetitionC:attentionZ b = 0.04, SE = 0.05, t(172) = 0.72, p = .470, r = 0.06 20: repetitionC:educationZ b = −0.01, SE = 0.05, t(156) = −0.26, p = .798, r = 0.02 21: repetitionC:godZ b = −0.04, SE = 0.05, t(211) = −0.70, p = .482, r = 0.05 22: repetitionC:hireZ b = −0.03, SE = 0.06, t(164) = −0.63, p = .529, r = 0.05 23: conditionD:ageZ b = −0.07, SE = 0.14, t(149) = −0.50, p = .619, r = 0.04 24: conditionD:genderZ b = −0.11, SE = 0.15, t(147) = −0.72, p = .475, r = 0.06 25: conditionD:aotZ b = 0.15, SE = 0.15, t(148) = 1.00, p = .320, r = 0.08 26: conditionD:covidconcernZ b = −0.17, SE = 0.18, t(147) = −0.90, p = .370, r = 0.07 27: conditionD:sesZ b = −0.07, SE = 0.16, t(147) = −0.46, p = .647, r = 0.04 28: conditionD:attentionZ b = 0.06, SE = 0.15, t(148) = 0.39, p = .698, r = 0.03 29: conditionD:educationZ b = −0.13, SE = 0.15, t(147) = −0.88, p = .379, r = 0.07 30: conditionD:godZ b = 0.26, SE = 0.14, t(148) = 1.94, p = .054, r = 0.16 31: conditionD:hireZ b = −0.07, SE = 0.15, t(147) = −0.47, p = .636, r = 0.04 32: repetitionC:conditionD:ageZ b = 0.11, SE = 0.08, t(216) = 1.38, p = .168, r = 0.09 33: repetitionC:conditionD:genderZ b = −0.18, SE = 0.08, t(167) = −2.14, p = .034, r = 0.16 # sig 34: repetitionC:conditionD:aotZ b = −0.14, SE = 0.08, t(179) = −1.71, p = .089, r = 0.13 35: repetitionC:conditionD:covidconcernZ b = 0.02, SE = 0.10, t(167) = 0.23, p = .817, r = 0.02 36: repetitionC:conditionD:sesZ b = −0.05, SE = 0.09, t(162) = −0.64, p = .525, r = 0.05 37: repetitionC:conditionD:attentionZ b = −0.10, SE = 0.08, t(177) = −1.23, p = .220, r = 0.09 38: repetitionC:conditionD:educationZ b = −0.06, SE = 0.08, t(157) = −0.69, p = .491, r = 0.06 39: repetitionC:conditionD:godZ b = 0.06, SE = 0.07, t(196) = 0.86, p = .390, r = 0.06 40: repetitionC:conditionD:hireZ b = −0.06, SE = 0.08, t(152) = −0.73, p = .464, r = 0.06 term results # bayes Parameter | Mean | 95% CI | pd | Rhat | ESS --------------------------------------------------------------------------- (Intercept) | 3.34 | [ 3.13, 3.54] | 100% | 1.002 | 3893.00 repetitionC | 0.09 | [ 0.01, 0.18] | 98.25% | 1.000 | 41784.00 # sig conditionD | -0.38 | [-0.64, -0.12] | 99.80% | 1.002 | 3349.00 # sig repetitionC:conditionD | -0.15 | [-0.28, -0.02] | 98.69% | 1.000 | 40812.00 # sig # with covariates Parameter | Mean | 95% CI | pd | Rhat | ESS ---------------------------------------------------------------------------------- (Intercept) | 3.32 | [ 3.11, 3.54] | 100% | 1.002 | 6657.00 repetitionC | 0.10 | [-0.01, 0.20] | 97.05% | 1.000 | 38340.00 conditionD | -0.25 | [-0.55, 0.04] | 95.38% | 1.001 | 6660.00 ageZ | 4.53e-03 | [-0.13, 0.14] | 52.55% | 1.001 | 8227.00 genderZ | 0.03 | [-0.12, 0.17] | 65.25% | 1.001 | 7142.00 aotZ | -0.36 | [-0.51, -0.22] | 100% | 1.000 | 7694.00 covidconcernZ | -0.06 | [-0.21, 0.09] | 79.53% | 1.001 | 7524.00 sesZ | 0.12 | [-0.02, 0.26] | 94.75% | 1.001 | 7797.00 attentionZ | -0.03 | [-0.18, 0.11] | 65.75% | 1.001 | 6988.00 educationZ | -0.05 | [-0.19, 0.09] | 76.43% | 1.001 | 7785.00 godZ | -0.05 | [-0.17, 0.08] | 76.71% | 1.001 | 9422.00 hireZ | -0.14 | [-0.28, 0.01] | 97.10% | 1.001 | 7281.00 repetitionC:conditionD | -0.21 | [-0.36, -0.05] | 99.40% | 1.000 | 37528.00 repetitionC:ageZ | -0.01 | [-0.08, 0.07] | 61.48% | 1.000 | 51795.00 repetitionC:genderZ | -0.02 | [-0.10, 0.06] | 70.40% | 1.000 | 47453.00 repetitionC:aotZ | -0.12 | [-0.20, -0.04] | 99.84% | 1.000 | 49344.00 repetitionC:covidconcernZ | 0.01 | [-0.07, 0.09] | 63.56% | 1.000 | 47562.00 repetitionC:sesZ | -0.09 | [-0.17, -0.02] | 99.10% | 1.000 | 45771.00 repetitionC:attentionZ | -2.17e-03 | [-0.08, 0.08] | 52.18% | 1.000 | 47410.00 repetitionC:educationZ | -0.03 | [-0.10, 0.05] | 74.77% | 1.000 | 47838.00 repetitionC:godZ | 6.09e-03 | [-0.07, 0.08] | 56.88% | 1.000 | 48884.00 repetitionC:hireZ | -0.07 | [-0.15, 0.00] | 96.82% | 1.000 | 47657.00 Parameter | Mean | 95% CI | pd | Rhat | ESS --------------------------------------------------------------------------------------------- (Intercept) | 3.31 | [ 3.09, 3.53] | 100% | 1.000 | 12198.00 repetitionC | 0.10 | [ 0.00, 0.20] | 97.34% | 1.000 | 57990.00 # almost sig conditionD | -0.23 | [-0.53, 0.06] | 93.63% | 1.001 | 14909.00 # not sig ageZ | 0.01 | [-0.15, 0.18] | 56.81% | 1.001 | 17004.00 genderZ | 0.06 | [-0.13, 0.26] | 73.62% | 1.000 | 12736.00 aotZ | -0.43 | [-0.64, -0.23] | 100.00% | 1.001 | 13898.00 covidconcernZ | -0.04 | [-0.21, 0.14] | 65.86% | 1.001 | 14707.00 sesZ | 0.11 | [-0.07, 0.29] | 88.48% | 1.001 | 13220.00 attentionZ | -0.04 | [-0.23, 0.16] | 64.52% | 1.000 | 13621.00 educationZ | -0.01 | [-0.20, 0.17] | 55.47% | 1.001 | 13627.00 godZ | -0.15 | [-0.33, 0.02] | 95.50% | 1.000 | 18283.00 hireZ | -0.11 | [-0.32, 0.08] | 86.61% | 1.000 | 13394.00 repetitionC:conditionD | -0.19 | [-0.36, -0.03] | 98.92% | 1.000 | 59020.00 # sig repetitionC:ageZ | -0.05 | [-0.14, 0.04] | 85.50% | 1.000 | 62538.00 repetitionC:genderZ | 0.04 | [-0.07, 0.14] | 75.17% | 1.000 | 56814.00 repetitionC:aotZ | -0.07 | [-0.17, 0.04] | 89.99% | 1.000 | 55573.00 repetitionC:covidconcernZ | 6.88e-03 | [-0.08, 0.10] | 55.70% | 1.000 | 61060.00 repetitionC:sesZ | -0.07 | [-0.16, 0.03] | 92.33% | 1.000 | 59707.00 repetitionC:attentionZ | 0.04 | [-0.07, 0.14] | 76.43% | 1.000 | 53433.00 repetitionC:educationZ | -0.01 | [-0.11, 0.09] | 59.76% | 1.000 | 57985.00 repetitionC:godZ | -0.04 | [-0.13, 0.06] | 75.95% | 1.000 | 58966.00 repetitionC:hireZ | -0.03 | [-0.14, 0.08] | 73.40% | 1.000 | 55995.00 conditionD:ageZ | -0.07 | [-0.36, 0.21] | 68.62% | 1.000 | 17609.00 conditionD:genderZ | -0.11 | [-0.42, 0.19] | 76.38% | 1.000 | 14321.00 conditionD:aotZ | 0.15 | [-0.15, 0.46] | 84.08% | 1.001 | 15262.00 conditionD:covidconcernZ | -0.17 | [-0.54, 0.20] | 81.35% | 1.000 | 16847.00 conditionD:sesZ | -0.07 | [-0.39, 0.25] | 67.39% | 1.001 | 16919.00 conditionD:attentionZ | 0.06 | [-0.23, 0.36] | 65.16% | 1.001 | 14517.00 conditionD:educationZ | -0.13 | [-0.43, 0.16] | 80.85% | 1.000 | 16231.00 conditionD:godZ | 0.26 | [-0.01, 0.53] | 97.19% | 1.000 | 17350.00 conditionD:hireZ | -0.07 | [-0.37, 0.23] | 68.04% | 1.000 | 14047.00 repetitionC:conditionD:ageZ | 0.11 | [-0.05, 0.27] | 91.47% | 1.000 | 60997.00 repetitionC:conditionD:genderZ | -0.18 | [-0.34, -0.01] | 98.28% | 1.000 | 56568.00 # sig repetitionC:conditionD:aotZ | -0.14 | [-0.30, 0.02] | 95.58% | 1.000 | 54681.00 repetitionC:conditionD:covidconcernZ | 0.02 | [-0.17, 0.22] | 58.38% | 1.000 | 57287.00 repetitionC:conditionD:sesZ | -0.05 | [-0.23, 0.11] | 73.48% | 1.000 | 58268.00 repetitionC:conditionD:attentionZ | -0.10 | [-0.26, 0.06] | 88.81% | 1.000 | 56031.00 repetitionC:conditionD:educationZ | -0.06 | [-0.21, 0.10] | 75.63% | 1.000 | 59838.00 repetitionC:conditionD:godZ | 0.06 | [-0.08, 0.21] | 80.77% | 1.000 | 57093.00 repetitionC:conditionD:hireZ | -0.06 | [-0.22, 0.10] | 77.00% | 1.000 | 56916.00 ``` Binomial/logistic regression model (binarized truth ratings) ```r # freq term results 1: (Intercept) b = −0.24, SE = 0.26, z = −0.90, p = .367, r = −0.07 2: repetitionC b = 0.28, SE = 0.12, z = 2.45, p = .014, r = 0.08 # sig 3: conditionD b = −0.67, SE = 0.35, z = −1.89, p = .059, r = −0.18 # almost sig 4: repetitionC:conditionD b = −0.56, SE = 0.18, z = −3.16, p = .002, r = −0.15 # sign # with covariates term results 1: (Intercept) b = −0.31, SE = 0.29, z = −1.07, p = .284, r = −0.08 2: repetitionC b = 0.32, SE = 0.14, z = 2.32, p = .020, r = 0.09 # sig 3: conditionD b = −0.29, SE = 0.40, z = −0.73, p = .468, r = −0.08 # nto sig 4: ageZ b = 0.09, SE = 0.19, z = 0.46, p = .645, r = 0.02 5: genderZ b = 0.22, SE = 0.20, z = 1.11, p = .268, r = 0.06 6: aotZ b = −0.87, SE = 0.21, z = −4.26, p < .001, r = −0.23 # sig 7: covidconcernZ b = −0.08, SE = 0.21, z = −0.39, p = .695, r = −0.02 8: sesZ b = 0.30, SE = 0.20, z = 1.51, p = .132, r = 0.08 9: attentionZ b = −0.31, SE = 0.20, z = −1.56, p = .119, r = −0.09 10: educationZ b = 0.01, SE = 0.20, z = 0.06, p = .951, r = 0 11: godZ b = −0.22, SE = 0.18, z = −1.26, p = .209, r = −0.06 12: hireZ b = −0.44, SE = 0.20, z = −2.18, p = .029, r = −0.12 # sig (rate false headlines less true with longer tenure) 13: repetitionC:conditionD b = −0.56, SE = 0.22, z = −2.57, p = .010, r = −0.15 # sig 14: repetitionC:ageZ b = −0.003, SE = 0.12, z = −0.03, p = .978, r = 0 15: repetitionC:genderZ b = −0.12, SE = 0.11, z = −1.13, p = .258, r = −0.03 16: repetitionC:aotZ b = −0.22, SE = 0.12, z = −1.94, p = .052, r = −0.06 # almost sig 17: repetitionC:covidconcernZ b = 0.02, SE = 0.11, z = 0.17, p = .868, r = 0 18: repetitionC:sesZ b = −0.19, SE = 0.10, z = −1.95, p = .051, r = −0.05 # almost sig 19: repetitionC:attentionZ b = −0.07, SE = 0.11, z = −0.65, p = .515, r = −0.02 20: repetitionC:educationZ b = 0.03, SE = 0.10, z = 0.33, p = .743, r = 0.01 21: repetitionC:godZ b = −0.02, SE = 0.10, z = −0.25, p = .806, r = −0.01 22: repetitionC:hireZ b = −0.19, SE = 0.10, z = −1.81, p = .070, r = −0.05 # almost sign term results term results 1: (Intercept) b = −0.34, SE = 0.28, z = −1.21, p = .227, r = −0.09 2: repetitionC b = 0.30, SE = 0.14, z = 2.17, p = .030, r = 0.08 # sig 3: conditionD b = −0.28, SE = 0.40, z = −0.70, p = .484, r = −0.08 # ns 4: ageZ b = 0.06, SE = 0.24, z = 0.26, p = .799, r = 0.02 5: genderZ b = 0.41, SE = 0.26, z = 1.58, p = .113, r = 0.11 6: aotZ b = −1.25, SE = 0.28, z = −4.49, p < .001, r = −0.33 7: covidconcernZ b = 0.09, SE = 0.24, z = 0.38, p = .707, r = 0.02 8: sesZ b = 0.16, SE = 0.24, z = 0.67, p = .506, r = 0.04 9: attentionZ b = −0.24, SE = 0.26, z = −0.91, p = .363, r = −0.07 10: educationZ b = 0.13, SE = 0.24, z = 0.55, p = .582, r = 0.04 11: godZ b = −0.37, SE = 0.24, z = −1.55, p = .120, r = −0.10 12: hireZ b = −0.40, SE = 0.27, z = −1.48, p = .140, r = −0.11 13: repetitionC:conditionD b = −0.53, SE = 0.22, z = −2.40, p = .016, r = −0.14 # sig 14: repetitionC:ageZ b = −0.16, SE = 0.15, z = −1.09, p = .277, r = −0.04 15: repetitionC:genderZ b = −0.07, SE = 0.14, z = −0.50, p = .615, r = −0.02 16: repetitionC:aotZ b = −0.13, SE = 0.16, z = −0.79, p = .427, r = −0.04 17: repetitionC:covidconcernZ b = 0.01, SE = 0.12, z = 0.08, p = .932, r = 0 18: repetitionC:sesZ b = −0.19, SE = 0.13, z = −1.48, p = .139, r = −0.05 19: repetitionC:attentionZ b = −0.04, SE = 0.14, z = −0.27, p = .787, r = −0.01 20: repetitionC:educationZ b = 0.05, SE = 0.12, z = 0.37, p = .714, r = 0.01 21: repetitionC:godZ b = −0.04, SE = 0.13, z = −0.30, p = .765, r = −0.01 22: repetitionC:hireZ b = −0.01, SE = 0.14, z = −0.08, p = .939, r = 0 23: conditionD:ageZ b = −0.10, SE = 0.40, z = −0.26, p = .794, r = −0.03 24: conditionD:genderZ b = −0.47, SE = 0.41, z = −1.14, p = .254, r = −0.13 25: conditionD:aotZ b = 0.75, SE = 0.41, z = 1.83, p = .067, r = 0.20 26: conditionD:covidconcernZ b = −0.81, SE = 0.49, z = −1.64, p = .100, r = −0.22 27: conditionD:sesZ b = 0.10, SE = 0.43, z = 0.24, p = .814, r = 0.03 28: conditionD:attentionZ b = −0.03, SE = 0.40, z = −0.09, p = .931, r = −0.01 29: conditionD:educationZ b = −0.45, SE = 0.40, z = −1.13, p = .258, r = −0.12 30: conditionD:godZ b = 0.42, SE = 0.36, z = 1.17, p = .241, r = 0.12 31: conditionD:hireZ b = −0.24, SE = 0.40, z = −0.58, p = .559, r = −0.07 32: repetitionC:conditionD:ageZ b = 0.36, SE = 0.25, z = 1.46, p = .144, r = 0.10 33: repetitionC:conditionD:genderZ b = −0.15, SE = 0.22, z = −0.71, p = .478, r = −0.04 34: repetitionC:conditionD:aotZ b = −0.17, SE = 0.22, z = −0.78, p = .436, r = −0.05 35: repetitionC:conditionD:covidconcernZ b = 0.01, SE = 0.26, z = 0.06, p = .956, r = 0 36: repetitionC:conditionD:sesZ b = 0.12, SE = 0.21, z = 0.57, p = .572, r = 0.03 37: repetitionC:conditionD:attentionZ b = −0.13, SE = 0.21, z = −0.62, p = .538, r = −0.04 38: repetitionC:conditionD:educationZ b = −0.03, SE = 0.22, z = −0.12, p = .907, r = −0.01 39: repetitionC:conditionD:godZ b = −0.01, SE = 0.20, z = −0.05, p = .960, r = 0 40: repetitionC:conditionD:hireZ b = −0.34, SE = 0.21, z = −1.62, p = .106, r = −0.09 term results # bayes Parameter | Mean | 95% CI | pd | Rhat | ESS --------------------------------------------------------------------------- (Intercept) | -0.23 | [-0.78, 0.31] | 79.77% | 1.001 | 4392.00 repetitionC | 0.29 | [ 0.05, 0.52] | 99.02% | 1.000 | 29753.00 # sig conditionD | -0.67 | [-1.37, 0.07] | 96.41% | 1.002 | 4120.00 # almost sig repetitionC:conditionD | -0.56 | [-0.92, -0.20] | 99.90% | 1.000 | 29924.00 # sig # with covariates Parameter | Mean | 95% CI | pd | Rhat | ESS --------------------------------------------------------------------------------- (Intercept) | -0.30 | [-0.93, 0.32] | 83.48% | 1.001 | 6057.00 repetitionC | 0.33 | [ 0.02, 0.63] | 98.23% | 1.000 | 23610.00 # sig conditionD | -0.30 | [-1.19, 0.56] | 75.13% | 1.001 | 5865.00 # ns ageZ | 0.10 | [-0.32, 0.52] | 68.40% | 1.001 | 8068.00 genderZ | 0.22 | [-0.21, 0.67] | 84.22% | 1.002 | 5638.00 aotZ | -0.91 | [-1.36, -0.45] | 100% | 1.001 | 6713.00 # sig covidconcernZ | -0.08 | [-0.54, 0.36] | 63.83% | 1.001 | 6791.00 sesZ | 0.30 | [-0.13, 0.73] | 91.52% | 1.002 | 6482.00 attentionZ | -0.33 | [-0.76, 0.11] | 93.31% | 1.000 | 6509.00 educationZ | 0.01 | [-0.42, 0.44] | 52.72% | 1.000 | 6647.00 godZ | -0.24 | [-0.63, 0.15] | 88.85% | 1.000 | 8009.00 hireZ | -0.47 | [-0.91, -0.03] | 98.28% | 1.002 | 6431.00 # sig repetitionC:conditionD | -0.58 | [-1.06, -0.11] | 99.21% | 1.000 | 23630.00 # sig repetitionC:ageZ | 2.65e-04 | [-0.26, 0.26] | 50.10% | 1.000 | 33721.00 repetitionC:genderZ | -0.13 | [-0.36, 0.10] | 86.47% | 1.000 | 31273.00 repetitionC:aotZ | -0.24 | [-0.50, 0.02] | 97.10% | 1.000 | 28043.00 # almost sig repetitionC:covidconcernZ | 0.01 | [-0.22, 0.24] | 54.80% | 1.000 | 31666.00 repetitionC:sesZ | -0.19 | [-0.41, 0.02] | 95.96% | 1.000 | 30505.00 repetitionC:attentionZ | -0.07 | [-0.30, 0.16] | 73.76% | 1.000 | 30504.00 repetitionC:educationZ | 0.03 | [-0.20, 0.25] | 60.61% | 1.000 | 30737.00 repetitionC:godZ | -0.03 | [-0.25, 0.18] | 61.50% | 1.000 | 31043.00 repetitionC:hireZ | -0.20 | [-0.43, 0.03] | 95.78% | 1.001 | 30188.00 Parameter | Mean | 95% CI | pd | Rhat | ESS ---------------------------------------------------------------------------------------------- (Intercept) | -0.35 | [-1.00, 0.28] | 85.52% | 1.000 | 10656.00 repetitionC | 0.30 | [-0.01, 0.62] | 96.93% | 1.000 | 36761.00 # almost sig conditionD | -0.28 | [-1.22, 0.64] | 72.75% | 1.001 | 10973.00 # ns ageZ | 0.08 | [-0.48, 0.65] | 61.79% | 1.000 | 13309.00 genderZ | 0.44 | [-0.17, 1.05] | 92.22% | 1.000 | 10288.00 aotZ | -1.35 | [-2.01, -0.71] | 100.00% | 1.001 | 11628.00 covidconcernZ | 0.10 | [-0.44, 0.66] | 64.55% | 1.001 | 11749.00 sesZ | 0.17 | [-0.41, 0.72] | 72.42% | 1.000 | 11422.00 attentionZ | -0.25 | [-0.86, 0.37] | 79.12% | 1.001 | 10383.00 educationZ | 0.15 | [-0.42, 0.71] | 70.42% | 1.001 | 9950.00 godZ | -0.42 | [-0.97, 0.14] | 93.02% | 1.001 | 14191.00 hireZ | -0.43 | [-1.05, 0.22] | 90.98% | 1.001 | 10219.00 repetitionC:conditionD | -0.57 | [-1.08, -0.06] | 98.60% | 1.000 | 37182.00 # sig repetitionC:ageZ | -0.15 | [-0.49, 0.20] | 80.88% | 1.000 | 37951.00 repetitionC:genderZ | -0.07 | [-0.40, 0.24] | 67.72% | 1.000 | 32511.00 repetitionC:aotZ | -0.19 | [-0.58, 0.20] | 82.60% | 1.000 | 28082.00 repetitionC:covidconcernZ | 1.63e-03 | [-0.27, 0.28] | 50.62% | 1.000 | 37726.00 repetitionC:sesZ | -0.19 | [-0.49, 0.10] | 90.31% | 1.000 | 37094.00 repetitionC:attentionZ | -0.05 | [-0.38, 0.28] | 60.78% | 1.000 | 33770.00 repetitionC:educationZ | 0.05 | [-0.24, 0.34] | 63.61% | 1.000 | 35485.00 repetitionC:godZ | -0.06 | [-0.37, 0.25] | 63.96% | 1.000 | 32878.00 repetitionC:hireZ | -0.03 | [-0.35, 0.29] | 55.99% | 1.000 | 31301.00 conditionD:ageZ | -0.12 | [-1.05, 0.81] | 59.80% | 1.001 | 13763.00 conditionD:genderZ | -0.51 | [-1.46, 0.45] | 85.26% | 1.000 | 10911.00 conditionD:aotZ | 0.83 | [-0.12, 1.78] | 95.81% | 1.001 | 12168.00 conditionD:covidconcernZ | -0.89 | [-2.03, 0.26] | 93.82% | 1.001 | 12651.00 conditionD:sesZ | 0.10 | [-0.91, 1.07] | 57.92% | 1.000 | 13763.00 conditionD:attentionZ | -0.04 | [-0.95, 0.89] | 53.73% | 1.001 | 11211.00 conditionD:educationZ | -0.50 | [-1.44, 0.41] | 85.51% | 1.001 | 12370.00 conditionD:godZ | 0.47 | [-0.36, 1.33] | 86.60% | 1.000 | 14837.00 conditionD:hireZ | -0.26 | [-1.22, 0.69] | 70.52% | 1.001 | 11163.00 repetitionC:conditionD:ageZ | 0.36 | [-0.23, 0.94] | 88.67% | 1.000 | 38586.00 repetitionC:conditionD:genderZ | -0.17 | [-0.68, 0.32] | 74.98% | 1.000 | 33817.00 repetitionC:conditionD:aotZ | -0.14 | [-0.67, 0.38] | 70.84% | 1.000 | 30969.00 repetitionC:conditionD:covidconcernZ | 3.28e-03 | [-0.62, 0.61] | 50.83% | 1.000 | 35887.00 repetitionC:conditionD:sesZ | 0.13 | [-0.35, 0.63] | 70.50% | 1.000 | 35436.00 repetitionC:conditionD:attentionZ | -0.14 | [-0.64, 0.36] | 70.85% | 1.000 | 34970.00 repetitionC:conditionD:educationZ | -0.06 | [-0.57, 0.45] | 58.30% | 1.000 | 35604.00 repetitionC:conditionD:godZ | -5.32e-03 | [-0.47, 0.47] | 51.04% | 1.000 | 34821.00 repetitionC:conditionD:hireZ | -0.37 | [-0.87, 0.12] | 92.86% | 1.000 | 35200.00 ``` ## H1 (control group only): truth ~ veracity * repetition We will then test Hypothesis 1, with the analytic approach depending on the outcome of the Hypothesis 2 analysis. If the `repetition * condition` interaction is signiﬁcant in the model above, we will focus on only participants in the **control group** (as this interaction means that the treatment attenuates the repetition eﬀect, polluting the estimation of the repetition eﬀect when both conditions are pooled). - repetition: dummy centered -0.5/0.5 - veracity: dummy centered -0.5/0.5 ```r # control group only # freq term results 1: (Intercept) b = 3.54, SE = 0.08, t(171) = 46.87, p < .001, r = 0.96 2: veracityC b = 0.40, SE = 0.09, t(99) = 4.31, p < .001, r = 0.40 3: repetitionC b = 0.06, SE = 0.03, t(141) = 1.73, p = .085, r = 0.14 # ns 4: veracityC:repetitionC b = −0.05, SE = 0.06, t(179) = −0.89, p = .375, r = 0.07 # with covariates term results 1: (Intercept) b = 3.53, SE = 0.08, t(114) = 45.44, p < .001, r = 0.97 2: veracityC b = 0.43, SE = 0.09, t(101) = 4.69, p < .001, r = 0.42 3: repetitionC b = 0.08, SE = 0.04, t(89) = 2.08, p = .040, r = 0.22 # sig 4: ageZ b = −0.004, SE = 0.06, t(88) = −0.07, p = .947, r = 0.007 5: genderZ b = 0.12, SE = 0.07, t(86) = 1.63, p = .107, r = 0.17 6: aotZ b = −0.31, SE = 0.07, t(86) = −4.19, p < .001, r = 0.41 # sig 7: covidconcernZ b = 0.007, SE = 0.06, t(86) = 0.11, p = .912, r = 0.01 8: sesZ b = 0.10, SE = 0.07, t(86) = 1.50, p = .138, r = 0.16 9: attentionZ b = −0.03, SE = 0.07, t(87) = −0.44, p = .661, r = 0.05 10: educationZ b = −0.02, SE = 0.07, t(86) = −0.33, p = .739, r = 0.04 11: godZ b = −0.12, SE = 0.07, t(88) = −1.91, p = .059, r = 0.20 12: hireZ b = −0.11, SE = 0.07, t(86) = −1.50, p = .137, r = 0.16 13: veracityC:repetitionC b = −0.01, SE = 0.07, t(129) = −0.14, p = .892, r = 0.01 # ns 14: veracityC:ageZ b = −0.01, SE = 0.05, t(101) = −0.22, p = .827, r = 0.02 15: veracityC:genderZ b = 0.07, SE = 0.06, t(89) = 1.22, p = .226, r = 0.13 16: veracityC:aotZ b = 0.18, SE = 0.06, t(87) = 3.01, p = .003, r = 0.31 # sig 17: veracityC:covidconcernZ b = 0.13, SE = 0.05, t(86) = 2.43, p = .017, r = 0.25 # sig 18: veracityC:sesZ b = −0.02, SE = 0.05, t(88) = −0.38, p = .704, r = 0.04 19: veracityC:attentionZ b = −0.01, SE = 0.06, t(91) = −0.25, p = .803, r = 0.03 20: veracityC:educationZ b = −0.04, SE = 0.05, t(87) = −0.74, p = .458, r = 0.08 21: veracityC:godZ b = −0.01, SE = 0.05, t(99) = −0.20, p = .844, r = 0.02 22: veracityC:hireZ b = 0.02, SE = 0.06, t(90) = 0.24, p = .808, r = 0.03 term results term results 1: (Intercept) b = 3.53, SE = 0.08, t(113) = 45.34, p < .001, r = 0.97 2: veracityC b = 0.44, SE = 0.09, t(100) = 4.68, p < .001, r = 0.42 # sig 3: repetitionC b = 0.08, SE = 0.04, t(83) = 2.18, p = .032, r = 0.23 # sig 4: ageZ b = −0.006, SE = 0.06, t(87) = −0.09, p = .927, r = 0.01 5: genderZ b = 0.11, SE = 0.07, t(86) = 1.56, p = .122, r = 0.17 6: aotZ b = −0.33, SE = 0.07, t(86) = −4.35, p < .001, r = 0.43 # sig 7: covidconcernZ b = 0.01, SE = 0.07, t(86) = 0.21, p = .832, r = 0.02 8: sesZ b = 0.10, SE = 0.07, t(86) = 1.43, p = .158, r = 0.15 9: attentionZ b = −0.03, SE = 0.07, t(86) = −0.48, p = .634, r = 0.05 10: educationZ b = −0.03, SE = 0.07, t(86) = −0.39, p = .697, r = 0.04 11: godZ b = −0.14, SE = 0.07, t(87) = −2.08, p = .041, r = 0.22 # sig 12: hireZ b = −0.11, SE = 0.08, t(86) = −1.50, p = .137, r = 0.16 13: veracityC:repetitionC b = −0.02, SE = 0.07, t(118) = −0.23, p = .818, r = 0.02 14: veracityC:ageZ b = −0.04, SE = 0.06, t(94) = −0.66, p = .508, r = 0.07 15: veracityC:genderZ b = 0.11, SE = 0.07, t(88) = 1.58, p = .119, r = 0.17 16: veracityC:aotZ b = 0.21, SE = 0.07, t(86) = 2.98, p = .004, r = 0.31 # sig 17: veracityC:covidconcernZ b = 0.11, SE = 0.06, t(87) = 1.71, p = .091, r = 0.18 18: veracityC:sesZ b = −0.04, SE = 0.06, t(87) = −0.61, p = .546, r = 0.06 19: veracityC:attentionZ b = 0.009, SE = 0.07, t(89) = 0.12, p = .902, r = 0.01 20: veracityC:educationZ b = −0.03, SE = 0.06, t(87) = −0.47, p = .641, r = 0.05 21: veracityC:godZ b = 0.03, SE = 0.06, t(93) = 0.42, p = .678, r = 0.04 22: veracityC:hireZ b = 2e−04, SE = 0.07, t(89) = 0.002, p = .998, r = 2e−04 23: repetitionC:ageZ b = −0.07, SE = 0.03, t(98) = −2.20, p = .030, r = 0.22 # sig 24: repetitionC:genderZ b = 0.07, SE = 0.04, t(67) = 1.84, p = .071, r = 0.22 25: repetitionC:aotZ b = −0.03, SE = 0.04, t(65) = −0.77, p = .445, r = 0.09 26: repetitionC:covidconcernZ b = −0.01, SE = 0.03, t(63) = −0.47, p = .642, r = 0.06 27: repetitionC:sesZ b = −0.06, SE = 0.03, t(69) = −1.75, p = .084, r = 0.21 28: repetitionC:attentionZ b = 0.04, SE = 0.04, t(72) = 0.97, p = .335, r = 0.11 29: repetitionC:educationZ b = 0.004, SE = 0.03, t(65) = 0.11, p = .911, r = 0.01 30: repetitionC:godZ b = 0.01, SE = 0.03, t(93) = 0.28, p = .780, r = 0.03 31: repetitionC:hireZ b = −0.04, SE = 0.04, t(69) = −1.16, p = .252, r = 0.14 32: veracityC:repetitionC:ageZ b = −0.03, SE = 0.07, t(140) = −0.48, p = .634, r = 0.04 33: veracityC:repetitionC:genderZ b = 0.05, SE = 0.07, t(96) = 0.67, p = .504, r = 0.07 34: veracityC:repetitionC:aotZ b = 0.07, SE = 0.07, t(93) = 1.00, p = .321, r = 0.10 35: veracityC:repetitionC:covidconcernZ b = −0.04, SE = 0.06, t(90) = −0.61, p = .541, r = 0.06 36: veracityC:repetitionC:sesZ b = −0.006, SE = 0.07, t(99) = −0.08, p = .934, r = 0.008 37: veracityC:repetitionC:attentionZ b = 0.03, SE = 0.07, t(103) = 0.38, p = .706, r = 0.04 38: veracityC:repetitionC:educationZ b = 0.02, SE = 0.07, t(93) = 0.25, p = .801, r = 0.03 39: veracityC:repetitionC:godZ b = 0.08, SE = 0.07, t(133) = 1.14, p = .255, r = 0.10 40: veracityC:repetitionC:hireZ b = −0.01, SE = 0.08, t(98) = −0.13, p = .897, r = 0.01 term results # bayesian Parameter | Mean | 95% CI | pd | Rhat | ESS -------------------------------------------------------------------------- (Intercept) | 3.54 | [ 3.38, 3.68] | 100% | 1.001 | 3975.00 veracityC | 0.40 | [ 0.21, 0.58] | 100.00% | 1.000 | 11332.00 repetitionC | 0.06 | [-0.01, 0.12] | 95.76% | 1.000 | 47395.00 # almost sig veracityC:repetitionC | -0.05 | [-0.17, 0.06] | 82.25% | 1.000 | 42250.00 # with covariates Parameter | Mean | 95% CI | pd | Rhat | ESS --------------------------------------------------------------------------------- (Intercept) | 3.53 | [ 3.37, 3.69] | 100% | 1.001 | 7961.00 veracityC | 0.43 | [ 0.25, 0.62] | 100% | 1.001 | 12571.00 repetitionC | 0.07 | [ 0.00, 0.14] | 98.02% | 1.000 | 51156.00 # sig ageZ | -3.14e-03 | [-0.13, 0.12] | 52.17% | 1.001 | 10806.00 genderZ | 0.12 | [-0.03, 0.26] | 93.98% | 1.001 | 8240.00 aotZ | -0.31 | [-0.46, -0.16] | 100.00% | 1.001 | 8816.00 # sig covidconcernZ | 9.70e-03 | [-0.12, 0.14] | 55.63% | 1.001 | 8828.00 sesZ | 0.10 | [-0.04, 0.23] | 92.55% | 1.001 | 8605.00 attentionZ | -0.03 | [-0.18, 0.11] | 67.61% | 1.002 | 8624.00 educationZ | -0.02 | [-0.16, 0.11] | 63.30% | 1.001 | 8194.00 godZ | -0.13 | [-0.26, 0.00] | 97.26% | 1.001 | 11337.00 hireZ | -0.11 | [-0.26, 0.04] | 92.62% | 1.001 | 8733.00 veracityC:repetitionC | -0.01 | [-0.15, 0.13] | 57.97% | 1.000 | 40853.00 # ns veracityC:ageZ | -0.01 | [-0.12, 0.09] | 60.79% | 1.000 | 21360.00 veracityC:genderZ | 0.07 | [-0.05, 0.20] | 88.60% | 1.000 | 18624.00 veracityC:aotZ | 0.19 | [ 0.06, 0.31] | 99.78% | 1.000 | 19290.00 # sig veracityC:covidconcernZ | 0.12 | [ 0.02, 0.23] | 98.95% | 1.000 | 19317.00 # sig veracityC:sesZ | -0.02 | [-0.13, 0.09] | 65.28% | 1.000 | 19264.00 veracityC:attentionZ | -0.01 | [-0.13, 0.11] | 57.85% | 1.000 | 19443.00 veracityC:educationZ | -0.04 | [-0.15, 0.07] | 75.82% | 1.000 | 18538.00 veracityC:godZ | -6.11e-03 | [-0.12, 0.10] | 54.33% | 1.000 | 21889.00 veracityC:hireZ | 0.01 | [-0.11, 0.14] | 58.73% | 1.000 | 20544.00 Parameter | Mean | 95% CI | pd | Rhat | ESS -------------------------------------------------------------------------------------------- (Intercept) | 3.53 | [ 3.37, 3.68] | 100% | 1.001 | 8210.00 veracityC | 0.44 | [ 0.25, 0.62] | 100% | 1.001 | 12293.00 # sig repetitionC | 0.08 | [ 0.01, 0.15] | 98.60% | 1.000 | 51064.00 # sig ageZ | -6.12e-03 | [-0.13, 0.12] | 53.76% | 1.001 | 9995.00 genderZ | 0.11 | [-0.03, 0.26] | 93.64% | 1.001 | 7950.00 aotZ | -0.33 | [-0.48, -0.17] | 100% | 1.001 | 8107.00 covidconcernZ | 0.01 | [-0.12, 0.15] | 58.12% | 1.001 | 8523.00 sesZ | 0.10 | [-0.04, 0.23] | 92.24% | 1.001 | 8703.00 attentionZ | -0.04 | [-0.18, 0.11] | 68.46% | 1.001 | 7719.00 educationZ | -0.03 | [-0.16, 0.11] | 64.39% | 1.001 | 7965.00 godZ | -0.14 | [-0.27, -0.01] | 97.98% | 1.001 | 11142.00 # sig hireZ | -0.11 | [-0.27, 0.03] | 93.02% | 1.001 | 8399.00 veracityC:repetitionC | -0.02 | [-0.16, 0.13] | 61.57% | 1.000 | 34794.00 # ns veracityC:ageZ | -0.04 | [-0.16, 0.08] | 74.69% | 1.000 | 17168.00 veracityC:genderZ | 0.11 | [-0.03, 0.24] | 94.27% | 1.000 | 15202.00 veracityC:aotZ | 0.21 | [ 0.07, 0.36] | 99.82% | 1.000 | 16148.00 veracityC:covidconcernZ | 0.11 | [-0.01, 0.23] | 95.82% | 1.000 | 16303.00 veracityC:sesZ | -0.04 | [-0.16, 0.09] | 73.50% | 1.000 | 16234.00 veracityC:attentionZ | 8.06e-03 | [-0.12, 0.15] | 54.63% | 1.000 | 14922.00 veracityC:educationZ | -0.03 | [-0.16, 0.09] | 68.50% | 1.001 | 15472.00 veracityC:godZ | 0.03 | [-0.10, 0.15] | 65.37% | 1.001 | 18027.00 veracityC:hireZ | -1.49e-03 | [-0.15, 0.14] | 50.89% | 1.001 | 15148.00 repetitionC:ageZ | -0.07 | [-0.14, -0.01] | 98.83% | 1.000 | 53072.00 # sig repetitionC:genderZ | 0.07 | [ 0.00, 0.14] | 97.44% | 1.000 | 51621.00 # sig repetitionC:aotZ | -0.03 | [-0.10, 0.04] | 79.30% | 1.000 | 52581.00 repetitionC:covidconcernZ | -0.01 | [-0.07, 0.05] | 62.87% | 1.000 | 45581.00 repetitionC:sesZ | -0.06 | [-0.12, 0.00] | 96.54% | 1.000 | 55342.00 repetitionC:attentionZ | 0.03 | [-0.03, 0.10] | 83.13% | 1.000 | 49270.00 repetitionC:educationZ | 2.79e-03 | [-0.06, 0.07] | 53.53% | 1.000 | 56321.00 repetitionC:godZ | 7.22e-03 | [-0.06, 0.07] | 58.44% | 1.000 | 54349.00 repetitionC:hireZ | -0.05 | [-0.12, 0.03] | 89.74% | 1.000 | 50247.00 veracityC:repetitionC:ageZ | -0.03 | [-0.16, 0.10] | 68.80% | 1.000 | 38380.00 veracityC:repetitionC:genderZ | 0.05 | [-0.09, 0.19] | 76.06% | 1.000 | 33146.00 veracityC:repetitionC:aotZ | 0.07 | [-0.07, 0.22] | 84.79% | 1.000 | 34100.00 veracityC:repetitionC:covidconcernZ | -0.04 | [-0.16, 0.09] | 71.37% | 1.000 | 35332.00 veracityC:repetitionC:sesZ | -6.18e-03 | [-0.14, 0.12] | 53.75% | 1.000 | 37049.00 veracityC:repetitionC:attentionZ | 0.02 | [-0.12, 0.17] | 62.64% | 1.000 | 34177.00 veracityC:repetitionC:educationZ | 0.02 | [-0.12, 0.15] | 59.86% | 1.000 | 34189.00 veracityC:repetitionC:godZ | 0.08 | [-0.06, 0.21] | 86.59% | 1.000 | 38738.00 veracityC:repetitionC:hireZ | -0.01 | [-0.16, 0.14] | 56.80% | 1.000 | 34881.00 ``` Binomial model (binarized truth ratings) ```r # freq term results 1: (Intercept) b = 0.15, SE = 0.24, z = 0.63, p = .531, r = 0.04 2: veracityC b = 0.73, SE = 0.19, z = 3.82, p < .001, r = 0.20 3: repetitionC b = 0.13, SE = 0.09, z = 1.53, p = .126, r = 0.04 # ns 4: veracityC:repetitionC b = −0.33, SE = 0.16, z = −2.01, p = .045, r = −0.09 # sig # with covariates term results 1: (Intercept) b = 0.09, SE = 0.26, z = 0.33, p = .739, r = 0.02 2: veracityC b = 0.84, SE = 0.19, z = 4.51, p < .001, r = 0.23 3: repetitionC b = 0.21, SE = 0.10, z = 2.11, p = .035, r = 0.06 # sig 4: ageZ b = 0.17, SE = 0.23, z = 0.73, p = .467, r = 0.05 5: genderZ b = 0.46, SE = 0.26, z = 1.80, p = .072, r = 0.13 6: aotZ b = −1.06, SE = 0.27, z = −3.94, p < .001, r = −0.28 # sig 7: covidconcernZ b = 0.15, SE = 0.23, z = 0.67, p = .506, r = 0.04 8: sesZ b = 0.12, SE = 0.24, z = 0.50, p = .614, r = 0.03 9: attentionZ b = −0.20, SE = 0.25, z = −0.78, p = .438, r = −0.05 10: educationZ b = 0.08, SE = 0.23, z = 0.34, p = .733, r = 0.02 11: godZ b = −0.40, SE = 0.23, z = −1.70, p = .090, r = −0.11 12: hireZ b = −0.44, SE = 0.28, z = −1.58, p = .114, r = −0.12 13: veracityC:repetitionC b = −0.15, SE = 0.20, z = −0.74, p = .462, r = −0.04 # ns 14: veracityC:ageZ b = −0.07, SE = 0.12, z = −0.58, p = .562, r = −0.02 15: veracityC:genderZ b = 0.05, SE = 0.11, z = 0.47, p = .636, r = 0.01 16: veracityC:aotZ b = 0.42, SE = 0.13, z = 3.22, p = .001, r = 0.12 # sig 17: veracityC:covidconcernZ b = 0.10, SE = 0.10, z = 1.09, p = .277, r = 0.03 18: veracityC:sesZ b = −0.04, SE = 0.10, z = −0.43, p = .669, r = −0.01 19: veracityC:attentionZ b = 0.009, SE = 0.11, z = 0.08, p = .937, r = 0 20: veracityC:educationZ b = −0.10, SE = 0.10, z = −1.03, p = .304, r = −0.03 21: veracityC:godZ b = 0.08, SE = 0.11, z = 0.78, p = .438, r = 0.02 22: veracityC:hireZ b = −0.02, SE = 0.12, z = −0.21, p = .836, r = −0.01 term results term results 1: (Intercept) b = 0.10, SE = 0.26, z = 0.37, p = .710, r = 0.03 2: veracityC b = 0.85, SE = 0.19, z = 4.55, p < .001, r = 0.23 # sig 3: repetitionC b = 0.24, SE = 0.10, z = 2.29, p = .022, r = 0.07 # sig 4: ageZ b = 0.10, SE = 0.23, z = 0.44, p = .663, r = 0.03 5: genderZ b = 0.51, SE = 0.26, z = 1.96, p = .050, r = 0.14 # sig 6: aotZ b = −1.13, SE = 0.28, z = −4.10, p < .001, r = −0.30 # sig 7: covidconcernZ b = 0.15, SE = 0.23, z = 0.65, p = .512, r = 0.04 8: sesZ b = 0.10, SE = 0.24, z = 0.40, p = .689, r = 0.03 9: attentionZ b = −0.21, SE = 0.26, z = −0.81, p = .420, r = −0.06 10: educationZ b = 0.09, SE = 0.24, z = 0.35, p = .724, r = 0.02 11: godZ b = −0.39, SE = 0.24, z = −1.61, p = .107, r = −0.11 12: hireZ b = −0.56, SE = 0.27, z = −2.04, p = .041, r = −0.15 # sig 13: veracityC:repetitionC b = −0.11, SE = 0.21, z = −0.51, p = .609, r = −0.03 14: veracityC:ageZ b = −0.07, SE = 0.13, z = −0.51, p = .610, r = −0.02 15: veracityC:genderZ b = 0.13, SE = 0.12, z = 1.03, p = .302, r = 0.04 16: veracityC:aotZ b = 0.39, SE = 0.15, z = 2.58, p = .010, r = 0.11 # sig 17: veracityC:covidconcernZ b = 0.11, SE = 0.11, z = 1.01, p = .311, r = 0.03 18: veracityC:sesZ b = −8e−04, SE = 0.11, z = −0.007, p = .995, r = 0 19: veracityC:attentionZ b = 0.01, SE = 0.13, z = 0.09, p = .927, r = 0 20: veracityC:educationZ b = −0.12, SE = 0.11, z = −1.07, p = .286, r = −0.03 21: veracityC:godZ b = 0.10, SE = 0.12, z = 0.80, p = .425, r = 0.03 22: veracityC:hireZ b = −0.11, SE = 0.13, z = −0.89, p = .375, r = −0.03 23: repetitionC:ageZ b = −0.17, SE = 0.11, z = −1.56, p = .120, r = −0.05 24: repetitionC:genderZ b = 0.08, SE = 0.10, z = 0.81, p = .420, r = 0.02 25: repetitionC:aotZ b = −0.16, SE = 0.12, z = −1.30, p = .194, r = −0.04 26: repetitionC:covidconcernZ b = 8e−04, SE = 0.09, z = 0.009, p = .993, r = 0 27: repetitionC:sesZ b = −0.09, SE = 0.09, z = −0.96, p = .338, r = −0.02 28: repetitionC:attentionZ b = −0.04, SE = 0.10, z = −0.42, p = .672, r = −0.01 29: repetitionC:educationZ b = 0.03, SE = 0.09, z = 0.29, p = .769, r = 0.01 30: repetitionC:godZ b = 0.01, SE = 0.10, z = 0.11, p = .913, r = 0 31: repetitionC:hireZ b = −0.21, SE = 0.10, z = −1.98, p = .048, r = −0.06 # sig 32: veracityC:repetitionC:ageZ b = 0.02, SE = 0.22, z = 0.07, p = .943, r = 0 33: veracityC:repetitionC:genderZ b = 0.28, SE = 0.21, z = 1.34, p = .180, r = 0.08 34: veracityC:repetitionC:aotZ b = −0.12, SE = 0.25, z = −0.47, p = .637, r = −0.03 35: veracityC:repetitionC:covidconcernZ b = 0.02, SE = 0.18, z = 0.14, p = .888, r = 0.01 36: veracityC:repetitionC:sesZ b = 0.14, SE = 0.19, z = 0.74, p = .458, r = 0.04 37: veracityC:repetitionC:attentionZ b = 0.02, SE = 0.21, z = 0.08, p = .939, r = 0 38: veracityC:repetitionC:educationZ b = −0.06, SE = 0.18, z = −0.31, p = .756, r = −0.02 39: veracityC:repetitionC:godZ b = 0.05, SE = 0.20, z = 0.24, p = .812, r = 0.01 40: veracityC:repetitionC:hireZ b = −0.34, SE = 0.22, z = −1.58, p = .115, r = −0.09 # bayesian Parameter | Mean | 95% CI | pd | Rhat | ESS -------------------------------------------------------------------------- (Intercept) | 0.15 | [-0.34, 0.63] | 73.07% | 1.004 | 2058.00 veracityC | 0.74 | [ 0.35, 1.13] | 99.99% | 1.001 | 9393.00 repetitionC | 0.13 | [-0.05, 0.30] | 92.73% | 1.000 | 35841.00 # ns veracityC:repetitionC | -0.33 | [-0.66, 0.00] | 97.57% | 1.000 | 39130.00 # sig # with covariates Parameter | Mean | 95% CI | pd | Rhat | ESS ----------------------------------------------------------------------------- (Intercept) | 0.10 | [-0.47, 0.68] | 63.32% | 1.001 | 12800.00 veracityC | 0.85 | [ 0.45, 1.24] | 100.00% | 1.000 | 25686.00 repetitionC | 0.20 | [ 0.01, 0.40] | 98.03% | 1.000 | 63769.00 # sig ageZ | 0.18 | [-0.34, 0.70] | 74.71% | 1.000 | 16882.00 genderZ | 0.47 | [-0.08, 1.05] | 94.87% | 1.001 | 12176.00 aotZ | -1.10 | [-1.70, -0.50] | 99.98% | 1.000 | 14579.00 # covidconcernZ | 0.15 | [-0.33, 0.67] | 72.59% | 1.000 | 15839.00 sesZ | 0.11 | [-0.41, 0.64] | 66.95% | 1.001 | 13609.00 attentionZ | -0.20 | [-0.74, 0.38] | 75.58% | 1.001 | 14173.00 educationZ | 0.08 | [-0.44, 0.60] | 62.29% | 1.001 | 13255.00 godZ | -0.41 | [-0.94, 0.10] | 94.12% | 1.000 | 20414.00 hireZ | -0.48 | [-1.09, 0.11] | 94.22% | 1.001 | 13198.00 veracityC:repetitionC | -0.17 | [-0.57, 0.25] | 79.41% | 1.000 | 66899.00 # ns veracityC:ageZ | -0.05 | [-0.32, 0.21] | 64.22% | 1.000 | 44639.00 veracityC:genderZ | 0.06 | [-0.19, 0.30] | 68.67% | 1.000 | 34364.00 veracityC:aotZ | 0.40 | [ 0.11, 0.70] | 99.70% | 1.000 | 36721.00 # sig veracityC:covidconcernZ | 0.11 | [-0.10, 0.32] | 84.82% | 1.000 | 38092.00 veracityC:sesZ | -0.04 | [-0.26, 0.18] | 65.13% | 1.000 | 36066.00 veracityC:attentionZ | 0.01 | [-0.24, 0.26] | 53.54% | 1.000 | 38717.00 veracityC:educationZ | -0.10 | [-0.33, 0.11] | 82.51% | 1.000 | 36505.00 veracityC:godZ | 0.07 | [-0.16, 0.32] | 72.49% | 1.000 | 43055.00 veracityC:hireZ | -0.05 | [-0.30, 0.21] | 64.50% | 1.000 | 32379.00 Parameter | Mean | 95% CI | pd | Rhat | ESS --------------------------------------------------------------------------------------------- (Intercept) | 0.11 | [-0.48, 0.69] | 64.39% | 1.000 | 12765.00 veracityC | 0.88 | [ 0.48, 1.29] | 100.00% | 1.000 | 24382.00 # sig repetitionC | 0.25 | [ 0.02, 0.48] | 98.41% | 1.000 | 53489.00 # sig ageZ | 0.14 | [-0.39, 0.70] | 69.21% | 1.000 | 17405.00 genderZ | 0.52 | [-0.08, 1.09] | 96.02% | 1.000 | 12350.00 aotZ | -1.19 | [-1.84, -0.58] | 100.00% | 1.001 | 14314.00 # sig covidconcernZ | 0.16 | [-0.36, 0.70] | 72.80% | 1.000 | 14460.00 sesZ | 0.10 | [-0.47, 0.62] | 63.93% | 1.000 | 13429.00 attentionZ | -0.22 | [-0.81, 0.36] | 76.50% | 1.000 | 13503.00 educationZ | 0.10 | [-0.44, 0.65] | 63.70% | 1.001 | 12513.00 godZ | -0.42 | [-0.97, 0.12] | 93.81% | 1.000 | 19036.00 hireZ | -0.59 | [-1.20, 0.04] | 96.98% | 1.000 | 13036.00 veracityC:repetitionC | -0.11 | [-0.57, 0.35] | 68.55% | 1.000 | 54400.00 veracityC:ageZ | -0.06 | [-0.36, 0.23] | 65.55% | 1.000 | 40107.00 veracityC:genderZ | 0.13 | [-0.14, 0.41] | 82.68% | 1.000 | 35234.00 veracityC:aotZ | 0.38 | [ 0.04, 0.72] | 98.85% | 1.000 | 35130.00 # sig veracityC:covidconcernZ | 0.12 | [-0.13, 0.36] | 82.87% | 1.000 | 36186.00 veracityC:sesZ | -2.22e-03 | [-0.25, 0.25] | 50.78% | 1.000 | 37269.00 veracityC:attentionZ | 0.02 | [-0.26, 0.30] | 54.51% | 1.000 | 36836.00 veracityC:educationZ | -0.13 | [-0.38, 0.12] | 84.07% | 1.000 | 36916.00 veracityC:godZ | 0.09 | [-0.17, 0.37] | 75.18% | 1.000 | 40761.00 veracityC:hireZ | -0.13 | [-0.42, 0.15] | 82.17% | 1.000 | 35323.00 repetitionC:ageZ | -0.18 | [-0.42, 0.07] | 92.63% | 1.000 | 57635.00 repetitionC:genderZ | 0.08 | [-0.14, 0.31] | 76.44% | 1.000 | 53659.00 repetitionC:aotZ | -0.16 | [-0.44, 0.11] | 88.05% | 1.000 | 40081.00 repetitionC:covidconcernZ | -8.79e-03 | [-0.21, 0.18] | 53.43% | 1.000 | 50724.00 repetitionC:sesZ | -0.09 | [-0.28, 0.12] | 80.96% | 1.000 | 56128.00 repetitionC:attentionZ | -0.05 | [-0.27, 0.18] | 65.86% | 1.000 | 52903.00 repetitionC:educationZ | 0.02 | [-0.17, 0.23] | 59.34% | 1.000 | 51926.00 repetitionC:godZ | 0.02 | [-0.21, 0.23] | 57.01% | 1.000 | 52378.00 repetitionC:hireZ | -0.21 | [-0.44, 0.02] | 96.64% | 1.000 | 44836.00 veracityC:repetitionC:ageZ | 2.45e-03 | [-0.50, 0.50] | 50.35% | 1.000 | 52371.00 veracityC:repetitionC:genderZ | 0.29 | [-0.16, 0.75] | 89.68% | 1.000 | 52380.00 veracityC:repetitionC:aotZ | -0.10 | [-0.66, 0.45] | 64.31% | 1.000 | 43851.00 veracityC:repetitionC:covidconcernZ | 0.03 | [-0.37, 0.42] | 55.07% | 1.000 | 51367.00 veracityC:repetitionC:sesZ | 0.16 | [-0.26, 0.57] | 77.44% | 1.000 | 54901.00 veracityC:repetitionC:attentionZ | 0.01 | [-0.45, 0.48] | 52.47% | 1.000 | 56452.00 veracityC:repetitionC:educationZ | -0.06 | [-0.47, 0.34] | 61.41% | 1.000 | 56566.00 veracityC:repetitionC:godZ | 0.06 | [-0.39, 0.51] | 60.11% | 1.000 | 52536.00 veracityC:repetitionC:hireZ | -0.34 | [-0.81, 0.13] | 92.45% | 1.000 | 47779.00 ``` # extra stuff ## check random assignment/counterbalancing ![[1690914364.png]] ```r # users per condition/survey condition survey N 1: control 1 18 2: control 3 18 3: control 5 20 4: control 7 24 5: control 9 16 6: control 11 15 7: control 13 23 8: treatment 2 12 9: treatment 4 17 10: treatment 6 21 11: treatment 8 15 12: treatment 10 15 13: treatment 12 17 14: treatment 14 8 ``` ## attention check > People are very busy these days and many do not have time to follow what goes on in the news. We are checking whether people read questions. To show that you've read this much, click the radio button below 3. ```r > ddemo[, .N, keyby = attentioncheck] attentioncheck N 1: NA 15 2: 1 10 3: 2 45 4: 3 85 # correct response 5: 4 43 6: 5 25 7: 6 16 ``` ## AOT reliability ```r > performance::cronbachs_alpha(select(ddemo, aot1:aot6)) # alpha [1] 0.8293517 ```