- 5-95% split
- only condition 3
- initial N: 8527
- 8156 have CRT (371 without CRT)
- everyone has 20 trials
- remove trials with rt < 0.5 or rt > 30
- **7767** have >= 15 trials (0.9108713 of 8527; 0.9523051 of 8156)
- remove outliers (MAD ± 3)
- **7450** have >= 15 trials (0.8736953 of 8527; 0.913438 of 8156)
![[s20220325_144601.png]]
```r
# original/total
r
gt; dt2[!is.na(rt), .(trials = .N), id][, .N, trials][order(-trials)]
trials N
1: 20 8286
2: 19 4
3: 18 11
4: 17 13
5: 16 7
6: 15 9
7: 14 7
8: 13 8
9: 12 10
10: 11 17
11: 10 13
12: 9 14
13: 8 10
14: 7 14
15: 6 8
16: 5 16
17: 4 19
18: 3 19
19: 2 17
20: 1 25
# remove those without CRT
rgt; dt2[!is.na(rt), .(trials = .N), id][, .N, trials][order(-trials)]
trials N
1: 20 8156
# remove fast/slow rts
rgt; dt2[!is.na(rt), .(trials = .N), id][, .N, trials][order(-trials)]
trials N
1: 20 4787
2: 19 1544
3: 18 687
4: 17 351
5: 16 244
6: 15 154
7: 14 84
8: 13 99
9: 12 53
10: 11 43
11: 10 25
12: 9 27
13: 8 10
14: 7 16
15: 6 7
16: 5 8
17: 4 5
18: 3 6
19: 2 2
20: 1 3
# remove outliers MAD3
rgt; dt2[!is.na(rtClean), .(trials = .N), id][, .N, trials][order(-trials)]
trials N
1: 20 1492
2: 19 2179
3: 18 1650
4: 17 1044
5: 16 667
6: 15 418
7: 14 238
8: 13 164
9: 12 100
10: 11 61
11: 10 42
12: 9 32
13: 8 14
14: 7 16
15: 6 10
16: 5 7
17: 4 10
18: 3 4
19: 2 4
20: 1 3
```
```r
# real (headline veracity): 0 (false), 1 (true)
# rating2 (dichotomized rating around 0.5): 0 (no), 1 (yes)
# acc: accuracy coding
# accuracy coding (recode rating2 to acc)
# 0=wrong answer (inaccurate if headline is true, accurate if headline is false)
# 1=right answer (accurate if headline is true, inaccurate if headline is false)
rgt; dt2[, .(real, rating2, acc)][order(real, rating2)] |> distinct()
real rating2 acc
1: 0 0 1
2: 0 1 0
3: 1 0 0
4: 1 1 1
```
```r
# split/fold - 5% fold 0
# count
rgt; folds[, .N, keyby = .(fold)]
fold N
1: 0 384
2: 1 7066
# proportion
rgt; folds[, .N / n_update2, keyby = .(fold)]
fold V1
1: 0 0.05154362
2: 1 0.94845638
rgt; folds[, .N, keyby = .(country, fold)]
country fold N
1: 1 0 24
2: 1 1 421
3: 2 0 24
4: 2 1 444
5: 3 0 24
6: 3 1 434
7: 4 0 24
8: 4 1 487
9: 5 0 24
10: 5 1 444
11: 6 0 24
12: 6 1 436
13: 7 0 24
14: 7 1 429
15: 8 0 24
16: 8 1 449
17: 9 0 24
18: 9 1 431
19: 10 0 24
20: 10 1 406
21: 11 0 24
22: 11 1 442
23: 12 0 24
24: 12 1 477
25: 13 0 24
26: 13 1 415
27: 14 0 24
28: 14 1 461
29: 15 0 24
30: 15 1 453
31: 16 0 24
32: 16 1 437
country fold N
```