On average, 20.725 raters per message. Politically balanced crowd agreed with perplexity evaluations on all messages (avg agreement > 3.5). Average agreement across 80 messages is 4.369732. ![[1729729521.png]] Republicans agreed with perplexity ratings less. ```r > summ(lm(rating ~ demrep, d1)) term result <char> <char> 1: (Intercept) b = 4.96 [4.67, 5.25], p < .001 2: demrep b = -0.39 [-0.58, -0.21], p < .001 ``` Split by topic and condition ```r condition topic rating <char> <char> <num> 1: persuadeHarris personality 4.305144 2: persuadeHarris policy 4.287121 3: persuadeTrump personality 4.421479 4: persuadeTrump policy 4.465185 condition topic demrep rating <char> <char> <int> <num> 1: persuadeHarris personality 1 4.573836 # dem 2: persuadeHarris personality 2 4.036453 # repub 3: persuadeHarris policy 1 4.589602 4: persuadeHarris policy 2 3.984640 5: persuadeTrump personality 1 4.481408 6: persuadeTrump personality 2 4.361549 7: persuadeTrump policy 1 4.619700 8: persuadeTrump policy 2 4.310671 ``` ![[1729728962.png]]