# Campaign overview - overall campaign duration: **2021-10-04 to 2021-10-24** (21 days) - pre-campaign (identify users to target): **2021-09-23 to 2021-09-30** (8 days) - 2 sub-campaigns - campaign 2 (7 days): **2021-10-04 to 2021-10-10 ** - reach campaign - spend: $594.88 - audience reach: 5165 - impressions: 17088 - campaign 3 (14 days): **2021-10-11 to 2021-10-24** - 2011-10-11 to 2021-10-16: reach campaign - 2010-10-15 to 2021-10-24: reach, engagements, followers, video views campaigns - spend: $5967.33 - audience reach: 9112 - impressions: 317672 - overall spend: $6562.21 - overall Impressions: 334760 - overall audience reach: 9112 # Condition assignment - 15 pre-treatment features/covariates used for blocked randomization/condition assignment (5423 blocks: 4 to 27 users per block) - 9 user features - total statuses (tweets, retweets, etc.) - followers - friends - favorites - account age - friend-follow-ratio - active days during pre-campaign (min 2) - no. of retweets found via search api during pre-campaign - no. of tweets found via search api during pre campaign - 6 outcome-related features: - domain quality during pre-campaign: mean, sum, count - predicted domain quality in the next 7-14 days: mean, sum, count - trained using gradient-boosted decision trees (Light GBM) (see models [[20211111_130302 predictive models|here]]) # Audience - *matched* (i.e., targetable)/upload users: *30141*/32888 - control: *15097*/16473 (0.916) - treatment: *15044*/16415 (0.916) - users reached during 21-day campaign: 9112 - reached/upload: 9112/16415 (0.555) - reached/matched: 9112/15044 (0.606) - [[20211111_123542 campaign2 and 3 reach and impressions|see audience reach/impressions info here]] - user timelines retrieved (Sept 23 to Oct 24): 32320/32888 (0.983) - 568 accounts were protected/suspended during the campaign - control: 283/16473 (0.017) - treatment: 285/16415 (0.017) # Domains ## Domains in tweets - Sept 23 to Oct 24 - total domains in all tweets: 10,219,643 (174,423 unique) - domains with ratings: 5,368,793 (0.525) - 2442 unique (of 3332 rated domains) (0.733) - during campaign: Oct 4 to Oct 24 - total domains in all tweets: 7,280,669 (143,751 unique) - domains with ratings: 3,761,495 (0.517) - 2384 unique (of 3332 rated domains) (0.715) ![[domains_shared 1.png|600]] ```r > dt_domains[url_domain %in% dt_domainQ$domain, .(n = .N), keyby = .(period, type)][order(period, -n)] period type n 1: 0 retweet 1426815 2: 0 tweet 88378 3: 0 quote 68185 4: 0 reply 19289 5: 0 quote-reply 4631 6: 1 retweet 3351708 7: 1 tweet 213565 8: 1 quote 142222 9: 1 reply 44379 10: 1 quote-reply 9621 ``` ![[domain_counts.png|600]] ## Compare domains shared between conditions - [[different measures of domain quality]] - [[20211111_152653 difference in domain counts between conditions|difference in domain counts between conditions for different measures of domain quality]] # Results ## Different measures of domain quality - [[different measures of domain quality]] - [[20211125_201711 fc|fc]] - 60/3332 - retweet - condition:t0 interaction (-) - quotereply - condition:t0 interaction (+) - [[20211125_220145 ng|ng]] - 207/3332 - [[20211125_221020 mbfc_bias|mbfc_bias]] - 2809/3332 - quote - condition (+) - quotereply - condition:t0 interaction (+) - reply - condition:t0 interaction (+) - [[20211128_222030 mbfc_fact|mbfc_fact]] - quote - condition (+) - [[20211125_221621 mbfc|mbfc]] - quote - condition (+) - quotereply - condition:t0 interaction (+) - [[20211125_222435 mbfc_min|mbfc_min]] - [[20211126_102201 afm_bias|afm_bias]] - 283/3332 - retweet - condition:t0 interaction (-) - quotereply - condition:t0 interaction (+) - reply - condition:t0 interaction (+) - [[20211126_102201 afm_rely|afm_rely]] - retweet - condition:t0 interaction (-) - quotereply - condition:t0 interaction (+) - reply - condition:t0 interaction (+) - [[20211126_102201 afm_min|afm_min]] - retweet - condition:t0 interaction (-) - quotereply - condition:t0 interaction (+) - reply - condition:t0 interaction (+) - [[20211125_222625 afm|afm]] - retweet - condition:t0 interaction (-) - quotereply - condition:t0 interaction (+) - reply - condition:t0 interaction (+) - [[20211126_102201 misinfome|misinfome]] - 471/3332 - many interactions - [[20211126_102201 quality01|quality01]] - 3332/3332 - quote - condition effect (+) - quotereply - condition:t0 interaction (+) - [[20211126_102201 quality02|quality02]] - quote - condition effect (+) - quotereply - condition:t0 interaction (+) - [[20211126_102201 quality03|quality03]] - quote - condition effect (+) - quotereply - condition:t0 interaction (+) - [[20211126_102201 quality04|quality04]] - quote - condition effect (+) - quotereply - condition:t0 interaction (+) - quality06 (binarized bad/good) - 1894/3332 - [[20211124_205846 quality06 - all domains|all domains]] (continuous and count models) - [[20211125_190321 quality06 - bad domains|bad domains]] (count model) - [[20211125_191535 quality06 - good domains|good domains]] (count model) - many interactions, but likely over-dispersed? - [[20211130_130313 quality06 - three-way interactions]]