approach - LLM provided full back-and-forth conversation (without the system prompt/instructions) to evaluate (instead of individual AI messages) # overall strategy usage ![[1738875117.png]] # condition and topic ## gpt4o Odd. Most strategies are used more in proHarris condition. ![[1738875332.png]] For reference, below is where LLM was given only individual messages to evaluate one at a time (instead of the full convo). Certain strategies are used more in proTrump condition. ![[1738877488.png]] ## deepseek ![[1738875347.png]] # pca ## gpt4o ![[20250206160136.png]] ## deepseek ![[20250206160207.png]] # best clustering? ## gpt4o: 9 clusters? ```python # negativity cluster 0 (5 strategies): ['contrastive_tone', 'namecalling', 'negative_tone', 'stimulate_anger', 'use_of_negative_testimonials'] # rapport buidling cluster 1 (4 strategies): ['active_listening_and_empathy', 'build_rapport_and_common_ground', 'localized_focus', 'reciprocity_and_mutual_benefit'] cluster 2 (1 strategies): ['use_of_everyday_people_as_messengers'] # positive framing/urgency and storytelling cluster 3 (7 strategies): ['emotional_appeal_with_balanced_urgency', 'positive_framing_and_value_alignment', 'positive_tone', 'relatable_hypotheticals', 'stimulate_enthusiasm', 'storytelling_and_relatable_anecdotes', 'transfer_of_association'] # directed facts and action-orientation cluster 4 (3 strategies): ['audience_adaptation', 'encourage_action_with_clear_calls', 'evidence_or_factbased_arguments'] cluster 5 (1 strategies): ['aggressive_and_explicit_directives'] cluster 6 (1 strategies): ['politeness_and_civil_tone'] # social influence cluster 7 (2 strategies): ['social_proof_and_normative_influence', 'use_of_positive_testimonials'] # systematic/thoughtful engagement? cluster 8 (3 strategies): ['address_objections_and_counterarguments', 'cognitive_elaboration', 'gradual_persuasion'] ``` ## deepseek: 10 similar-ish clusters? ```python # negativity cluster 0 (3 strategies): ['namecalling', 'stimulate_anger', 'use_of_negative_testimonials'] # systematic/thoughtful engagement? cluster 1 (4 strategies): ['active_listening_and_empathy', 'address_objections_and_counterarguments', 'cognitive_elaboration', 'gradual_persuasion'] # rapport building cluster 2 (2 strategies): ['build_rapport_and_common_ground', 'reciprocity_and_mutual_benefit'] # storytelling cluster 3 (3 strategies): ['relatable_hypotheticals', 'storytelling_and_relatable_anecdotes', 'transfer_of_association'] # social proof cluster 4 (2 strategies): ['social_proof_and_normative_influence', 'use_of_positive_testimonials'] cluster 5 (1 strategies): ['aggressive_and_explicit_directives'] # action orientation and urgency cluster 6 (4 strategies): ['audience_adaptation', 'emotional_appeal_with_balanced_urgency', 'encourage_action_with_clear_calls', 'stimulate_enthusiasm'] cluster 7 (2 strategies): ['localized_focus', 'use_of_everyday_people_as_messengers'] # constructive, balanced, factual approach? cluster 8 (5 strategies): ['contrastive_tone', 'evidence_or_factbased_arguments', 'negative_tone', 'positive_framing_and_value_alignment', 'positive_tone'] cluster 9 (1 strategies): ['politeness_and_civil_tone'] ```