During mass vaccination campaigns, social media platforms can facilitate broader access to public health information, but they may also engender vaccine hesitancy through the spread of false or misleading information. We design and deploy a Facebook Messenger chatbot to test interventions targeting sources of vaccine hesitancy among social media users in Kenya and Nigeria.