iCANDID has an integration with the X/Twitter API. The application process for access to X/Twitter API has to be handled by the researchers/research teams themselves (more information below). Once a researcher is granted access, iCANDID can use the API key to harvest the required data.

How is data harvested from X/Twitter?

Previously, data from X/Twitter was harvested using academic API access. Because it is impossible to extract all the data from Twitter, we collected data using queries with Twitter accounts (@) and/or hashtags (#), in combination with the desired period (“from-to” or continuous) based on requests from research groups and their ongoing projects. The available data collections from Twitter are therefore limited to certain topics and profiles. An overview of the available data can be found in the Collection registry. Records from Twitter contain metadata (publication date, sender, keywords (hashtags) and mentions (the original author in case it is a retweet), the text of the tweet, a link to the tweet and a permalink for the record on iCANDID.

Due to changes in how X operates (more information), academic API access has been suspended and costs are now attached to gain access to Tweets (cf. X subscription models). Thanks to the EU’s Digital Services Act, it should again become possible for researchers to receive API access to X if their research meets certain criteria.

Getting access to X/Twitter API for research
X was designated as a "Very Large Online Platform" (VLOP) by the European Commission on April 25, 2023. As a VLOP, the EU's Digital Service Act requires X to give access to their data for research purposes. X provides an application form but they only grant access when the research is focused on the detection, identification and understanding of systemic risks in the European Union and X follows a narrow interpretation of this. The European Commission has opened formal proceedings to assess whether X may have breached the Digital Services Act (DSA) in areas linked to risk management, content moderation, dark patterns, advertising transparency and data access for researchers.

You can apply for access to the X API via the X DSA Researcher Application form. In case of refusal you can reach out to the Irish digital services coordinator Coimisiún na Meán, X's country of establishment in the EU, with your request.

Once you have requested and received access to the X API for researchers, you can contact 'icandid[at]kuleuven[dot]be' for help in harvesting data and its integration in iCANDID. For questions or support, you can also contact 'icandid[at]kuleuven[dot]be'.

Got access to X/Twitter API for research?
When contacting us for help in harvesting data, please provide the following information:
  • which accounts (@) you want to collect from. Please also provide the unique Twitter ID, as Handles (e.g. @vooruit_nu) sometimes change and we therefore miss data before the name change. The Twitter ID can be looked up with the following tool https://tweeterid.com/. Input the handle (circled in yellow below) in the tool to receive the correct ID.
  • which hashtags (#) you want to collect
  • for what period (from dd/mm/yyyy – to dd/mm/yyyy) or continuously (daily addition of messages from the previous day)
Image Placeholder



For more information about the application procedure at Twitter, see https://developer.twitter.com/en/use-cases/do-research/academic-research. For questions or support, please contact our helpdesk icandid@kuleuven.be.