Investing in data talent for social impact matters now more than ever

In recent years, there has been a growing recognition worldwide that data-driven decision making is indispensable to addressing complex and interdisciplinary challenges. The social sector ecosystem is increasingly relying on large datasets and sophisticated technologies to tackle some of the world’s most pressing issues such as climate change, epidemics and inequality. In India, the democratization of data through rapid digitization and open data platforms has led to a pivotal shift in the approach taken by nonprofits and governments alike. 

If the Data for Social Impact (DSI) field keeps growing at the same rate as all jobs in the formal sector, it is estimated that there will be about 220,000 DSI jobs to fill in developing countries over the next ten years. But the supply of quality talent has remained low even though data analysts and scientists have been among the jobs with the highest demand. There are various factors contributing to this gulf between demand and supply, including limited availability of data science training programs with a strong social impact orientation as well as lack of exposure to promising pathways to long-term careers. In this context, through the India Climate and Health Data Capacity Accelerator (IDCA), J-PAL South Asia, in collaboration with Data.org, is working to build a cohort of professionals equipped to ride this wave of data utilization by giving them the tools to identify patterns, spot emerging trends, and make evidence-based decisions. 

While initiatives like these aim to address the data talent gap, parallel initiatives by key institutions are driving the creation of the ethical framework and robust data systems to tackle pressing challenges across sectors. Top bodies like the Government of India’s Ministry of Electronics and Information Technology are catalyzing ethical use of artificial intelligence, while organizations like the Council on Energy, Environment and Water (CEEW), Janaagraha, and Civic Data Lab are establishing a robust data architecture to address multidimensional issues like climate change and public health. 

For instance, CEEW is actively working towards developing a ‘Climate resilience atlas for India’ to track district hotspots and inform budgetary allocations at a sub-national level. Similar initiatives have been taken by pioneering institutions like ISRO and IIT-Madras to develop high-resolution geospatial maps that can utilize data modeling to track landslides and at-risk populations. Organizations such as Khushi Baby are investing in new technologies to catalyze adoption of evidence-based digital health interventions—from smartphone based diagnosis of anemia to LLM-based chatbots for Accredited Social Health Activists (ASHAs) to real-time climate health vulnerability index maps for district officials in Rajasthan.

Building on these innovative efforts,the IDCA Fellowship model stands out for its focus on real-world impact, combining rigorous training with practical, hands-on experience. Fellows work on collaborative projects with host institutions, receive mentorship from industry and academic experts, and are trained to communicate their findings effectively to governments, civil society organizations and others. This holistic approach equips fellows to develop data-driven solutions to critical challenges in climate and health, in line with J-PAL’s mission of addressing some of the world’s biggest problems with science and data.

The IDCA fellowship program is now being hosted on HIVE, the World Health Organization's invite only, digital platform for health emergency preparedness.

There are four defining features of the IDCA Fellowship:

• Creating training programs that adequately cater to the demands of the social sector: Data science courses can be strengthened by rooting the study of statistics and advanced data analytics in interdisciplinary thinking, supplemented by exposure to working with large datasets relevant to social sector themes. J-PAL South Asia regularly engages with training providers, such as universities, and social impact organizations (SIOs)  to identify the specific skills in demand, using these insights to refine the fellowship program and pedagogical frameworks. This ensures that the training effectively caters to the needs of the social sector.
• Collaborating with Data-driven SIO leaders to nurture talent: The IDCA Fellowship model emphasizes collaboration with SIOs to address critical challenges in climate and health. By working closely with SIO, IDCA identifies organizational needs and co-creates fellowship opportunities that align with their goals. This partnership-driven approach guarantees fellows are placed in impactful roles, contributing to the capacity building of these organizations while gaining real-world experience. Through these initiatives, IDCA ensures that both organizations and individuals are empowered to leverage data effectively to address pressing climate and health challenges. Such collaborations ensure that data-driven solutions are tailored to the needs of the social sector.
• Improving diversity and representation: Opportunities to pursue data science remain inequitable across groups divided by socioeconomic status, gender, and other identities. These inequities stem from systemic barriers such as unequal access to quality education, financial constraints, and digital divide. Underrepresentation of marginalized groups in STEM fields, pervasive gender biases, and a lack of tailored support or mentorship further limit opportunities for these individuals to enter and thrive in data science programs. IDCA is actively working to make data science more accessible and equitable by designing fellowships that prioritize outreach to marginalized communities, providing financial support, and fostering inclusive learning environments. The IDCA Fellowship works with leading academic institutions such as Ashoka University, BITS Pilani, and IIIT Delhi to design training programs that integrate technical rigor with real-world relevance. Through targeted outreach, open-source resources, and partnerships with diverse institutions, IDCA is creating pathways that enable underrepresented groups to develop quality data skills for the social impact sector, bringing a wide range of perspectives and experiences to address critical climate and health challenges.
• Providing clear career ladders and professional development opportunities: Hands-on project work is integrated with structured mentorship and targeted skills training to help fellows advance their careers. Fellows are connected to a global network of professionals and organizations which helps ensure continued learning and leadership opportunities. Additionally, through exposure to networks and events, IDCA equips fellows with the skills and visibility needed to establish sustainable career pathways in the social sector.

Through the India Climate and Health Data Capacity Accelerator, data fellows are not only trained to analyze and interpret complex data but also equipped with the critical skills to communicate their insights effectively. By bridging the gap between data and decision-making, the fellowship empowers the fellows to translate data into actionable narratives, enabling the larger ecosystem to make informed, evidence-based decisions that drive impact in the climate and health space.  

IDCA Program team members and the host organizations, Khushi Baby and CEEW, contributed to this blog.