Skip to Main content Skip to Navigation
Journal articles

Empowering Investigative Journalism with Graph-based Heterogeneous Data Management

Abstract : Investigative Journalism (IJ, in short) is staple of modern, democratic societies. IJ often necessitates working with large, dynamic sets of heterogeneous, schema-less data sources, which can be structured, semi-structured, or textual, limiting the applicability of classical data integration approaches. In prior work, we have developed ConnectionLens, a system capable of integrating such sources into a single heterogeneous graph, leveraging Information Extraction (IE) techniques; users can then query the graph by means of keywords, and explore query results and their neighborhood using an interactive GUI. Our keyword search problem is complicated by the graph heterogeneity, and by the lack of a result score function that would enable pruning of the search space. In this work, we describe an actual IJ application studying conflicts of interest in the biomedical domain, and we show how ConnectionLens supports it. Then, we present novel techniques addressing the scalability challenges raised by this application: one allows us to reduce the significant IE costs while building the graph, while the other is a novel, parallel, in-memory keyword search engine, which achieves orders of magnitude speed-up over our previous engine. Our experimental study on the realworld IJ application data confirms the benefits of our contributions.
Complete list of metadata
Contributor : Angelos Christos Anadiotis Connect in order to contact the contributor
Submitted on : Thursday, January 6, 2022 - 3:41:36 PM
Last modification on : Monday, May 30, 2022 - 5:44:01 PM
Long-term archiving on: : Thursday, April 7, 2022 - 6:03:09 PM


Files produced by the author(s)


  • HAL Id : hal-03337650, version 1
  • ARXIV : 2102.04141


Angelos-Christos Anadiotis, Oana Balalau, Théo Bouganim, Francesco Chimienti, Helena Galhardas, et al.. Empowering Investigative Journalism with Graph-based Heterogeneous Data Management. Bulletin of the Technical Committee on Data Engineering, IEEE Computer Society, inPress. ⟨hal-03337650⟩



Record views


Files downloads