Progressive Data Analysis

Our civilization is collecting data at a pace never seen before. While data analysis has made tremendous progresses in scalability in the last decade, this progress has only benefited “confirmative” analysis or model-based computation; progress in data exploration has lagged behind. The main reason is that, to maintain their efficiency during exploration, humans need a rapid feedback loop of about 10 seconds. However, when data becomes larger or algorithms more complex, bounding the latency is not possible with existing computation paradigms. To address this problem, recent research have proposed an approach called Progressive Visual Analytics (PVA). Instead of performing the whole computation in one long step, PVA quickly generates estimates of the results and updates them continuously to allow the analyst to 1) monitor progress, usually with data visualizations, 2) steer algorithms by interactively adjusting parameters while the computation is performed, and 3) control the process (start, stop, resume).

Our objective is to explore this new field of research. We are studying it with multiple facets, both from the human side, and from the machine side.

Positions

We have a post-doctoral position on the topic. If you are interested, contact Jean-Daniel Fekete.

Current Topics

Studies on Requirements for Progressive Visual Analytics

We study the cognitive, perceptive, and HCI issues raised by progressive data analysis.

Software Infrastructure

We develop ProgressiVis, a toolkit for progressive data analysis in Python.

Progressive Data Structure and Algorithms

We study the data structure suited to progressive data analysis, and how to transform standard data analysis algorithms into their progressive counterpart.

Publications

  • Sriram Karthik Badam, Niklas Elmqvist, Jean-Daniel Fekete. Steering the Craft: UI Elements and Visualizations for Supporting Progressive Visual Analytics . Computer Graphics Forum, Wiley, 2017, Eurographics Conference on Visualization (EuroVis 2017), 36 (3), pp.12. <hal-01512256>
  • Emanuel Zgraggen, Alex Galakatos, Andrew Crotty, Jean-Daniel Fekete, Tim Kraska. How Progressive Visualizations Affect Exploratory Analysis. IEEE Transactions on Visualization and Computer Graphics, Institute of Electrical and Electronics Engineers, 2017, <10.1109/TVCG.2016.2607714>. <hal-01377896>
  • Jean-Daniel Fekete, Romain Primet. Progressive Analytics: A Computation Paradigm for Exploratory Data Analysis. 2016. <<arXiv:1607.05162 <hal-01361430>
  • Jean-Daniel Fekete. ProgressiVis: a Toolkit for Steerable Progressive Analytics and Visualization. 1st Workshop on Data Systems for Interactive Analysis, Oct 2015, Chicago, United States. pp.5, 2015, <http://www.interactive-analysis.org/>. <hal-01202901>

Contact

For more information contact Jean-Daniel Fekete.