Design Decision Patterns for Visualizing Multivariate Graphs

pathline poemage nbgm
NSF Grant 1350896
PI: Miriah Meyer
July 2014 - June 2020 (estimated)

Multivariate graphs are an important data type in many high-impact application areas. Yet we know little about the underlying principles of how to effectively visualize them. Despite the plethora of techniques and methods for visualizing graphs, much of this work breaks down when attempting to visualize more than one or two additional attributes — there are simply not enough visual channels to succinctly show all aspects of a rich, complex multivariate graph. Compounding this challenge is the large design space of possible encodings, making it difficult for visualization practitioners to design effective visualizations of multivariate graphs using a top-down, problem-agnostic approach. This project will establish the first set of validated, foundational principles for visualizing multivariate graphs using a structured, methodological research approach. Several target application areas will drive the investigations using a design study approach. These areas were chosen to represent a wide spectrum of possible applications in which multivariate graphs play a central role, thus fostering generalizable results.

resulting techniques

RESHAPING MULTIVARIATE GRAPHS
connectivity
  matrix

Networks are a natural way of thinking about many datasets. The data on which a network is based, however, is rarely collected in a form that suits the analysis process, making it necessary to create and reshape networks. Data wrangling is widely acknowledged to be a critical part of the data analysis pipeline, yet interactive network wrangling has received little attention in the visualization research community. In this technique, we implement a set of operations that are important for wrangling multivariate network datasets. Key operations include creating a network from source data such as tables, reshaping a network by introducing new node or edge classes, filtering nodes or edges, and deriving new node or edge attributes. Our technique enables analysts to execute these operations with little to no programming, and to immediately visualize the results. It provides views to investigate the network model, a sample of the network, and node and edge attributes.



CONNECTIVITY MATRIX
connectivity
  matrix

A key task in multivariate graph analysis is the exploration of connectivity, to, for example, analyze how signals flow through neurons, or to explore how well different cities are connected by flights. While standard node-link diagrams are helpful in judging connectivity, they do not scale to large networks. Adjacency matrices also do not scale to large networks and are only suitable to judge connectivity of adjacent nodes. A key approach to realize scalable graph visualization are queries: instead of displaying the whole network, only a relevant subset is shown. Query-based techniques for analyzing connectivity in graphs, however, can also easily suffer from cluttering if the query result is big enough. To remedy this, we introduce a technique called the connectivity matrix that provide an overview of the connectivity and reveal details on demand.



VISUALIZATION OF PATHS THROUGH SPATIALLY-CONSTRAINED NODES
paths through
  spatially constrained nodes

Graphs that consist of nodes that are spatial constrained -- such nodes with a geospatial location -- are difficult to visualize due to the inability to move nodes to reduce visual clutter. Tackling this challenge, we developed a novel technique that supports visualization of paths through spatially constrained graphs. The technique reduces visual clutter while also maintaining visibility of all nodes through an algorithm that reroutes edges around non-path nodes, while also ensuring that individual, intersecting paths are visible. This technique supports visualization and analysis of the intersecting and diverging nature of paths.

resulting methods

A TYPOLOGY OF VISUALIZATION TECHNIQUES FOR MULTIVARIATE GRAPHS
connectivity
  matrix

Multivariate networks are made up of nodes and their relationships (links), but also data about those nodes and links as attributes. Most real-world networks are associated with several attributes, and many analysis tasks depend on analyzing both, relationships and attributes. Visualization of multivariate networks, however, is challenging, especially when both the topology of the network and the attributes need to be considered concurrently. We analyzed current practices and classify techniques along four axes: layouts, view operations, layout operations, and data operations. We also provide an analysis of tasks specific to multivariate networks and give recommendations for which technique to use in which scenario. Finally, we survey application areas and evaluation methodologies.



A FRAMEWORK FOR CREATIVE VISUALIZATION-OPPORTUNITIES WORKSHOPS
connectivity
  matrix

Applied visualization researchers often work closely with domain collaborators to explore new and useful applications of visualization. The early stages of collaborations are typically time consuming for all stakeholders as researchers piece together an understanding of domain challenges from disparate discussions and meetings. A number of recent projects, however, report on the use of creative visualization-opportunities (CVO) workshops to accelerate the early stages of applied work, eliciting a wealth of requirements in a few days of focused work. Yet, there is no established guidance for how to use such workshops effectively. Through a two-year collaboration in which we analyzed the use of 17 workshops in 10 visualization contexts we developed a framework for CVO workshops that 1) identifies a process model for using workshops; 2) describes a structure of what happens within effective workshops; 3) recommends 25 actionable guidelines for future workshops; and 4) presents an example workshop and workshop methods.



ACTION DESIGN RESEARCH FOR APPLIED VISUALIZATION RESEARCH

In applied visualization research, artifacts are shaped by a series of small design decisions, many of which are evaluated quickly and informally via methods that often go unreported and unverified. Such design decisions are influenced not only by visualization theory, but also by the people and context of the research. While existing applied visualization models support a level of reliability throughout the design process, they fail to explicitly address the influence of the research context in shaping the resulting design artifacts. In this work, we look to action design research (ADR) for insight into filling this gap. In particular, ADR offers a framework along with a set of guiding principles for navigating and capitalizing on the disruptive, subjective, human-centered nature of applied design research, while aiming to ensure reliability of the process and design.



NESTED BLOCKS AND GUIDELINES MODEL
connectivity
  matrix

The nested blocks and guidelines model for describing visualization design decisions extends previous models to provide explicit mechanisms that capture and discuss design decision rationale. Blocks are the outcomes of design decisions throughout the design process, and guidelines discuss relationships between these blocks. Using the NBGM we are able to more concretely identify possible weaknesses in exisitng and new guidelines, clarify assumptions that require further evaluation, and provide feedback on the rigor and validity of visualization research results.

team

Miriah Meyer

Associate Professor, School of Computing, University of Utah

Miriah

Alex Bigelow

PhD student

Alex

collaborators

project alumni

Ethan Kerzner, PhD student

Nina McCurdy, PhD student

Josh Dawson, MS student

publications

Origraph: Interactive Network Wrangling. Alex Bigelow, Carolina Nobre, Miriah Meyer, Alex Lex. Proceedings of IEEE VAST, 2019.

The State of the Art in Visualizing Multivariate Networks. Carolina Nobre, Miriah Meyer, Marc Streit, Alexander Lex. Computer Graphics Forum (Proceedings of EuroVis 2019), 38(3), 2019.

A Framework for Creative Visualization-Opportunities Workshops. Ethan Kerzner, Sarah Goodwin, Jason Dykes, Sara Jones, Miriah Meyer. IEEE Transactions on Visualization and Computer Graphics (Proceedings of InfoVis 2018), 25(1), 2019.

Graffinity: Visualizing Connectivity in Large Graphs. Ethan Kerzner, Alex Lex, Crystal Sigulinsky, Tim Urness, Bryan Jones, Robert Marc, Miriah Meyer. Computer Graphics Forum (Proceedings of EuroVis 2017), 36(3):251-260, 2017.

The rod-cone crossover connectome of mammalian bipolar cells. J. Scott Lauritzen, Crystal Sigulinsky, James Anderson, Noah Nelson, Daniel Emrich, Christopher Rapp, Nicholas McCarthy, Michael Kalloniatis, Ethan Kerzner, Miriah Meyer, Bryan Jones, Robert Marc. Journal of Comparative Neurology, 2016.

Action Design Research and Visualization Design. Nina McCurdy, Jason Dykes, Miriah Meyer. Proceedings of the Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization (BELIV), IEEE VIS 2016.

Poemage: Visualizing the Sonic Topology of a Poem. Nina McCurdy, Julie Lein, Katharine Coles, Miriah Meyer. IEEE Transactions on Visualization and Computer Graphics (Proceedings of InfoVis 2015), 22(1):439-448, 2016.

The Nested Blocks and Guidelines Model. Miriah Meyer, Michael Sedlmair, P. Samuel Quinan, Tamara Munzner. Journal of Information Visualization, 14(3):234-249, 2015.

theses

Action Design Research for Applied Visualization Design. Nina McCurdy. University of Utah, PhD Thesis, May 2020.

A Framework for Creative Visualization-Opportunities Workshops. Ethan Kerzner. University of Utah, PhD Thesis, May 2019.

Reflections, Models, and Software for Iterative Visualization Design. Alex Bigelow. University of Utah, PhD Thesis, May 2019.

education

teaching

Each fall we teach a class on the fundamental concepts of visualization in the School of Computing at the University of Utah. This course is a mix of undergraduate and graduate students. The syllabus, lecture materials, and readings can be found on the course website. Starting in Fall 2019 we will introduce a new visualization course targeting early-stage understudents.

outreach

We have conducted a number of events to teach high school girls about visualization and computer science. Through an annual collaboration with local high schools, we give short talks to girls about the power of visualization, and answer questions about being a computer scientist. We are also involved with the annual NCWIT Aspirations Awards that recognizes young women who are active and interested in computing and technology, and encourages them to pursue their passions.

software and materials

Origraph [link]: Origraph is a tool for interactively wrangling multivariate networks. The tool makes it possible to re-imagine a network model as your questions change —- not just importing graphs or building one from tabular data.



Wizard for Multivariate Network Visualization Techniques [link]: Multivariate networks are networks where both the structure of the network and the attributes of the nodes and edges matter. It turns out, these are very common. Every person in a social network, for example, has both, relationships and lots of other characteristics, such as their age, the school they went to, or the city they live in. Multivariate network visualization techniques are designed to be able to show both, these attributes and the structure. Using these visualization techniques, we can analyze, for example, if a network of friends predominantly went to the same high school. The visualization research community has developed many techniques to visualize these kinds of networks, and our web-based wizard is designed to help you sort through these options. Use our wizard to find the right multivariate network visualization technique for your datasets and tasks.



Creative Visualization-Opportunities Workshops [link]: CVO workshops are a participatory design method that, when used in the early stages of collaborative, applied visualization research, allow visualization designers to efficiently develop a rich understanding of visualization opportunities within a domain. We provide an example workshop that can serve as a starting point for the design of future workshops. We also provide a list of methods that we have used in workshops, as well as a list of 21 pitfalls to avoid.



Graffinity [link]: Graffinity is a prototype implementation of two visualization techniques for visualizing connectivity realtionships in large graphs. These techniques are the connectivity matrix and intermediate node table. Graffinity also includes a query interface and supplemental views in the form of path lists and node-link diagrams. Graffinity was developed at the University of Utah as part of an ongoing collaboration between data visualization experts and neuroscientists.



Poemage [link]: Poemage is a visualization system for exploring the the complex structures formed from a spatially-constrained graph representing the interaction of words connected through some sonic or linguistic resemblance. The graph is generated using text-to-speach algorithms combined with our novel NLP approach for defining sonic similarities. The visualization tool allows the user to explore paths through the graph using several, linked views, and includes a novel technique for visualizing multiple paths directly in the text document itself. Poemage was developed at the University of Utah as part of an ongoing, highly exploratory collaboration between data visualization experts and literary scholars.



last update October 15, 2020