New Publication: Identifying Unexpected Behaviors of Agent-based Models

Research Associate Ross Gore, Collaborating Specialist Christopher Lynch and Co-Authors
Conference Paper at Swarmfest 2017: 21st Annual Meeting on Agent Based Modeling and Simulation
August 2017

Abstract: Verification and validation (V&V) techniques commonly require modelers to collect and statistically analyze large amounts of data which require specific methods for ordering, filtering, or converting data points. Modelers need simple, intuitive, and efficient techniques for gaining insight into unexpected behaviors to help in determining if these behaviors are errors or if they are artifacts resulting from the model’s specifications. We present an approach to begin addressing this need by applying heat maps and spatial plots to visually observe unexpected behaviors within agent-based models. Our approach requires the modeler to specify hypotheses about expected model behavior. Agent level outputs of interest are then used to create graphical displays to visually test the hypotheses. Visual identification of unexpected behaviors can direct focus for additional V&V efforts and inform the selection process of follow-on V&V techniques. We apply our approach to a model of obesity.

Read the Article Here