This model implements a classic scenario used in Reinforcement Learning problem, the “Cliff Walking Problem”. Consider the gridworld shown below (SUTTON; BARTO, 2018). This is a standard undiscounted, episodic task, with start and goal states, and the usual actions causing movement up, down, right, and left. Reward is -1 on all transitions except those into the region marked “The Cliff.” Stepping into this region incurs a reward of -100 and sends the agent instantly back to the start (SUTTON; BARTO, 2018).

The problem is solved in this model using the Q-Learning algorithm. The algorithm is implemented with the support of the NetLogo Q-Learning Extension

A stylized scale model to codesign with villagers an agent-based model of bushmeat hunting in the periphery of Korup National Park (Cameroon)

Agriculture is the largest water-consuming sector worldwide, responsible for almost 70% of the world’s total freshwater consumption. Agricultural water reuse is one of the most sustainable and reliable methods to alleviate water shortages worldwide. However, the dynamics of agricultural water reuse adoption by farmers and its impacts on local water resources are still unknown to the scientific community, according to the literature. Therefore, the primary purpose of the WRAF model is to investigate the micro-level dynamics of agricultural water reuse adoption by farmers and its impacts on local water resources. The WRAF was developed using agent-based modeling as an exploratory tool for scenario analysis. The model was specifically designed for researchers and water resources decision-makers, especially those interested in natural resources management and water reuse.
WRAF simulates a virtual agricultural area in which several autonomous farms operate. It also simulates these farms’ water consumption dynamics. The developed model includes two types of agents: farmers and wastewater treatment plants. In general, farmer agents are the main water-consuming agents, and wastewater treatment plant agents are recycled water providers in the WRAF model. Dynamic simulation of agricultural water supply and demand in the area allows the user to observe the results of various irrigation water management scenarios, including recycled water. The models also enable the user to apply multiple climate change scenarios, including normal, moderate drought, severe drought, and wet weather conditions.

The Communicating Hazard Information in the Modern Environment (CHIME) agent-based model (ABM) is a Netlogo program that facilitates the analysis of information flow and protective decisions across space and time during hazardous weather events. CHIME ABM provides a platform for testing hypotheses about collective human responses to weather forecasts and information flow, using empirical data from historical hurricanes. The model uses real world geographical and hurricane data to set the boundaries of the simulation, and it uses historical hurricane forecast information from the National Hurricane Center to initiate forecast information flow to citizen agents in the model.

The ForagerNet3_Demography model is a non-spatial ABM designed to serve as a platform for exploring several aspects of hunter-gatherer demography.

The model analyzes the economic and ecological effects of a provision of livestock drought insurance for dryland pastoralists. More precisely, it yields qualitative insights into how long-term herd and pasture dynamics change through insurance.

The natural selection of foresight, an accuracy at assess the environment, under degrees of environmental heterogeneity. The model is designed to connect local scale mobility, from foraging, with the global scale phenomenon of population dispersal.

The General Housing Model demonstrates a basic housing market with bank lending, renters, owners and landlords. This model was developed as a base to which students contributed additional functions during Arizona State University’s 2020 Winter School: Agent-Based Modeling of Social-Ecological Systems.

This model was designed to study resilience in organizations. Inspired by ethnographic work, it follows the simple goal to understand whether team structure affects the way in which tasks are performed. In so doing, it compares the ‘hybrid’ data-inspired structure with three more traditional structures (i.e. hierarchy, flexible/relaxed hierarchy, and anarchy/disorganization).

This BNE-informed ABM ultimately aims to provide a more realistic description of complicated pedestrian behaviours especially in high-density and life-threatening situations. Bayesian Nash Equilibrium (BNE) was adopted to reproduce interactive decision-making process among rational and game-playing agents. The implementations of 3 behavioural models, which are Shortest Route (SR) model, Random Follow (RF) model, and BNE model, make it possible to simulate emergent patterns of pedestrian behaviours (e.g. herding and self-organised queuing behaviours, etc.) in emergency situations.

According to the common features of previous mass trampling accidents, a series of simulation experiments were performed in space with 3 types of barriers, which are Horizontal Corridors, Vertical Corridors, and Random Squares, standing for corridors, bottlenecks and intersections respectively, to investigate emergent behaviours of evacuees in varied constricted spatial environments. The output of this ABM has been available at https://data.mendeley.com/datasets/9v4byyvgxh/1.