This model implements a classic scenario used in Reinforcement Learning problem, the “Cliff Walking Problem”. Consider the gridworld shown below (SUTTON; BARTO, 2018). This is a standard undiscounted, episodic task, with start and goal states, and the usual actions causing movement up, down, right, and left. Reward is -1 on all transitions except those into the region marked “The Cliff.” Stepping into this region incurs a reward of -100 and sends the agent instantly back to the start (SUTTON; BARTO, 2018).

The problem is solved in this model using the Q-Learning algorithm. The algorithm is implemented with the support of the NetLogo Q-Learning Extension

We demonstrate how a simple model of community associated Methicillin-resistant Staphylococcus aureus (CA-MRSA) can be easily constructed by leveraging the statecharts and ReLogo capabilities in Repast Simphony.

Irrigation game calibrated on experimental data

This is a replication of the Pumpa model that simulates the Pumpa Irrigation System in Nepal (Cifdaloz et al., 2010).

The study goes back to a model created in the 1990s which successfully tried to replicate the changes of the percentages of female teachers among the teaching staff in high schools (“Gymnasien”) in the German federal state of Rheinland-Pfalz. The current version allows for additional validation and calibration of the model and is accompanied with the empirical data against which the model is tested and with an analysis program especially designed to perform the analyses in the most recent journal article.

The model is designed to simulate the behavior and decision-making processes of individuals (agents) in a social network. It aims to represent the changes in individual probability to take any action based on changes in attributes. The action is anything that can be reasonably influenced by the three influencing methods implemented in this model: peer pressure, social media, and state campaigns, and for which the user has a decision-making model. The model is implemented in the multi-agent programmable environment NetLogo 6.3.0.

Toolkit to specify demographic multistate model with a behavioural element linking intentions to behaviour

Like many developing countries, Nigeria is faced with a number of tradeoffs that pit rapid economic development against environmental preservation. Environmentally sustainable, “green” economic development is slower, more costly, and more difficult than unrestricted, unregulated economic growth. The mathematical model that we develop in this code suggests that widespread public awareness of environmental issues is insufficient to prevent the tendency towards sacrificing the environment for the sake of growth. Even if people have an understanding of negative impacts and always choose to act in their own self-interest, they may still act collectively in such a way as to bring down the quality of life for the entire society. We conclude that additional actions must be taken besides raising public awareness of the environmental problem.

Chicago’s demographic, neighborhood, sex risk behaviors, sexual network data, and HIV prevention and treatment cascade information from 2015 were integrated as input to a new agent-based model (ABM) called the Levers-of-HIV-Model (LHM). This LHM, written in NetLogo, forms patterns of sexual relations among Men who have Sex with Men (MSM) based on static traits (race/ethnicity, and age) and dynamic states (sexual relations and practices) that are found in Chicago. LHM’s five modules simulate and count new infections at the two marker years of 2023 and 2030 for a wide range of distinct scenarios or levers, in which the levels of PrEP and ART linkage to care, retention, and adherence or viral load are increased over time from the 2015 baseline levels.

This model aims to explore how gambling-like behavior can emerge in loot box spending within gaming communities. A loot box is a purchasable mystery box that randomly awards the player a series of in-game items. Since the contents of the box are largely up to chance, many players can fall into a compulsion loop of purchasing, as the fear of missing out and belief in the gambler’s fallacy allow one to rationalize repeated purchases, especially when one compares their own luck to others. To simulate this behavior, this model generates players in different network structures to observe how factors such as network connectivity, a player’s internal decision making strategy, or even common manipulations games use these days may influence a player’s transactions.