This model implements a classic scenario used in Reinforcement Learning problem, the “Cliff Walking Problem”. Consider the gridworld shown below (SUTTON; BARTO, 2018). This is a standard undiscounted, episodic task, with start and goal states, and the usual actions causing movement up, down, right, and left. Reward is -1 on all transitions except those into the region marked “The Cliff.” Stepping into this region incurs a reward of -100 and sends the agent instantly back to the start (SUTTON; BARTO, 2018).

The problem is solved in this model using the Q-Learning algorithm. The algorithm is implemented with the support of the NetLogo Q-Learning Extension

The purpose of this study is another agent-based replication of a System Dynamics model (Anderson,1973) where he analysed the dynamics of nutrient, biomass, oxygen and detritus in a model lake under conditions of artificial fertilising and policies to deal with the consequences of artificial fertilising.. A first replication (Möhring & Troitzsch,2001) added those agents to the original model that were necessary to move the role of the experimenter into the model, whereas this replication replaces the original lake with a collection of small elements between which biomass, nurtrents and oxygen are exchanged, adds rivers upstream and downstream as well as adjacent land divided into villages and populated with farms and industrial plants run by individual persons.

This model implements two types of network diffusion from an initial group of activated nodes. In complex contagion, a node is activated if the proportion of neighbour nodes that are already activated exceeds a given threshold. This is intended to represented the spread of health behaviours. In simple contagion, an activated node has a given probability of activating its inactive neighbours and re-tests each time step until all of the neighbours are activated. This is intended to represent information spread.

A range of networks are included with the model from secondary school friendship networks. The proportion of nodes initially activated and the method of selecting those nodes are controlled by the user.

ForagerNet3_Demography is a non-spatial ABM for exploring hunter-gatherer demography. Key methods represent birth, death, and marriage. The dependency ratio is an imporant variable in many economic decisions embedded in the methods.

A model for simulating farmers and foresters response on changing climate and changing socio-economic parameters. Modeled are changes in land-use as well as in ecosystem services provision.

The model is based on the influence function of the Leviathan model (Deffuant, Carletti, Huet 2013 and Huet and Deffuant 2017). We aim at better explaining some patterns generated by this model, using a derived mathematical approximation of the evolution of the opinions averaged.

We consider agents having an opinion/esteem about each other and about themselves. During dyadic meetings, agents change their respective opinion about each other, and possibly about other agents they gossip about, with a noisy perception of the opinions of their interlocutor. Highly valued agents are more influential in such encounters.

We show that the inequality of reputations among agents have a negative effect on the opinions about the agents of low status.The mathematical analysis of the opinion dynamic shows that the lower the status of the agent, the more detrimental the interactions are for the opinions about this agent, especially when gossip is activated, while the interactions always tend to increase the opinions about agents of high status.

We model the relationship between natural resource user´s individual time preferences and their use of destructive extraction method in the context of small-scale fisheries.

This agent-based model explores the existence of positive feedback loops related to illegal, unregulated, unreported (IUU) fishing; the use of forced labor; and the depletion of fish populations due to commercial fishing.

This model represents technological and ecological behaviors of mobile hunter-gatherers, in a variable environment, as they produce, use, and discard chipped stone artifacts. The results can be analyzed and compared with archaeological sites.

This agent-based model examines the impact of seasonal aggregation, dispersion, and learning opportunities on the richness and evenness of artifact styles under random social learning (unbiased transmission).