website/_posts/projects/2020-05-01-FIKS.md

29 lines
1.8 KiB
Markdown

---
layout: single
title: "AI-Fusion: Emergence Detection for Mixed MARL Systems."
categories: acoustic anomaly-detection projects
excerpt: "Bringing together agents can be an inherent safety problem. Building the basis to mix and match."
header:
teaser: assets/images/projects/robot.png
---
![logo](\assets\images\projects\robot.png){: .align-left style="padding:0.1em; width:5em"}
In cooperation with [Fraunhofer IKS](https://www.iks.fraunhofer.de/), this project explored emergent effects in multi-agent reinforcement learning scenarios, such as mixed-vendor autonomous systems. Emergence, defined as complex dynamics arising from interactions among entities and their environment, was a key focus.
![Relation emergence](/assets/images/projects/rel_emergence.png){: .align-center style="padding:0.1em; width:80%"}
<div class="table-right" style="text-align:right">
| ![logo](\assets\images\projects\full_domain.png){: style="margin:0em; padding:0em; width:15em"} |
| [GitHub Repo](https://github.com/illiumst/marl-factory-grid/) |
| [Install via PyPI](https://pypi.org/project/Marl-Factory-Grid/) |
| [Read-the-docs](https://marl-factory-grid.readthedocs.io/en/latest/) |
| Read the Paper (TBA) |
</div>
We developed a high-performance environment in Python, adhering to the [gymnasium](https://gymnasium.farama.org/main/) specifications, to facilitate reinforcement learning algorithm training.
This environment uniquely supports a variety of scenarios through `modules` and `configurations`, with capabilities for per-agent observations and handling of multi-agent and sequential actions.
Additionally, a [Unity demonstrator unit](https://github.com/illiumst/F-IKS_demonstrator) was developed to replay and analyze specific scenarios, aiding in the investigation of emerging dynamics.