> For the complete documentation index, see [llms.txt](https://youness-organization-4.gitbook.io/recommendation-system-infrastructure/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://youness-organization-4.gitbook.io/recommendation-system-infrastructure/infrastructure-setup.md).

# Infrastructure Setup

## Requirements : 

Our infrastructure leverages Docker for initial deployment, configuring Docker images for each

| Technologie    | Version | Docker Image       |
| -------------- | :-----: | ------------------ |
| Apache Nifi    |  latest | apache/nifi        |
| Apache Airflow |  latest | apache/airflow     |
| Feast          |  latest | blcox/feast        |
| MLflow         |  latest | bitnami/mlflow     |
| MinIo          |  latest | bitnami/minio      |
| Postgres       |  latest | postgres           |
| Python         |  3.10.6 | python             |
| Tensorflow     |  latest | bitnami/tensorflow |
| PyTorch        |  latest | pytorch/pytorch    |

besides other technologies like Git, Azure DevOps, Azure Blob Storage, and Azure VM.

Apache Nifi : 

#### Setting Up Apache NiFi, ZooKeeper, and NiFi Registry using Docker

To set up Apache NiFi, ZooKeeper, and NiFi Registry using Docker, you need to follow these steps:

**Prerequisites**

* Ensure Docker is installed on your system.
* Pull the necessary Docker images.

**Step-by-Step Guide**

1. **Pull Docker Images:**

   ```bash
   docker pull apache/nifi:latest
   docker pull apache/zookeeper:latest
   docker pull apache/nifi-registry:latest
   ```