/
2.1. ACDI - Storage & System Requirements and Best Practices

2.1. ACDI - Storage & System Requirements and Best Practices

 

 

ACDI - Storage & System Requirements and Best Practices

  1. File System

    1. ACDI requires a native Linux file system.

    2. OpenSearch requires a native Linux file system for optimal performance. Avoid using network-shared or network-based file systems (such as NFS or SMB).

    3. Network-shared drives are not recommended for the software in general, as they may introduce latency and affect performance.

  1. Disk Performance

    1. A minimum disk read/write speed of 300-500 MB/s is required for efficient Open Search operation, ensuring smooth data handling and high availability.

  1. Multi-Node clusters While an ACDI single-node cluster can be suitable for development, testing, or small-scale deployments, it's generally not recommended for production environments or situations with demanding requirements.

    1. When is a multi-node cluster particularly beneficial?

      1. Large datasets: If you're dealing with terabytes or petabytes of data.

      2. High query volume: If your application receives many search requests.

      3. High data ingestion volume: The usage of data ingestion nodes frees up data nodes and leads to improved overall cluster performance and stability.

      4. Complex analytics: If you're performing complex aggregations or machine learning tasks.

    2. Additionally, an ACDI multi-node cluster offers several advantages over a single-node setup

      1. Redundancy: In a multi-node cluster, data is distributed across multiple nodes. If one node fails, the others can take over, ensuring continuous operation with minimal downtime.

      2. Increased Capacity: A multi-node cluster can handle larger amounts of data and higher query volumes than a single node.

      3. Improved Performance: Distributing data and search requests across multiple nodes leads to faster indexing and searching and overall better performance.

      4. Easier Scaling: You can easily add more nodes to your cluster as your needs grow, without significant disruption.