CI850K01A Launch edge AI server solutions for generative AI

CI850K01A Four solutions for different applications

Advantech offers four options: the AIR-520-L13B/L33B/L70B and L70B-Plus, tailored to different sizes and applications. L13B is ideal for chatbots and language translation to increase productivity and innovation in content creation. L70B specializes in complex data analysis and decision making in specialized areas. In addition, the L70B-Plus is equipped with the NVIDIA AI Enterprise software platform, which provides an end-to-end, reliable optimized AI SDK, long-term support and expert consulting services to ensure efficient deployment in business scenarios.

Easy and quick installation, optimized cost effectiveness

All solutions include the SQ AI100 AI SSD, which uses Phison aiDAPTIV+ technology. This series of SSDS acts as an extension of the graphics card vRAM, enabling the system to fine-tune large language models (LLM) with minimal graphics. This solution not only reduces the budget burden on customers, but also makes edge AI servers more compact than traditional mainframe servers. Designed for a variety of edge AI applications, the AIR-520 Edge AI server is the size of a desktop computer and can be mounted on a rack with the appropriate accessories. With its slim design,CI850K01A the product can be easily deployed in edge AI fine-tuning environments, eliminating customer space and maintenance concerns.

Fast track the development of generative AI through software services

In addition to large Language model (LLM) fine-tuning capabilities, Advantech also offers an Edge AI SDK with a generative AI training studio that comes pre-loaded with Llama-2 13B/33B/70B models for applications such as chatbots and data analytics. This will simplify and accelerate customer-specific Large Language model (LLM) model training and inference evaluation with the AIR-520. In addition, Advantech’s DeviceOn provides OTA software/container updates and remote management, facilitating efficient edge AI orchestration and long-term maintenance.

Product features:

Powered by the server-grade performance of AMD’s EPYC 7003 processor, it offers up to 64 cores, CI850K01A 768GB DRAM, and four PCle x16 expansion slots
Up to 768GB DDR4 3200 DRAM
Supports four PCIe x16 expansion slots
The integrated 1200W PSU can power two NVIDIA L40S graphics cards

Share this post
Facebook
Twitter
LinkedIn
WhatsApp