Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Overview of Huawei CloudMatrix
- Architecture of the CloudMatrix ecosystem and its deployment lifecycle
- Compatible models, data formats, and various deployment methods
- Common application scenarios and supported hardware chipsets
Model Preparation for Production
- Exporting models from development frameworks (MindSpore, TensorFlow, PyTorch)
- Utilizing ATC (Ascend Tensor Compiler) for efficient format translation
- Distinguishing between static and dynamic shape models
Deployment Process on CloudMatrix
- Creating services and registering model assets
- Launching inference services through user interfaces or command-line tools
- Configuring request routing, security authentication, and access management
Managing Inference Requests
- Differentiating between batch and real-time inference architectures
- Implementing data preprocessing and postprocessing workflows
- Integrating external applications with CloudMatrix services
Monitoring and Performance Optimization
- Reviewing deployment logs and tracing request activity
- Managing resource scaling and implementing load balancing strategies
- Optimizing latency and enhancing throughput capacity
Enterprise Tool Integration
- Linking CloudMatrix with OBS and ModelArts services
- Leveraging workflows and implementing model version control
- Establishing CI/CD pipelines for deployment automation and rollback procedures
Complete Inference Pipeline Implementation
- Building a full image classification workflow
- Conducting performance benchmarks and accuracy validation
- Testing failover mechanisms and system alerting systems
Course Wrap-up and Recommendations for Further Learning
Requirements
- Foundational knowledge of AI model training processes
- Practical experience utilizing Python-based machine learning frameworks
- General awareness of cloud deployment principles
Target Audience
- AI Operations (AIOps) teams
- Machine learning engineers
- Cloud deployment experts operating within Huawei’s infrastructure ecosystem
21 Hours
Testimonials (2)
The extensive selection of tools presented
Miruna Buzduga - Aeronamic Eastern Europe
Course - AI Enablement Training for Engineers
Step by step training with a lot of exercises. It was like a workshop and I am very glad about that.
