Course Outline
Introduction to the Stratio Platform
- Overview of Stratio’s architecture and core components.
- The strategic role of Rocket and Intelligence modules in the data lifecycle.
- Procedures for logging in and navigating the Stratio user interface.
Utilizing the Rocket Module
- Data ingestion strategies and pipeline construction.
- Establishing data source connections and configuring transformations.
- Applying PySpark for preprocessing tasks within the Rocket environment.
PySpark Fundamentals for Stratio Users
- Essential PySpark data structures and core operations.
- Implementation of looping constructs, including for, while, and if/else statements.
- Defining and executing custom functions using the def keyword.
Advanced PySpark Integration with Rocket
- Managing streaming ingestion and dynamic transformations.
- Deploying loops and functions in both batch and real-time processing scenarios.
- Best practices for optimizing performance in PySpark pipelines.
Deep Dive into the Intelligence Module
- Overview of data modeling capabilities and analytical features.
- Techniques for feature selection, transformation, and data exploration.
- The role of PySpark in enabling custom analytics and generating insights.
Constructing Advanced Analytics Workflows
- Development of user-defined functions (UDFs) within the Intelligence module.
- Applying conditional logic and loops to structure complex data logic.
- Practical use cases, including segmentation, aggregation, and predictive modeling.
Deployment and Team Collaboration
- Procedures for saving, exporting, and reusing developed workflows.
- Strategies for collaborative work with team members on Stratio.
- Reviewing outputs and integrating results with downstream tools.
Course Summary and Recommended Next Steps
Requirements
- Proficiency in Python programming.
- A solid understanding of data analytics or big data processing concepts.
- Foundational knowledge of Apache Spark and distributed computing principles.
Target Audience
- Data engineers developing on Stratio-based platforms.
- Analysts and developers utilizing the Rocket and Intelligence modules.
- Technical teams adopting PySpark workflows within the Stratio ecosystem.
Testimonials (3)
Learning that the QGIS and a tool that can used by other different professionals such land survey
Bame Duncan Koko - Bentel Technologies (Pty) Ltd
Course - QGIS for Geographic Information System
How to use open satellites data for real applications
Tshering Dorji - Druk Holding and Investments
Course - Advanced Geographic Information Systems (GIS)
Hands-on examples allowed us to get an actual feel for how the program works. Good explanations and integration of theoretical concepts and how they relate to practical applications.