Building Blocks¶
Seeknal provides modular building blocks that you can combine to create powerful data pipelines. This section describes each building block in detail.
What Are Building Blocks?¶
Building blocks are the fundamental components of Seeknal pipelines:
- Sources: Define where your data comes from
- Transforms: Specify how to transform your data
- Common Config: Reusable column mappings, rules, and SQL snippets
- Aggregations: Aggregate data across entities and time
- Feature Groups: Organize features for ML use cases
- Semantic Models: Define metrics for analytics
- Tasks: Advanced processing with Python
When to Use Building Blocks¶
Use Building Blocks When:¶
- You need detailed reference information
- You're designing complex pipelines
- You want to understand available options
- You're troubleshooting pipeline issues
Use Tutorials When:¶
- You're learning Seeknal for the first time
- You want hands-on examples
- You prefer step-by-step guidance
Building Blocks Overview¶
| Block | Description | Use Case |
|---|---|---|
| Sources | Data ingestion from files, databases, APIs | Getting data into Seeknal |
| Transforms | Data transformations with SQL or Python | Cleaning, enriching, reshaping data |
| Common Config | Shared column mappings, rules, SQL snippets | DRY pipelines, consistent naming |
| Aggregations | First and second-order aggregations | Computing metrics, rollups |
| Feature Groups | Feature organization with point-in-time joins | ML feature engineering |
| Semantic Models | Metric definitions for analytics | Business intelligence, KPIs |
| Tasks | Advanced Python processing | Custom logic, complex operations |
Related Concepts¶
- Pipeline Builder Workflow - How building blocks fit into the workflow
- YAML vs Python - Choosing your implementation approach
- Virtual Environments - Safe development with building blocks
Next: Learn about Sources or return to Choosing Your Path