Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
-
Updated
Jul 29, 2024 - Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.
pyinfra turns Python code into shell commands and runs them on your servers. Execute ad-hoc commands and write declarative operations. Target SSH servers, local machine and Docker containers. Fast and scales from one server to thousands.
Accelerated deep learning R&D
Distributed self-replicating programs in Python
An open, distributed platform as a service
Build better AWS infrastructure
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
a lightweight, security focused, BDD test framework against terraform.
A Data Engineering & Machine Learning Knowledge Hub
🎨 Infinite Drawboard in Python
Like PyTorch for ML infra. Iterable, debuggable, multi-cloud, 100% reproducible across research and production.
The next generation of Infrastructure-as-Code. Work with high-level constructs instead of getting lost in low-level cloud configuration.
Using network observability to operate and design healthier networks
python wrapper for Proxmox API v2 (https://pve.proxmox.com/pve-docs/api-viewer/index.html)
Command Line Interface for Oracle Cloud Infrastructure
The official Linode command line interface.
Infrastructure to set up the public Compiler Explorer instances and compilers
Dell OpenManage Ansible Modules
📦 CodeBox is the simplest cloud infrastructure for your LLM Apps and Services.
Add a description, image, and links to the infrastructure topic page so that developers can more easily learn about it.
To associate your repository with the infrastructure topic, visit your repo's landing page and select "manage topics."