An AI agent for generating data pipelines from Slack requests
An AI agent for generating data pipelines from Slack requests
GoDaddy's domain data platform team built Pipeline Build Agent, a conversational AI agent on their go-agent-python SDK deployed via Katana that turns a single Slack message into a complete data pipeline, reducing a task that took 2–4 hours to minutes. A manager agent routes intent to a Pipeline Creation Agent (checks S3 schemas, generates PySpark jobs, DAGs, and policy files, opens a PR) or a Column Addition Agent (finds the pipeline, propagates changes downstream, opens a PR), with both querying the Lake Naming Standards knowledge base before generating code. The team enforces one PR per run with update_pr_files as the only correction path, and plans to add Redshift and S3 CSV export destinations plus pre-PR syntax validation.
Source: Hacker News AI · godaddy.com