Stack Overview

Technology Selection

Models: OpenRouter / local (Ollama, vLLM) / specialized (Claude, Gemini).

Orchestration: LangGraph / CrewAI / AutoGen / custom DAG (Prefect, Temporal).

Knowledge layer: pgvector/Chroma/Weaviate + GraphRAG (Neo4j, MemGraph) when relationships matter.

Tooling: OpenAPI-generated tools, function-calling schemas, headless browsers, Zapier/N8n for quick wins.

Tracing/Monitoring: LangSmith, Helicone, Honeycomb, OpenTelemetry.

Prompt/version mgmt: Git + YAML/JSON prompt files, Jinja templates, eval harness (DeepEval, Ragas).

Security: secrets vault (Doppler, AWS SM), RBAC on tools, rate limits, audit logs.

Development Tools

Development environments, testing frameworks, deployment tools, monitoring and logging.

Infrastructure

Hosting options, database considerations, API management, security requirements.