yumoqing/pipeline-service
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
277 Commits 1 Branch 0 Tags
Commit Graph

15 Commits

Author SHA1 Message Date
ymq
e3917e681c feat(work_env): 远程模式自动初始化——技能同步+依赖软件自动安装;agent_loop deploy别名归测试环境 2026-08-28 21:10:36 +08:00
ymq
1d743df4e3 feat(approval): 钉钉审批接成产线审批关卡 
复用引擎既有 approval_gate 机制，不重造状态机：
- 新增 dingtalk_approval.py：注册 step_type='dingtalk_approval'(interactive)，
  进入步骤自动向钉钉发起审批；注册 biz_type='pipeline_approval' 回调钩子，
  审批结果回来调 approval_approve/reject 推进产线(内部已 save_artifact+resume_task)
- executor._handle_interactive_step 加外部通知钩子(按 step_type meta.notifier 分派)，
  并把 tenant_id 从 _execute_step 传下来(原 step_info 里无此字段，会永远取空)
- biz_id 编码 tenant_id:task_id:step_name，回调据此定位步骤
- 软依赖 dingdingflow：未加载时步骤仍挂起等人工审批，不推钉钉、不报错
- 通知失败只记日志不改步骤状态，避免外部系统故障导致步骤 FAILED
 2026-08-25 18:22:03 +08:00
ymq
c87b8d94ed feat: 通用slash命令(/help/status/reset/tools/skills/model)+SDLC产线slash(/tasks/diagnose)+AgentExecutor按role加载技能 2026-08-15 09:38:31 +08:00
ymq
0a90f60315 refactor: SDLC能力迁移到sdlc_ability可插拔能力包——14工具+prompt+handler独立函数，AgentExecutor按pipeline_id动态挂载，删除硬编码SDLC handler 2026-08-15 09:26:01 +08:00
ymq
92ee88d1f4 refactor: 审计逻辑迁移到独立模块 app_audit 
- 移除 pipeline_service/audit_service.py（迁移到 app_audit）
- __init__.py 移除 audit import，init.py 移除 sd_audit_logs/owner.audit DDL
 2026-08-14 12:20:36 +08:00
ymq
eaaf5fad26 feat: 审计日志全局模块（append-only，查看/备份/删除仅 owner.audit） 
- audit_service.py: audit_log 写入 + is_audit_role + list/backup/delete
- sd_audit_logs 表 + owner.audit 角色 DDL
- 审计独立性：owner.superuser 也无权查看审计日志
 2026-08-14 12:10:57 +08:00
ymq
939fd252ec security: 机构独立 SSH key + host key 校验(accept-new 防 MITM) 
- ensure_org_key: 每机构独立 ed25519 key pair（~/.ssh/org_keys/<org_id>/），防单点泄露
- org 级远程模式自动用机构 key，不允许指定任意 key
- StrictHostKeyChecking=no → accept-new，首次记录后严格校验 host key 防 MITM
 2026-08-14 11:58:48 +08:00
ymq
262d678e2a feat: 工作环境管理（沙箱本地/远程切换 + 目录迁移） 
- work_env.py: get/set_work_env(用户/机构维度,缺省local)、rsync目录迁移、远程SSH+bwrap沙箱、远程bwrap部署
- run_in_work_env: 按mode分发本地bwrap/远程SSH+bwrap
- sd_work_envs 表 DDL
 2026-08-14 11:12:54 +08:00
ymq
08ae248c2a feat: 应用部署主机逻辑账号系统（零root+bwrap沙箱） 
- deploy_account.py: 逻辑账号（ag_前缀）创建/删除/列表，bwrap沙箱执行，免密目录读写
- 零root：不建真实Linux账号，逻辑隔离目录 + unprivileged user namespace
- init.py: sd_deploy_accounts 表 DDL 自动初始化
 2026-08-13 17:57:09 +08:00
ymq
2d6709ee33 feat: Agent v2 执行引擎 - AgentExecutor with compression/memory/skills 2026-08-10 11:06:42 +08:00
Hermes Agent
a44130b23b refactor(v3.1): decouple KTV handlers — pipeline-service is pure engine 
- Remove handlers_ktv.py (943 lines) — KTV is now an external adapter
- Remove register_ktv_handlers() from load_pipeline_service()
- Remove KTV imports from __init__.py
- pipeline-service no longer knows about any specific pipeline type
- Version bump: 3.0.0 → 3.1.0

Each pipeline type should be a separate adapter package that calls:
  register_handler(step_type, fn)
  register_step_type(step_type, metadata)

This keeps pipeline-service stable and lets adapters evolve independently.
 2026-06-16 11:11:05 +08:00
Hermes Agent
b9a5810d85 feat(v3): human-in-the-loop — interactive steps, pluggable step_type registry 
- New states: waiting (step/task), rejected (step)
- New tables: pipeline_human_tasks, pipeline_step_types
- New module: step_registry.py — pluggable step_type metadata
- New module: human.py — human_complete, approval_approve, approval_reject
- Executor: detects interactive step_types, creates human_tasks, enters waiting
- Reject with rollback: approval_reject(rollback_to=step) resets steps and re-runs
- API: human_task_complete, approval_approve, approval_reject, human_task_list
- API: pipeline_step_types, pipeline_register_step_type, pipeline_unregister_step_type
- Built-in interactive types: human_task, approval_gate
- Updated DDL and appcodes
 2026-06-16 11:05:45 +08:00
yumoqing
113eb7e040 feat: add KTV pipeline handlers (17 step types, 3 production modes) 
- handlers_ktv.py: 17 async step handlers for KTV production
  - Audio/Video preparation (ffmpeg)
  - Demucs vocal separation (GPU server SSH)
  - Lyric calibration (SenseVoice ASR + LLM)
  - Subtitle rendering (ASS karaoke format)
  - Lyric generation & evaluation (Mode C)
  - Music generation (Suno/MiniMax API)
  - Character design & image generation (wan2.7)
  - Storyboard generation (LLM)
  - Scene video generation (T2V/Ref2V)
  - Scene video evaluation (quality threshold)
  - Scene video concatenation (ffmpeg loop)
  - KTV synthesis (dual-track + MTV)

- llm_bridge.py: async LLM call bridge (harnessed_agent / OpenAI API)
- storage.py: extract deps from step_config JSON
- init.py: auto-register KTV handlers on load
 2026-06-11 20:36:05 +08:00
yumoqing
2448ad45f7 refactor: 改造为通用产线执行引擎模块 
- 去掉独立 aiohttp 服务器，改为标准模块（load_pipeline_service）
- 存储从文件系统改 MySQL（sqlor）
- 新增 3 张数据表：pipeline_tasks/task_steps/artifacts
- 多租户隔离（tenant_id）
- 通用 DAG 调度引擎（读 pipeline_steps 表，不硬编码业务）
- 可插拔步骤处理器（register_handler by step_type）
- artifact 版本管理 + 级联重跑
- init/data.json 标准 appcodes 格式
- 完整 README 文档
 2026-06-11 17:30:06 +08:00
yumoqing
fd6d982704 feat: pipeline-service早期产线引擎(初始版本) 2026-06-11 14:47:08 +08:00