yumoqing
fa257f36b1
依据现有实现补全「自动识别故障 → 人工确认切换 → 切回」运维核心闭环。 触发模式 1A+2B+3A：VIP 浮动 + 半自动 + 切前隔离原主（防脑裂）。 【表结构】 clusters 加 vip/failover_mode；node_commands 加 command_type 新增 switchover_steps（切换步骤级审计） 【Agent 六动作（脚本化、幂等、结构化返回）】 fence(停MySQL+摘VIP)/unfence(恢复)/promote_master(STOP+RESET SLAVE) revert_promote(降回从库)/flip_sync(反转同步)/verify(可写+VIP校验) 【切换编排器 foms/failover.py】 六步状态机：precheck→fence→promote→flip_sync→verify→converge 失败 → 已完成步骤逆向回滚 → switchover_logs=failed 回滚也失败 → rollback_failed + 最高级告警冒泡人工 防脑裂不变量：fence 先于 promote，fence 失败硬中止绝不 promote 【健康判定器】 后台循环（默认5s）扫 active 集群，心跳超时/复制异常判定 防抖：连续 failover_threshold 次命中才判故障（防瞬时抖动误判） 半自动：只告警（写 switchover_logs + hostwatch_events）不切，等人确认 【切回 + 回滚语义】 trigger_switchback 反向六步；回滚用 unfence/revert_promote/反转/换回 【部署文档】 docs/deploy-operations.md：架构/三机部署/keepalived/Agent 环境变量/ 日常运维/失败语义/防脑裂/已知限制 验证：语法全过；编排器↔Agent 六命令类型对齐；六步顺序正确； 防脑裂不变量成立（fence idx=1 < promote idx=2）；注册链完整。
30 lines
1.4 KiB
JSON
30 lines
1.4 KiB
JSON
{
|
|
"summary": [
|
|
{
|
|
"name": "switchover_steps",
|
|
"title": "切换步骤明细",
|
|
"primary": ["id"],
|
|
"catelog": "entity"
|
|
}
|
|
],
|
|
"fields": [
|
|
{"name": "id", "title": "步骤ID", "type": "str", "length": 32, "nullable": "no"},
|
|
{"name": "switchover_id", "title": "切换事件", "type": "str", "length": 32, "nullable": "no"},
|
|
{"name": "seq", "title": "步骤序号", "type": "int", "nullable": "no"},
|
|
{"name": "step_name", "title": "步骤名称", "type": "str", "length": 32, "nullable": "no"},
|
|
{"name": "status", "title": "步骤状态", "type": "str", "length": 16, "nullable": "no", "default": "pending"},
|
|
{"name": "output", "title": "执行输出", "type": "text"},
|
|
{"name": "error", "title": "错误信息", "type": "text"},
|
|
{"name": "started_at", "title": "开始时间", "type": "datetime"},
|
|
{"name": "completed_at", "title": "完成时间", "type": "datetime"}
|
|
],
|
|
"indexes": [
|
|
{"name": "idx_ss_switchover", "idxtype": "index", "idxfields": ["switchover_id"]},
|
|
{"name": "idx_ss_seq", "idxtype": "index", "idxfields": ["switchover_id", "seq"]}
|
|
],
|
|
"codes": [
|
|
{"field": "status", "table": "appcodes_kv", "valuefield": "k", "textfield": "v", "cond": "parentid='step_status'"},
|
|
{"field": "switchover_id", "table": "switchover_logs", "valuefield": "id", "textfield": "event_type"}
|
|
]
|
|
}
|