326 lines
13 KiB
Markdown
326 lines
13 KiB
Markdown
# 缓存系统
|
||
|
||
<cite>
|
||
**本文引用的文件**
|
||
- [cmd/server/main.go](file://cmd/server/main.go)
|
||
- [internal/cache/redis.go](file://internal/cache/redis.go)
|
||
- [internal/config/config.go](file://internal/config/config.go)
|
||
- [internal/config/redis.go](file://internal/config/redis.go)
|
||
- [internal/router/router.go](file://internal/router/router.go)
|
||
- [internal/handler/device.go](file://internal/handler/device.go)
|
||
- [go.mod](file://go.mod)
|
||
</cite>
|
||
|
||
## 目录
|
||
1. [简介](#简介)
|
||
2. [项目结构](#项目结构)
|
||
3. [核心组件](#核心组件)
|
||
4. [架构总览](#架构总览)
|
||
5. [详细组件分析](#详细组件分析)
|
||
6. [依赖关系分析](#依赖关系分析)
|
||
7. [性能考虑](#性能考虑)
|
||
8. [故障排查指南](#故障排查指南)
|
||
9. [结论](#结论)
|
||
10. [附录](#附录)
|
||
|
||
## 简介
|
||
本文件面向 Luxsin 应用 API 的缓存系统,聚焦 Redis 缓存客户端的初始化流程、连接配置与使用方式。当前代码库实现了最小可用的 Redis 客户端封装与配置加载,并在设备上报接口中演示了哈希写入的典型用法。本文将从系统架构、组件职责、数据流、错误处理到性能优化与故障恢复进行系统化梳理,帮助初学者快速上手,同时为高级用户提供深入的技术细节与最佳实践参考。
|
||
|
||
## 项目结构
|
||
与缓存系统直接相关的模块分布如下:
|
||
- 配置层:负责加载环境变量与默认值,生成 RedisConfig 并进行基础校验
|
||
- 缓存层:基于 RedisConfig 构造 Redis 客户端实例
|
||
- 应用入口:在启动时加载配置、初始化缓存客户端并注入路由
|
||
- 路由与处理器:将 Redis 客户端注入到需要缓存能力的处理器中
|
||
- 外部依赖:通过 go.mod 指定 Redis 客户端版本
|
||
|
||
```mermaid
|
||
graph TB
|
||
subgraph "应用入口"
|
||
MAIN["cmd/server/main.go<br/>启动与生命周期管理"]
|
||
end
|
||
subgraph "配置层"
|
||
CFG["internal/config/config.go<br/>统一配置加载"]
|
||
REDIS_CFG["internal/config/redis.go<br/>Redis 配置与校验"]
|
||
end
|
||
subgraph "缓存层"
|
||
CACHE["internal/cache/redis.go<br/>NewClient 构造 Redis 客户端"]
|
||
end
|
||
subgraph "路由与处理器"
|
||
ROUTER["internal/router/router.go<br/>路由注册与依赖注入"]
|
||
DEVICE["internal/handler/device.go<br/>设备上报使用 Redis"]
|
||
end
|
||
subgraph "外部依赖"
|
||
MOD["go.mod<br/>Redis 客户端版本"]
|
||
end
|
||
MAIN --> CFG
|
||
CFG --> REDIS_CFG
|
||
MAIN --> CACHE
|
||
CACHE --> DEVICE
|
||
ROUTER --> DEVICE
|
||
MOD --> CACHE
|
||
```
|
||
|
||
图表来源
|
||
- [cmd/server/main.go:22-62](file://cmd/server/main.go#L22-L62)
|
||
- [internal/config/config.go:18-52](file://internal/config/config.go#L18-L52)
|
||
- [internal/config/redis.go:16-56](file://internal/config/redis.go#L16-L56)
|
||
- [internal/cache/redis.go:10-16](file://internal/cache/redis.go#L10-L16)
|
||
- [internal/router/router.go:14-25](file://internal/router/router.go#L14-L25)
|
||
- [internal/handler/device.go:26-78](file://internal/handler/device.go#L26-L78)
|
||
- [go.mod:9](file://go.mod#L9)
|
||
|
||
章节来源
|
||
- [cmd/server/main.go:22-62](file://cmd/server/main.go#L22-L62)
|
||
- [internal/config/config.go:18-52](file://internal/config/config.go#L18-L52)
|
||
- [internal/config/redis.go:16-56](file://internal/config/redis.go#L16-L56)
|
||
- [internal/cache/redis.go:10-16](file://internal/cache/redis.go#L10-L16)
|
||
- [internal/router/router.go:14-25](file://internal/router/router.go#L14-L25)
|
||
- [internal/handler/device.go:26-78](file://internal/handler/device.go#L26-L78)
|
||
- [go.mod:9](file://go.mod#L9)
|
||
|
||
## 核心组件
|
||
- RedisConfig:定义 Redis 连接所需的主机、端口、密码与数据库编号,并提供校验逻辑
|
||
- NewClient:根据 RedisConfig 创建 Redis 客户端实例,设置 Addr、Password、DB 等选项
|
||
- 配置加载:Load 统一加载应用配置,其中包含 Redis 配置加载与校验
|
||
- 启动流程:main 在启动阶段创建 Redis 客户端并注入路由,服务关闭时释放连接
|
||
- 使用示例:设备上报接口在请求上下文中向 Redis 写入哈希字段
|
||
|
||
章节来源
|
||
- [internal/config/redis.go:9-14](file://internal/config/redis.go#L9-L14)
|
||
- [internal/config/redis.go:51-56](file://internal/config/redis.go#L51-L56)
|
||
- [internal/cache/redis.go:10-16](file://internal/cache/redis.go#L10-L16)
|
||
- [internal/config/config.go:18-52](file://internal/config/config.go#L18-L52)
|
||
- [cmd/server/main.go:22-62](file://cmd/server/main.go#L22-L62)
|
||
- [internal/handler/device.go:70-78](file://internal/handler/device.go#L70-L78)
|
||
|
||
## 架构总览
|
||
下图展示了从应用启动到 Redis 客户端被注入处理器的整体流程:
|
||
|
||
```mermaid
|
||
sequenceDiagram
|
||
participant Boot as "启动器(main)"
|
||
participant Cfg as "配置加载(Config.Load)"
|
||
participant RdsCfg as "Redis 配置(loadRedis)"
|
||
participant Cache as "NewClient"
|
||
participant Router as "路由(router)"
|
||
participant Dev as "设备处理器(DeviceHandler)"
|
||
Boot->>Cfg : 加载配置
|
||
Cfg->>RdsCfg : 读取 Redis 配置并校验
|
||
RdsCfg-->>Cfg : 返回 RedisConfig
|
||
Cfg-->>Boot : 返回完整 Config
|
||
Boot->>Cache : 基于 RedisConfig 创建客户端
|
||
Cache-->>Boot : 返回 *redis.Client
|
||
Boot->>Router : 注入 Redis 客户端
|
||
Router-->>Dev : 初始化处理器并传入 Redis 客户端
|
||
```
|
||
|
||
图表来源
|
||
- [cmd/server/main.go:22-62](file://cmd/server/main.go#L22-L62)
|
||
- [internal/config/config.go:18-52](file://internal/config/config.go#L18-L52)
|
||
- [internal/config/redis.go:16-56](file://internal/config/redis.go#L16-L56)
|
||
- [internal/cache/redis.go:10-16](file://internal/cache/redis.go#L10-L16)
|
||
- [internal/router/router.go:14-25](file://internal/router/router.go#L14-L25)
|
||
|
||
## 详细组件分析
|
||
|
||
### Redis 客户端初始化与配置
|
||
- NewClient 实现要点
|
||
- 将 Host 与 Port 组合为 Addr 字符串
|
||
- 设置 Password 与 DB
|
||
- 返回 redis.Client 实例供后续调用
|
||
- 配置来源与优先级
|
||
- 若存在环境变量 REDIS_HOST,则以环境变量 REDIS_HOST/REDIS_PORT/REDIS_PASSWORD/REDIS_DATABASE 为准
|
||
- 否则根据运行环境(开发/生产)选择默认主机与端口,并从环境变量读取密码与数据库编号
|
||
- 校验规则
|
||
- RedisConfig.validate 校验 Host 必填;其他字段如 Password、Database 可为空或按需提供
|
||
|
||
```mermaid
|
||
flowchart TD
|
||
Start(["开始"]) --> CheckEnv["检查是否存在 REDIS_HOST"]
|
||
CheckEnv --> |是| FromEnv["从环境变量读取 Redis 配置"]
|
||
CheckEnv --> |否| SwitchEnv["根据运行环境选择默认配置"]
|
||
FromEnv --> Validate["执行 validate 校验 Host"]
|
||
SwitchEnv --> Validate
|
||
Validate --> |通过| BuildClient["调用 NewClient 构造客户端"]
|
||
Validate --> |失败| Error["返回错误"]
|
||
BuildClient --> End(["结束"])
|
||
Error --> End
|
||
```
|
||
|
||
图表来源
|
||
- [internal/config/redis.go:16-56](file://internal/config/redis.go#L16-L56)
|
||
- [internal/cache/redis.go:10-16](file://internal/cache/redis.go#L10-L16)
|
||
|
||
章节来源
|
||
- [internal/cache/redis.go:10-16](file://internal/cache/redis.go#L10-L16)
|
||
- [internal/config/redis.go:16-56](file://internal/config/redis.go#L16-L56)
|
||
- [internal/config/redis.go:51-56](file://internal/config/redis.go#L51-L56)
|
||
|
||
### 启动流程与生命周期
|
||
- 启动阶段
|
||
- 加载配置后,创建 Redis 客户端并记录连接信息
|
||
- 将客户端注入路由,随后启动 HTTP 服务器
|
||
- 关闭阶段
|
||
- 优雅关闭时调用 Close 释放连接
|
||
|
||
```mermaid
|
||
sequenceDiagram
|
||
participant M as "main"
|
||
participant R as "Redis 客户端"
|
||
participant S as "HTTP 服务器"
|
||
M->>M : 加载配置
|
||
M->>R : NewClient(cfg.Redis)
|
||
M->>S : 启动监听
|
||
S-->>M : 服务运行中
|
||
M->>R : 关闭时调用 Close
|
||
```
|
||
|
||
图表来源
|
||
- [cmd/server/main.go:22-62](file://cmd/server/main.go#L22-L62)
|
||
- [cmd/server/main.go:87-94](file://cmd/server/main.go#L87-L94)
|
||
|
||
章节来源
|
||
- [cmd/server/main.go:22-62](file://cmd/server/main.go#L22-L62)
|
||
- [cmd/server/main.go:87-94](file://cmd/server/main.go#L87-L94)
|
||
|
||
### 设备上报接口中的缓存使用
|
||
- 典型场景
|
||
- 从请求参数构造设备信息,序列化为 JSON
|
||
- 在请求上下文基础上向 Redis 写入哈希字段 devices,键为 MAC 地址
|
||
- 错误处理
|
||
- HSet 失败时记录日志并返回系统错误响应
|
||
|
||
```mermaid
|
||
sequenceDiagram
|
||
participant Client as "客户端"
|
||
participant Handler as "DeviceHandler"
|
||
participant Redis as "Redis 客户端"
|
||
Client->>Handler : GET /audio/reportDevInfo?mac=...&model=...
|
||
Handler->>Handler : 参数校验与日志记录
|
||
Handler->>Handler : 构造设备信息并序列化
|
||
Handler->>Redis : HSet(ctx, "devices", mac, json)
|
||
alt 成功
|
||
Handler-->>Client : 返回成功响应
|
||
else 失败
|
||
Handler-->>Client : 返回系统错误
|
||
end
|
||
```
|
||
|
||
图表来源
|
||
- [internal/handler/device.go:26-78](file://internal/handler/device.go#L26-L78)
|
||
|
||
章节来源
|
||
- [internal/handler/device.go:26-78](file://internal/handler/device.go#L26-L78)
|
||
|
||
### 类图:配置与客户端关系
|
||
```mermaid
|
||
classDiagram
|
||
class RedisConfig {
|
||
+string Host
|
||
+int Port
|
||
+string Password
|
||
+int Database
|
||
+validate() error
|
||
}
|
||
class NewClient {
|
||
+NewClient(cfg RedisConfig) *redis.Client
|
||
}
|
||
class Config {
|
||
+string Env
|
||
+string Host
|
||
+int Port
|
||
+Database DatabaseConfig
|
||
+Meilisearch MeilisearchConfig
|
||
+Redis RedisConfig
|
||
+Addr() string
|
||
}
|
||
NewClient --> RedisConfig : "接收配置"
|
||
Config --> RedisConfig : "包含"
|
||
```
|
||
|
||
图表来源
|
||
- [internal/config/redis.go:9-14](file://internal/config/redis.go#L9-L14)
|
||
- [internal/config/redis.go:51-56](file://internal/config/redis.go#L51-L56)
|
||
- [internal/cache/redis.go:10-16](file://internal/cache/redis.go#L10-L16)
|
||
- [internal/config/config.go:9-16](file://internal/config/config.go#L9-L16)
|
||
|
||
## 依赖关系分析
|
||
- Redis 客户端版本
|
||
- 通过 go.mod 指定 github.com/redis/go-redis/v9 版本
|
||
- 模块耦合
|
||
- cache/redis.go 仅依赖 internal/config 中的 RedisConfig
|
||
- cmd/server/main.go 依赖 cache/redis.go 与 internal/config
|
||
- internal/router/router.go 依赖 redis.go 与 handler 层
|
||
- internal/handler/device.go 依赖 redis.go 与 zap 日志
|
||
|
||
```mermaid
|
||
graph LR
|
||
MAIN["cmd/server/main.go"] --> CACHE["internal/cache/redis.go"]
|
||
MAIN --> CFG["internal/config/config.go"]
|
||
CFG --> REDISCFG["internal/config/redis.go"]
|
||
ROUTER["internal/router/router.go"] --> DEVICE["internal/handler/device.go"]
|
||
DEVICE --> CACHE
|
||
MOD["go.mod"] --> CACHE
|
||
```
|
||
|
||
图表来源
|
||
- [cmd/server/main.go:13-18](file://cmd/server/main.go#L13-L18)
|
||
- [internal/cache/redis.go:6-7](file://internal/cache/redis.go#L6-L7)
|
||
- [internal/router/router.go:10](file://internal/router/router.go#L10)
|
||
- [internal/handler/device.go:10](file://internal/handler/device.go#L10)
|
||
- [go.mod:9](file://go.mod#L9)
|
||
|
||
章节来源
|
||
- [cmd/server/main.go:13-18](file://cmd/server/main.go#L13-L18)
|
||
- [internal/cache/redis.go:6-7](file://internal/cache/redis.go#L6-L7)
|
||
- [internal/router/router.go:10](file://internal/router/router.go#L10)
|
||
- [internal/handler/device.go:10](file://internal/handler/device.go#L10)
|
||
- [go.mod:9](file://go.mod#L9)
|
||
|
||
## 性能考虑
|
||
- 连接池与并发
|
||
- 当前 NewClient 未显式设置连接池参数,Redis 客户端默认行为将复用连接;在高并发场景建议结合业务压力测试评估连接数上限
|
||
- 超时与上下文
|
||
- 所有 Redis 操作均使用请求上下文,便于在上游取消或超时控制
|
||
- 数据过期与键空间
|
||
- 当前示例未设置过期时间;对于临时数据可考虑在写入时设置 TTL,避免无界增长
|
||
- 键命名规范
|
||
- 示例使用固定字段名 devices;建议采用前缀+业务域+标识的命名规范,便于运维与清理
|
||
- 批量与流水线
|
||
- 对于批量写入场景,可考虑使用 Pipeline 或 MSET/MGET 提升吞吐
|
||
|
||
## 故障排查指南
|
||
- 连接失败
|
||
- 检查 REDIS_HOST/REDIS_PORT/REDIS_PASSWORD/REDIS_DATABASE 是否正确
|
||
- 确认 validate 校验未返回“redis host is required”
|
||
- 写入失败
|
||
- 查看 HSet 返回的错误并结合日志定位
|
||
- 确认 Redis 服务状态与网络连通性
|
||
- 优雅关闭
|
||
- 确保在服务关闭时调用 Close,避免资源泄漏
|
||
|
||
章节来源
|
||
- [internal/config/redis.go:51-56](file://internal/config/redis.go#L51-L56)
|
||
- [internal/handler/device.go:70-78](file://internal/handler/device.go#L70-L78)
|
||
- [cmd/server/main.go:87-94](file://cmd/server/main.go#L87-L94)
|
||
|
||
## 结论
|
||
当前缓存系统以简洁的方式完成了 Redis 客户端的初始化与注入,满足基本的键值写入需求。建议在后续迭代中补充连接池配置、过期策略、键命名规范与监控告警,以提升稳定性与可观测性。同时,可在更多处理器中引入缓存读取与写入,形成统一的缓存访问模式。
|
||
|
||
## 附录
|
||
|
||
### 配置项一览
|
||
- 应用层
|
||
- APP_ENV:运行环境(development/production)
|
||
- APP_HOST:监听地址
|
||
- APP_PORT:监听端口
|
||
- Redis 层
|
||
- REDIS_HOST:Redis 主机(优先级最高)
|
||
- REDIS_PORT:Redis 端口(默认 16279)
|
||
- REDIS_PASSWORD:Redis 密码(默认 eafon123!)
|
||
- REDIS_DATABASE:数据库编号(默认 1)
|
||
|
||
章节来源
|
||
- [internal/config/config.go:18-52](file://internal/config/config.go#L18-L52)
|
||
- [internal/config/redis.go:16-56](file://internal/config/redis.go#L16-L56) |