Commit Graph

  • d2494a8881 fix: stable develop eson 2020-09-17 18:55:01 +0800
  • 9e90c80702 Merge tag 'v0.7.0' into develop eson 2020-09-17 15:01:17 +0800
  • d041600663 Merge branch 'release/v0.7.0' master v0.7.0 eson 2020-09-17 15:00:51 +0800
  • 750a83bc53 Merge branch 'feature/add-mirrativ' into develop eson 2020-09-17 15:00:10 +0800
  • 0e19b59813 add mirrativ finish eson 2020-09-17 14:58:50 +0800
  • fb3b09fc38 mirrativ finish 90% eson 2020-09-16 18:53:26 +0800
  • ee28db4ad8 todo: profile live feature/add-mirrativ eson 2020-09-15 19:06:03 +0800
  • 925b7d42c7 add: mirrativ init eson 2020-09-15 17:09:22 +0800
  • 36c277c3ce fix: update_interval = 0 if that is error eson 2020-09-15 10:39:34 +0800
  • 072468005c pkill 添加-9 强制kill eson 2020-09-14 15:15:41 +0800
  • ef7b59ce3d TODO: streamerlist eson 2020-09-11 18:52:04 +0800
  • c4d0140b42 for save eson 2020-09-10 17:33:52 +0800
  • 0b8a6fd810 Merge tag 'v0.6.0' into develop eson 2020-09-09 17:27:09 +0800
  • 4693296671 Merge branch 'release/v0.6.0' v0.6.0 eson 2020-09-09 17:26:51 +0800
  • a848f26d65 Merge branch 'feature/autostore' into develop eson 2020-09-09 17:25:55 +0800
  • a9bb448351 重构完成 eson 2020-09-09 17:25:36 +0800
  • 30a6c35980 finish: twitch restructure eson 2020-09-09 16:49:44 +0800
  • b5d5ec04e7 TODO: feature/autostore eson 2020-09-08 18:54:37 +0800
  • fb07d61353 TODO: twitch_task2 fix 错误 eson 2020-09-08 18:24:51 +0800
  • 28319bf02a TODO eson 2020-09-07 18:52:59 +0800
  • 2c557e3b42 todo: twitcasting 测试 store. 2. 修改streamer. tag 符合要求 eson 2020-09-07 18:12:18 +0800
  • 7849d09a18 完成autostore. TODO: 替换old store 类. eson 2020-09-07 17:13:40 +0800
  • 1590fa0c82 add: autostore todo: autostore replace old store eson 2020-09-07 16:54:03 +0800
  • d3689a0c8b TODO: sql to time.Time Type eson 2020-09-07 15:13:50 +0800
  • 83dcdf86c9 TODO: 2 eson 2020-09-04 19:01:51 +0800
  • 2236e13af7 TODO: autostore eson 2020-09-03 18:50:32 +0800
  • f86c255407 finish nimo eson 2020-09-03 14:17:54 +0800
  • be47c77e88 TODO: upgrade store method eson 2020-09-03 12:01:55 +0800
  • 5912111f29 add: WaitFor method add: Channel tag eson 2020-09-02 19:18:44 +0800
  • 3b7e8e94ea nimo 插件优化 nimo 数据测试提取成功 eson 2020-09-02 18:56:20 +0800
  • a72ba6257c change: gcurl version eson 2020-08-30 05:31:15 +0800
  • 5d50119825 add new nimo code change more eson 2020-08-28 19:07:12 +0800
  • eee4e30585 fix: twistcasting tags error. change: twistcasting, some filed type to number eson 2020-08-18 16:50:49 +0800
  • b595ea8d19 Merge tag 'v0.5.4' into develop eson 2020-08-17 14:53:34 +0800
  • d2b05e864c Merge branch 'release/v0.5.4' v0.5.4 eson 2020-08-17 14:53:10 +0800
  • 5a8eda6f1b create ln to supervisor conf.d path eson 2020-08-17 14:52:21 +0800
  • 61634751bf add supervisor conf eson 2020-08-17 14:50:19 +0800
  • 9d7c2e1e54 1.修改build.sh 2.删除hunter包引用和使用 eson 2020-08-17 14:38:00 +0800
  • d1298dc3f3 finish: 重构openrec eson 2020-08-17 13:10:29 +0800
  • a50c879d83 todo: openrec 重构 eson 2020-08-14 19:26:03 +0800
  • b20f97f7c9 1. 修复 store_extractor Update 错误. 2. 重构前两个网站的代码架构不合理. 3. 减少冗余代码 eson 2020-08-13 19:11:53 +0800
  • 36c28826ba change some api v0.5.2 eson 2020-08-12 18:18:25 +0800
  • d91e6be269 rename api name xml -> html eson 2020-08-12 17:42:27 +0800
  • 885003bf76 Merge tag 'v0.5.1' into develop eson 2020-08-12 12:25:33 +0800
  • ba95402651 Merge branch 'release/v0.5.1' v0.5.1 eson 2020-08-12 12:25:10 +0800
  • c878de09ee Merge branch 'feature/add-twitcasting' into develop eson 2020-08-12 12:24:53 +0800
  • 671bd8f70a Merge tag 'v0.5.0' into develop eson 2020-08-12 12:23:44 +0800
  • 2b3c7a662e Merge branch 'release/v0.5.0' v0.5.0 eson 2020-08-12 12:23:39 +0800
  • 16c3ed93b7 finish twitcasting eson 2020-08-12 12:22:46 +0800
  • b82b4f5b77 finish tag slice eson 2020-08-11 18:26:17 +0800
  • 23fa32b4ae TODO: 重构XPath 的使用 shit eson 2020-08-07 18:10:22 +0800
  • 0bff7169ec Extractor upgrade feature/add-twitcasting eson 2020-08-05 18:49:47 +0800
  • 6158976986 add twitcasting test eson 2020-08-04 14:13:39 +0800
  • 826d15876a fix windows quit eson 2020-08-04 14:12:00 +0800
  • 93ec2e78a6 Merge tag 'v0.4.0' into develop eson 2020-07-31 18:05:51 +0800
  • 2161de6e33 Merge branch 'release/v0.4.0' v0.4.0 eson 2020-07-31 18:05:28 +0800
  • ac47b28153 Merge branch 'feature/add-twitch' into develop eson 2020-07-31 18:05:06 +0800
  • 0c54cbf8d8 完成twitch的期望功能 eson 2020-07-31 18:04:10 +0800
  • ac1ab81676 完成twitch 数据提取入库 eson 2020-07-28 18:56:27 +0800
  • 1d2f2d14c5 1. 添加了block twitch 视频流的插件. 2. 流量减少99% 3. cpu使用率降低50% 4. 速度提高了400% eson 2020-07-27 19:30:54 +0800
  • 41d3763b57 TODO: finish extractor data eson 2020-07-27 00:35:41 +0800
  • ea650f91dc TODO: twitch get all userid list eson 2020-07-24 18:48:33 +0800
  • cbdedb6795 twitch source 非常多, 需要把增量的架构设计好. 修改原来架构. eson 2020-07-23 18:29:56 +0800
  • 6d688b8450 fix: libxml2 leak eson 2020-07-22 20:00:02 +0800
  • b9f2f5cf22 Merge tag 'v0.3.0' into develop eson 2020-07-21 15:07:24 +0800
  • 9c4b3eb60b Merge branch 'release/v0.3.0' v0.3.0 eson 2020-07-21 15:07:18 +0800
  • 079488a2ba v0.3.0版本重构. 以 主播 为目标单位. eson 2020-07-21 15:05:56 +0800
  • d7a6da287d TODO: extractor 的重构. eson 2020-07-20 18:54:34 +0800
  • f0f83a9f00 1.最后一次数据存储结构重构. 2.数据最接近需求方. eson 2020-07-20 18:13:54 +0800
  • 6369387179 Merge tag 'v0.2.1' into develop eson 2020-07-17 19:21:33 +0800
  • 2611e1df9f Merge branch 'release/v0.2.1' v0.2.1 eson 2020-07-17 19:21:04 +0800
  • 7182da2cbe fix: 时区问题. sqluri导致解析错误. eson 2020-07-17 19:20:08 +0800
  • e1040e69cd 1.重构命名, 简化代码, 加入build.sh 2.重构数据字段结构, 使数据合理性提高. 3.测试通过openrec获取数据完整性. TODO: 测试时区问题. eson 2020-07-17 18:21:38 +0800
  • bb0f3845b7 Merge tag 'v0.2.0' into develop eson 2020-07-16 18:35:46 +0800
  • 8ba6169932 Merge branch 'release/v0.2.0' v0.2.0 eson 2020-07-16 18:35:30 +0800
  • 93efe36d0b add: 优雅停机 eson 2020-07-16 18:31:13 +0800
  • fe25921f9a fix: ParseDuration Method add: store UpdateOperator eson 2020-07-16 16:22:14 +0800
  • 7e3b36c7d0 完成解析模块示例. 数据库入库测试. TODO: 调整程序启动停止(非暴力关闭). eson 2020-07-16 15:25:55 +0800
  • 51fe6f6039 finish: 解析逻辑, 入库正确. TODO: 整理代码, 让入库提取数据成为 基础库. eson 2020-07-16 11:02:30 +0800
  • 13ae890171 TODO: 正则Regexp 获取Tags错误 eson 2020-07-15 19:23:45 +0800
  • b63e180499 添加tags, 修改 存储结构 更加接近制直播的数据存储架构. eson 2020-07-15 18:22:40 +0800
  • 75b1d9fb77 TODO: 完善主播表的更新方式. 存在更新最新状态时, 会被改版类似情况覆盖, 从而找不到原信息数据 eson 2020-07-15 15:44:21 +0800
  • 0d8b456f41 TODO: 解决编码问题 eson 2020-07-14 19:00:34 +0800
  • ad02a5b4d9 TODO: workflow改进, 命名 eson 2020-07-13 19:11:13 +0800
  • d034647b93 修改直到curl 成功. eson 2020-07-13 18:10:48 +0800
  • a305700a69 fix: config path error eson 2020-07-10 18:39:27 +0800
  • d258cc51d3 for save. eson 2020-07-10 18:31:17 +0800
  • d5151f92bf 1.extractor 表字段的实现. 2.存储通用包的实现. eson 2020-07-10 16:13:08 +0800
  • 4af5430572 TODO: extractor openrec eson 2020-07-10 12:05:33 +0800
  • 2e9a803645 完成openrec源的获取. eson 2020-07-09 17:09:46 +0800
  • a027861f5a add: 更新数据ext参考例子 eson 2020-07-09 11:38:51 +0800
  • 0a2a134511 TODO: openrec user data. isource update interface eson 2020-07-08 18:57:57 +0800
  • 5cbb17d6d4 add: Pop 队列. 以mysql 表的标志做一个队列. eson 2020-07-08 15:02:55 +0800
  • 0b5425088f add: anchor_id field fix: table some key eson 2020-07-08 10:11:35 +0800
  • 6197f445bf 拆解子任务 eson 2020-07-07 18:39:24 +0800
  • eba36b0c95 完成 openrec 的排名获取主播主页的功能. TODO: 分解成多任务服务机制. 让每个子任务独立互不干扰. eson 2020-07-07 18:14:14 +0800
  • fdc351da83 更新数据存储格式的设计, 用ext 存储子任务的数据内容. eson 2020-07-07 16:17:05 +0800
  • 8a0d71a34e 第一个插入数据成功 eson 2020-07-07 12:04:05 +0800
  • db782a3533 TODO: Insert OpenrecRanking Data eson 2020-07-06 17:58:24 +0800
  • ae56d86026 初步-> 架构设计,字段存储结构设计,代码框架实现. eson 2020-07-06 16:33:35 +0800