https://blog.qife122.com/tags/%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0%E6%B5%81%E6%B0%B4%E7%BA%BF/ Recent content in 机器学习流水线 on 办公AI智能小助手 Hugo zh-cn qife Thu, 18 Sep 2025 03:36:04 +0800 https://blog.qife122.com/p/%E4%BD%BF%E7%94%A8kubeflow%E6%9E%84%E5%BB%BAai/ml%E5%85%A8%E7%94%9F%E5%91%BD%E5%91%A8%E6%9C%9F%E8%93%9D%E5%9B%BE%E4%BB%8E%E5%8E%9F%E5%A7%8B%E6%95%B0%E6%8D%AE%E5%88%B0%E6%A8%A1%E5%9E%8B%E9%83%A8%E7%BD%B2/ Thu, 18 Sep 2025 03:36:04 +0800 https://blog.qife122.com/p/%E4%BD%BF%E7%94%A8kubeflow%E6%9E%84%E5%BB%BAai/ml%E5%85%A8%E7%94%9F%E5%91%BD%E5%91%A8%E6%9C%9F%E8%93%9D%E5%9B%BE%E4%BB%8E%E5%8E%9F%E5%A7%8B%E6%95%B0%E6%8D%AE%E5%88%B0%E6%A8%A1%E5%9E%8B%E9%83%A8%E7%BD%B2/ <h1 id="数据准备与spark处理">数据准备与Spark处理</h1> <p>使用Apache Spark和Kubeflow Spark Operator处理原始交易数据。Spark任务执行数据合并、类型转换、特征工程（如添加时间戳、生成唯一ID）和点-in-time特征计算（历史交易统计）。处理后的数据以CSV和Parquet格式存储至MinIO对象存储。</p>