Loading…
中国上海
2019 年 6 月 24–26 日
单击此处了解更多信息和注册

点击此处查看英文版日程表。
To view the English version of this schedule please go here.

我们将为所有主题演讲和分组会议提供同声传译服务。
Simultaneous translation will be provided for all keynote and breakout sessions.

场馆 + 赞助商展示区地图
Venue + Sponsor Showcase Map
Back To Schedule
Tuesday, June 25 • 15:05 - 15:40
HDFS CSI 插件：加速本地大数据集群中的 Kubernetes - Yi Chen 和 Junping Du，腾讯

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
如今，Kubernetes 不仅在公有云领域占据着主导地位，而且日趋成为本地大数据集群环境的新星，成功取代资源调度组件 Hadoop YARN。在本地大数据集群中，大多数数据都保存在 HDFS 中。如何使用 Kubernetes 消耗 HDFS 中的大数据对用户来说是一个新的挑战。
在本次演讲中，我们将首先介绍我们的 CSI 兼容 HDFS 插件的设计和架构。然后，我们将分享大数据工作负载 Spark 在 K8s 上运行时如何使用 HDFS CSI 插件访问 HDFS 数据的最佳实践和经验。最后，我们将使用 TPC-DS 基准套件对 K8s 上运行的 Spark（支持 HDFS）和在 YARN 运行的 Spark（支持 HDFS）之间的性能进行比较分析。
Speakers
YC

Yi Chen

Senior Software Engineer, Tencent
Yi Chen is a senior software engineer at Tencent Cloud, responsible for cloud data warehouse development. As a Hadoop committer/PMC member, she focuses on big data storage area, and also leads the Hadoop 2.9.1 release for Apache Hadoop community. Before joining Tencent, she was the... Read More →
JD

Junping Du

Architect, Tencent
Junping Du is chief architect for Tencent Cloud Big Data Department and responsible for cloud data warehouse engineering team. As Committer/PMC member, he serves as release manager of Hadoop 2.6.x and 2.8.x for Apache Hadoop community. Junping has more than 10 years industry experiences... Read More →

KubeCon China 2019 kccnc yichen v1 pdf
Tuesday June 25, 2019 15:05 - 15:40 CST
609
  KC+CNC - 存储