[GSoC 2026] Flink connector for IoTDB table mode – prospective contributor #17128
Replies: 5 comments
-
|
Thank you for your strong interest in the Apache IoTDB Flink connector project. We are impressed with your thorough preparation and understanding of the project's goals. Regarding your questions, here is some guidance: [1] https://github.com/apache/iotdb-extras/tree/master/connectors/flink-iotdb-connector |
Beta Was this translation helpful? Give feedback.
-
|
Thank you for the detailed guidance and encouragement. I’ll start by studying the Source and Sink implementations for Tree Mode in the existing flink-iotdb-connector to better understand the current data flow and architecture. In parallel, I’ll continue exploring IoTDB’s table-mode SQL features to identify where adaptations may be needed. I’ll keep the Flink Table API as the primary focus for an initial MVP while keeping the DataStream API in mind for the overall design. Once I have some exploratory findings or early design thoughts, I’ll be happy to share them in a follow-up discussion or small PR for feedback. Thanks again for your guidance. Sincerely, |
Beta Was this translation helpful? Give feedback.
-
|
Hello , Following our previous discussion, I wanted to share a quick update on my progress with the IoTDB 2.0 Table Model integration. To better understand the new API, I built a functional Proof of Concept (PoC) that successfully connects Flink 1.18 to IoTDB in Table Mode. Key Findings: During implementation, I confirmed that the standard Session class defaults to the legacy Tree Model, which caused syntax errors when executing SQL (e.g., CREATE TABLE). I resolved this by switching to the TableSessionBuilder, which explicitly initializes the connection with the correct SQL dialect. I have implemented a custom Flink SourceFunction that executes SQL queries and streams the result rows into Flink. You can review the prototype code and execution logs here: https://github.com/anukalp2804/flink-iotdb-table-connector Next Steps for GSoC Proposal: Based on this PoC, my plan for the official proposal is to:
I would love to hear your thoughts on this approach. Does this align with the project's vision? Thank you for your time. Sincerely, |
Beta Was this translation helpful? Give feedback.
-
|
Hi Anukalp, Thank you for your enthusiasm and for already starting on the code — Really appreciate it! A gentle note: the GSoC project approvals are still pending, so we don’t know yet if it will be accepted. See [1]. For now, it might be best to wait for the official results. If you're interested, we could explore some other IoTDB-related tasks or contributions. We’ll let you know as soon as we hear anything. Feel free to reach out if you have any questions. [1] https://developers.google.com/open-source/gsoc/timeline Warm regards, |
Beta Was this translation helpful? Give feedback.
-
|
Hi Haonan, Thank you for the kind words and the heads-up regarding the GSoC organization acceptance status. I completely understand that the official results are pending. Regardless of the GSoC outcome, building this prototype was a great way for me to understand the internal changes in IoTDB 2.0. I am definitely interested in contributing to the project in the meantime to get more familiar with the codebase. You mentioned exploring other IoTDB-related tasks—are there any specific modules, 'good first issues,' or documentation updates you would recommend I look into? I have my environment set up and ready to go. Best regards, |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Hello,
I’m Anukalp, a CS undergraduate with a strong interest in Java-based backend and data integration systems. I’ve been going through the GSoC idea around building a Flink connector for Apache IoTDB 2.X table mode, and the scope and motivation behind the project are very clear and interesting.
From my understanding, the existing Flink connectors mainly focus on the tree mode, and this project aims to provide first-class support for IoTDB’s table mode through Flink’s DataStream and Table APIs, including schema mapping, read/write support, and fault tolerance.
I’m preparing for GSoC 2026 and plan to start by exploring the existing
flink-iotdb-connector, the table-mode SQL features in IoTDB 2.X, and Flink’s connector architecture. I had a couple of questions:I’d appreciate any guidance on how to prepare effectively and where early exploratory contributions would be most useful.
Thank you for your time.
Beta Was this translation helpful? Give feedback.
All reactions