Uploaded image for project: 'Apache IoTDB'
  1. Apache IoTDB
  2. IOTDB-68

IoTDB supports distributed version

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Hi, IoTDB only supports stand-alone version now. We plan to develop distributed version in next two months. 

      We initially decided to use the master-slave architecture. The master node is responsible for processing read and write requests, and the slave node is responsible for processing read-only requests as a copy.

      In terms of implementation, we currently intend to use the raft protocol to ensure the data consistency of each replica node.

      If you have any suggestion, please comment below or send an email to our mailing list(dev@iotdb.apache.org).

      Attachments

        Issue Links

        Blocked

        New Feature - A new feature of the product, which has yet to be developed. IOTDB-781 [Distributed]Support AlterTimeSeriesPlan in distributed version

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-1182 [Distributed] read and write in leader node

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-1251 optimization route intervals

        • Major - Major loss of function.
        • Closed
        is a parent of

        Sub-task - The sub-task of the issue IOTDB-373 [Distributed] Query coordinating

        • Major - Major loss of function.
        • Open

        Bug - A problem which impairs or prevents the functions of the product. IOTDB-1302 [Distributed] Remove what is not in the snapshot during installation

        • Major - Major loss of function.
        • Open

        Bug - A problem which impairs or prevents the functions of the product. IOTDB-674 [Distributed] WAL cannot be replayed due to meta missing

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. IOTDB-823 [Distributed] All Nodes Report Successful Execution When Delete Timeseries Simultaneously

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. IOTDB-896 [Distributed] Fail to Insert Nonexistent Timeseries

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. IOTDB-917 [Distributed] Prevent rebooting from damaging file versions

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. IOTDB-1096 [Distributed]Can not restart the servers when added one new node

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. IOTDB-1402 Support the auto-create-schema mechanism for insertRecords in cluster module

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. IOTDB-1404 Write blocking problem for three node three replica cluster

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. IOTDB-838 [Distributed]merge raft log and wal log

        • Major - Major loss of function.
        • Open

        New Feature - A new feature of the product, which has yet to be developed. IOTDB-857 [Distributed]make call traceable

        • Major - Major loss of function.
        • Open

        New Feature - A new feature of the product, which has yet to be developed. IOTDB-992 [Distributed] The ability to migrate stand-alone version data to distributed version

        • Major - Major loss of function.
        • Open

        New Feature - A new feature of the product, which has yet to be developed. IOTDB-801 [Distributed]Separate data port and heartbeat port

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. IOTDB-372 [Distributed] Support node deletion.

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. IOTDB-925 [Distributed]Add a mechanism for detecting down nodes

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-688 [Distributed] Supplement the functionalities of NodeTool

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-690 [Distributed] Turn to broadcasting when calculating targeting nodes takes too long

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-820 [Distributed] A non-blocking snapshot should be brought up

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-854 [Distributed] Limit the memory foorprint of the committed log cache

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-880 [Distributed] Better concurrecy control in RaftLogManager

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-998 [Distributed] Split the snapshot when sending to follower

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-1019 [Distributed] Memory control of the cluster engine

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-1020 [Distributed] Split the persist log buffer to better absorb ingestion

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-1236 Improve jdbc performance for creating timeseries in cluster module

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-1370 Cache Leader feature Optimization for massive device scenarios

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-349 [Distributed] Incrementally update snapshot

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-353 [Distributed] Validate files in snapshots

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-900 [Distributed] Tree-structured log forwarding within a raft group.

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-821 [Distributed] Flush Raft Logs in Batches

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-822 [Distributed] Flush Raft Logs Periodically

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-1118 [Distributed] Limit query log lag in mid consistency level

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-814 [Distributed] Cache and redirect distributed IoTDB's leader for write requests in IoTDB's client

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-815 [Distributed] Support cluster_name check

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-348 [Distributed] Support more non-query operations (log types)

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-350 [Distributed] Integrate with time partitioning of data

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-351 [Distributed] Serialize the raft logs

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-352 [Distributed] Recognize and skip duplicated files in a snapshot

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-355 [Distributed] Start-up checks

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-451 [Distributed]Recovery of snapshot pulling

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-460 [Distributed] Remove data of outdated slots

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-526 [Distributed] Support metadata queries

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-532 [Distributed] Enabling parallel processing within a data group

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-554 [Distributed] Add the ability to resolve log inconsistencies for AppendEntries request

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-555 [Distributed] Add peer tracker

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-556 [Distributed] Implement truncate function for logs inconsistence

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-562 [Distributed]Apache IoTDB raft log persistence in the distributed version

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-568 [Distributed] Protect files of data snapshot

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-590 [Distributed] add other meta data when do metaSnapshot

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-601 [Distributed]Add authentication in MetaSnapshot

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-602 [Distributed] Check or enable LAST query

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-604 [Distributed] More robust cluster readers

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-606 [Distributed] Replace raw logs in MetaSnapshot

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-709 [Distributed] Enable schema auto-creation

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-722 [Distributed] Support mode consistencies

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-723 [Distributed] Decide a log discarding policy

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-807 [Distributed]Make heartbeat thread commit log asynchronous

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-809 [Distributed] Separate Read and Write Timeout Threshold Configurations

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-810 [Distributed] Set Configuration of Max Number of Logs in Memory

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-860 [Distributed]Emend the async log applier

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-884 [Distributed] Batched forwarding for batched requests

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-915 [Distributed] Merge StableEntryManager into CommittedLogManager

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-918 [Distributed] Bind TsFiles with log index to accelerate snapshots

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-948 [Distributed]Use binary search when checking the follower's match index when catchup

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-953 [Distributed] Improve handling when a node cannot be reached

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-1099 Optimize insertablets logic in cluster module

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-1117 [Distributed] Batched creation and fetch of RemoteSeriesReader

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-1399 Make session and jdbc interface more adaptable to the cluster

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-354 [Distributed] Implement batch append entries

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-586 [Distributed] Eliminate some timeseries schemas When memory is limited

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-613 [Distributed] Add the ability to persist and maintain currentterm for the raft node

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. IOTDB-620 [Distributed] Add the ability to persist and maintain voteFor for the raft node and amend the judgment conditions for elections

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Wish - General wishlist item. IOTDB-571 [Distributed] Automated cluster test

        • Major - Major loss of function.
        • Open

        Wish - General wishlist item. IOTDB-858 [Distributed]Add cluster setup document

        • Major - Major loss of function.
        • Closed

        Task - A task that needs to be done. IOTDB-567 [Distributed]Apache IoTDB's Peer Tracker for The Raft Protocol

        • Major - Major loss of function.
        • Closed
        relates to

        Bug - A problem which impairs or prevents the functions of the product. IOTDB-1218 [Distributed]System properties is not persist in cluster version

        • Major - Major loss of function.
        • Closed
        links to

        Web Link GitHub Pull Request #178

        Web Link GitHub Pull Request #460

        Web Link GitHub Pull Request #460

        Web Link pr#172

        Web Link pr#178

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            XuYi XuYi
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 10m
                10m

                Slack

                  Issue deployment