Olio
  1. Olio
  2. OLIO-40

File loader is slow. Filestore architecture is problematic

    Details

    • Type: Improvement Improvement
    • Status: Reopened
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.1
    • Fix Version/s: 0.2
    • Component/s: generic
    • Labels:
      None

      Description

      As we scale up the number of users, the fileloader takes longer and longer to load the filestore. Further, the loader clutters the faban log with lots of messages marking it's progress. The frequency of these msgs need to be reduced.

      In addition, the current filestore design of a single directory to hold all the files is proving to be difficult to manage. It is impossible to even do an 'ls' in the directory as the number of files is large at scales beyond a few thousand users. A well-defined directory hierarchy should be used to make access more reasonable.

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Akara Sucharitakul
            Reporter:
            Shanti Subramanyam
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Due:
              Created:
              Updated:

              Development