Uploaded image for project: 'Olio'
  1. Olio
  2. OLIO-40

File loader is slow. Filestore architecture is problematic

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Reopened
    • Major
    • Resolution: Unresolved
    • 0.1
    • 0.2
    • generic
    • None

    Description

      As we scale up the number of users, the fileloader takes longer and longer to load the filestore. Further, the loader clutters the faban log with lots of messages marking it's progress. The frequency of these msgs need to be reduced.

      In addition, the current filestore design of a single directory to hold all the files is proving to be difficult to manage. It is impossible to even do an 'ls' in the directory as the number of files is large at scales beyond a few thousand users. A well-defined directory hierarchy should be used to make access more reasonable.

      Attachments

        Activity

          People

            akara Akara Sucharitakul
            shanti Shanti Subramanyam
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated: