Uploaded image for project: 'Daffodil'
  1. Daffodil
  2. DAFFODIL-1774

Performance - Investigate expression compilation speed

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Not A Bug
    • None
    • None
    • Front End, Middle "End"
    • None

    Description

      Expression compilation is incredibly slow right now, even for incredibly small schemas.

      We should profiling just expression compilation and see if there is any low hanging fruit that could easily be sped up. One potential place is the type converter, which is a just match case. This is probably very slow when the match is at the bottom of this list. We likely want to use a hash lookup for this.

      Additionally, there have been some reports that the scala parser combinator library is fairly poor (both slow and memory inefficient), so it may be worth looking into alternatives. The [https://github.com/lihaoyi/fastparse|fastparse] library might be a good alternative, though it does not appear to be a drop in replacement for our needs.

      Attachments

        Activity

          People

            slawrence Steve Lawrence
            slawrence Steve Lawrence
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: