Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-574

HCat replication fails

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.5
    • None
    • replication
    • None
    • QA

    Description

      Got the following error upon scheduling an HCat feed for replication:

      <?xml version="1.0" encoding="UTF-8"?><result>
        <status>PARTIAL</status>
        <message>ua1/raaw-logs16-256a9e62(feed) scheduled successfullyua2/org.apache.falcon.FalconException: AUTHENTICATION : E1004 : E1004: Expression language evaluation error, Unable to evaluate :${coord:dataInPartitions('input', 'hive-export')}:	at org.apache.falcon.workflow.engine.OozieWorkflowEngine.dryRunInternal(OozieWorkflowEngine.java:188)	at org.apache.falcon.workflow.engine.OozieWorkflowEngine.schedule(OozieWorkflowEngine.java:157)	at org.apache.falcon.resource.AbstractSchedulableEntityManager.scheduleInternal(AbstractSchedulableEntityManager.java:69)	at org.apache.falcon.resource.AbstractSchedulableEntityManager.schedule(AbstractSchedulableEntityManager.java:58)	at org.apache.falcon.resource.SchedulableEntityManager.schedule(SchedulableEntityManager.java:85)	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)	at java.lang.reflect.Method.invoke(Method.java:622)	at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)	at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)	at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)	at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)	at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)	at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)	at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)	at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)	at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)	at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)	at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)	at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)	at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)	at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)	at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)	at org.apache.falcon.security.BasicAuthFilter$2.doFilter(BasicAuthFilter.java:184)	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:384)	at org.apache.falcon.security.BasicAuthFilter.doFilter(BasicAuthFilter.java:222)	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)	at org.mortbay.jetty.Server.handle(Server.java:326)	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)	at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)	at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)	at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)Caused by: AUTHENTICATION : E1004 : E1004: Expression language evaluation error, Unable to evaluate :${coord:dataInPartitions('input', 'hive-export')}:	at org.apache.oozie.client.ProxyOozieClient.dryrun(ProxyOozieClient.java:184)	at org.apache.falcon.workflow.engine.OozieWorkflowEngine.dryRunInternal(OozieWorkflowEngine.java:186)	... 44 moreCaused by: E1004 : E1004: Expression language evaluation error, Unable to evaluate :${coord:dataInPartitions('input', 'hive-export')}:	at org.apache.oozie.client.OozieClient.handleError(OozieClient.java:508)	at org.apache.oozie.client.OozieClient$JobSubmit.call(OozieClient.java:591)	at org.apache.oozie.client.OozieClient$JobSubmit.call(OozieClient.java:561)	at org.apache.oozie.client.OozieClient$ClientCallable.call(OozieClient.java:479)	at org.apache.oozie.client.OozieClient.dryrun(OozieClient.java:634)	at org.apache.oozie.client.ProxyOozieClient.access$401(ProxyOozieClient.java:49)	at org.apache.oozie.client.ProxyOozieClient$4.call(ProxyOozieClient.java:180)	at org.apache.oozie.client.ProxyOozieClient$4.call(ProxyOozieClient.java:177)	at org.apache.oozie.client.OozieClient.doAs(OozieClient.java:191)	at org.apache.oozie.client.ProxyOozieClient.dryrun(ProxyOozieClient.java:177)	... 45 more</message>
        <requestId>ua1/5b1d78b0-a603-48e8-b454-1cae3cbd3eccua2/95c2b81b-696f-4ef6-a6ba-775a15bf93be</requestId>
      </result>
      
      

      Feed xml:

      <?xml version="1.0" encoding="UTF-8"?><feed xmlns="uri:falcon:feed:0.1" name="raaw-logs16-256a9e62" description="clicks log">
          <frequency>hours(1)</frequency>
          <timezone>UTC</timezone>
          <late-arrival cut-off="hours(6)"/>
          <clusters>
              <cluster name="corp-b6af0900" type="source">
                  <validity start="2010-01-01T20:00Z" end="2099-01-01T00:00Z"/>
                  <retention limit="months(9000)" action="delete"/>
              </cluster>
              <cluster name="corp-a8fb8341" type="target">
                  <validity start="2010-01-01T20:00Z" end="2099-01-01T00:00Z"/>
                  <retention limit="months(9000)" action="delete"/>
                  <table uri="catalog:default:HCatReplication_oneSourceOneTarget_hyphen#dt=${YEAR}-${MONTH}-${DAY}-${HOUR}"/>
              </cluster>
          </clusters>
          <table uri="catalog:default:HCatReplication_oneSourceOneTarget_hyphen#dt=${YEAR}-${MONTH}-${DAY}-${HOUR}"/>
          <ACL owner="karishma" group="default" permission="0x755"/>
          <schema location="hcat" provider="hcat"/>
          <properties>
              <property name="field1" value="value1"/>
              <property name="field2" value="value2"/>
          </properties>
      </feed>
      

      Attachments

        Activity

          People

            satish.mittal Satish Mittal
            karishmag9 Karishma Gulati
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: