Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-26084

Oracle metastore init tests are flaky

    XMLWordPrintableJSON

Details

    • Test
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 4.0.0-alpha-2
    • None
    • Testing Infrastructure
    • None

    Description

      After HIVE-26022 we started to run the oracle metastore init tests, but they seem to be flaky.
      I see this issue quite often: http://ci.hive.apache.org/blue/organizations/jenkins/hive-precommit/detail/PR-3147/1/pipeline/551

      We might have to increase the timeout, or use another oracle image for more consistent tests.

      The error in the logs for future reference

      [2022-03-28T14:10:07.804Z] + echo 127.0.0.1 dev_oracle
      [2022-03-28T14:10:07.804Z] + sudo tee -a /etc/hosts
      [2022-03-28T14:10:07.804Z] 127.0.0.1 dev_oracle
      [2022-03-28T14:10:07.804Z] + . /etc/profile.d/confs.sh
      [2022-03-28T14:10:07.804Z] ++ export MAVEN_OPTS=-Xmx2g
      [2022-03-28T14:10:07.804Z] ++ MAVEN_OPTS=-Xmx2g
      [2022-03-28T14:10:07.804Z] ++ export HADOOP_CONF_DIR=/etc/hadoop
      [2022-03-28T14:10:07.804Z] ++ HADOOP_CONF_DIR=/etc/hadoop
      [2022-03-28T14:10:07.804Z] ++ export HADOOP_LOG_DIR=/data/log
      [2022-03-28T14:10:07.804Z] ++ HADOOP_LOG_DIR=/data/log
      [2022-03-28T14:10:07.804Z] ++ export 'HADOOP_CLASSPATH=/etc/tez/:/active/tez/lib/*:/active/tez/*:/apps/lib/*'
      [2022-03-28T14:10:07.804Z] ++ HADOOP_CLASSPATH='/etc/tez/:/active/tez/lib/*:/active/tez/*:/apps/lib/*'
      [2022-03-28T14:10:07.804Z] ++ export HIVE_CONF_DIR=/etc/hive/
      [2022-03-28T14:10:07.804Z] ++ HIVE_CONF_DIR=/etc/hive/
      [2022-03-28T14:10:07.804Z] ++ export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/active/hive/bin:/active/hadoop/bin:/active/eclipse/:/active/maven/bin/:/active/protobuf/bin:/active/visualvm/bin:/active/kubebuilder/bin:/active/idea/bin
      [2022-03-28T14:10:07.804Z] ++ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/active/hive/bin:/active/hadoop/bin:/active/eclipse/:/active/maven/bin/:/active/protobuf/bin:/active/visualvm/bin:/active/kubebuilder/bin:/active/idea/bin
      [2022-03-28T14:10:07.804Z] ++ . /etc/profile.d/java.sh
      [2022-03-28T14:10:07.804Z] +++ export JAVA_HOME=/usr/lib/jvm/zulu-8-amd64/
      [2022-03-28T14:10:07.804Z] +++ JAVA_HOME=/usr/lib/jvm/zulu-8-amd64/
      [2022-03-28T14:10:07.804Z] + sw hive-dev /home/jenkins/agent/workspace/hive-precommit_PR-3147
      [2022-03-28T14:10:07.804Z] @ activating: /home/jenkins/agent/workspace/hive-precommit_PR-3147/packaging/target/apache-hive-4.0.0-alpha-1-SNAPSHOT-bin/apache-hive-4.0.0-alpha-1-SNAPSHOT-bin/ for hive
      [2022-03-28T14:10:07.804Z] + ping -c2 dev_oracle
      [2022-03-28T14:10:07.804Z] PING dev_oracle (127.0.0.1) 56(84) bytes of data.
      [2022-03-28T14:10:07.804Z] 64 bytes from localhost (127.0.0.1): icmp_seq=1 ttl=64 time=0.082 ms
      [2022-03-28T14:10:08.795Z] 64 bytes from localhost (127.0.0.1): icmp_seq=2 ttl=64 time=0.087 ms
      [2022-03-28T14:10:08.795Z] 
      [2022-03-28T14:10:08.795Z] --- dev_oracle ping statistics ---
      [2022-03-28T14:10:08.795Z] 2 packets transmitted, 2 received, 0% packet loss, time 51ms
      [2022-03-28T14:10:08.795Z] rtt min/avg/max/mdev = 0.082/0.084/0.087/0.009 ms
      [2022-03-28T14:10:08.795Z] + export DOCKER_NETWORK=host
      [2022-03-28T14:10:08.795Z] + DOCKER_NETWORK=host
      [2022-03-28T14:10:08.795Z] + export DBNAME=metastore
      [2022-03-28T14:10:08.795Z] + DBNAME=metastore
      [2022-03-28T14:10:08.795Z] + reinit_metastore oracle
      [2022-03-28T14:10:08.795Z] @ initializing: oracle
      [2022-03-28T14:10:08.795Z] metastore database name: metastore
      [2022-03-28T14:10:09.135Z] @ starting dev_oracle...
      [2022-03-28T14:10:09.445Z] Unable to find image 'quay.io/maksymbilenko/oracle-12c:latest' locally
      [2022-03-28T14:10:10.407Z] latest: Pulling from maksymbilenko/oracle-12c
      [2022-03-28T14:10:10.407Z] 8ba884070f61: Pulling fs layer
      [2022-03-28T14:10:10.407Z] ef9513b81046: Pulling fs layer
      [2022-03-28T14:10:10.407Z] 6f1de349e202: Pulling fs layer
      [2022-03-28T14:10:10.407Z] 5376ebfa0fa3: Pulling fs layer
      [2022-03-28T14:10:10.407Z] 5f632c3633d2: Pulling fs layer
      [2022-03-28T14:10:10.407Z] 3e74293031d2: Pulling fs layer
      [2022-03-28T14:10:10.407Z] 5376ebfa0fa3: Waiting
      [2022-03-28T14:10:10.407Z] 5f632c3633d2: Waiting
      [2022-03-28T14:10:10.407Z] 3e74293031d2: Waiting
      [2022-03-28T14:10:10.407Z] 6f1de349e202: Download complete
      [2022-03-28T14:10:11.365Z] ef9513b81046: Download complete
      [2022-03-28T14:10:11.365Z] 5f632c3633d2: Verifying Checksum
      [2022-03-28T14:10:11.365Z] 5f632c3633d2: Download complete
      [2022-03-28T14:10:11.365Z] 8ba884070f61: Verifying Checksum
      [2022-03-28T14:10:11.365Z] 8ba884070f61: Download complete
      [2022-03-28T14:10:11.952Z] 3e74293031d2: Verifying Checksum
      [2022-03-28T14:10:11.952Z] 3e74293031d2: Download complete
      [2022-03-28T14:10:18.581Z] 8ba884070f61: Pull complete
      [2022-03-28T14:10:25.200Z] ef9513b81046: Pull complete
      [2022-03-28T14:10:25.200Z] 6f1de349e202: Pull complete
      [2022-03-28T14:10:51.836Z] 5376ebfa0fa3: Verifying Checksum
      [2022-03-28T14:10:51.836Z] 5376ebfa0fa3: Download complete
      [2022-03-28T14:12:28.458Z] 5376ebfa0fa3: Pull complete
      [2022-03-28T14:12:28.458Z] 5f632c3633d2: Pull complete
      [2022-03-28T14:12:28.458Z] 3e74293031d2: Pull complete
      [2022-03-28T14:12:28.720Z] Digest: sha256:de3f7d4a608107d6271d7b2c40368caae7b4fc14bb893e164346fb951e15a70b
      [2022-03-28T14:12:31.364Z] Status: Downloaded newer image for quay.io/maksymbilenko/oracle-12c:latest
      [2022-03-28T14:14:22.932Z] 0ba74f61dbea555b045628b8eede1ca9513d4baf16882a983550515b16d7ba2a
      [2022-03-28T14:14:22.932Z] waiting for oracle to be available...
      [2022-03-28T14:19:29.766Z] timeout reached before the port went into state "inuse"
      script returned exit code 1
      

      Attachments

        Issue Links

          Activity

            People

              zabetak Stamatis Zampetakis
              pvary Peter Vary
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: