Uploaded image for project: 'Apache MADlib'
  1. Apache MADlib
  2. MADLIB-1026

Support for Greenplum 4.30RCA

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Minor
    • Resolution: Cannot Reproduce
    • None
    • v1.9.1
    • All Modules
    • None

    Description

      Hi there,

      Lately I have setup a 02 node cluster for Greenplum 4.3RC, however cannot setup madlib. Following is the error that I get when i try to install madlib

      gppkg installation was successful.

      [gpadmin@GPDB2-M1 ~]$ gppkg -i GPDB_4.3/madlib-ossv1.7.1_pv1.9.3_gpdb4.3orca-rhel5-x86_64.gppkg
      20160924:18:10:58:005508 gppkg:GPDB2-M1:gpadmin-[INFO]:-Starting gppkg with args: -i GPDB_4.3/madlib-ossv1.7.1_pv1.9.3_gpdb4.3orca-rhel5-x86_64.gppkg
      20160924:18:10:59:005508 gppkg:GPDB2-M1:gpadmin-[INFO]:-Installing package madlib-ossv1.7.1_pv1.9.3_gpdb4.3orca-rhel5-x86_64.gppkg
      20160924:18:10:59:005508 gppkg:GPDB2-M1:gpadmin-[INFO]:-Validating rpm installation cmdStr='rpm --test -i /home/gpadmin/GPDB/install/.tmp/madlib-1.7.1-1.x86_64.rpm --dbpath /home/gpadmin/GPDB/install/share/packages/database --prefix /home/gpadmin/GPDB/install'
      20160924:18:11:02:005508 gppkg:GPDB2-M1:gpadmin-[INFO]:-Installing madlib-ossv1.7.1_pv1.9.3_gpdb4.3orca-rhel5-x86_64.gppkg locally
      20160924:18:11:03:005508 gppkg:GPDB2-M1:gpadmin-[INFO]:-Validating rpm installation cmdStr='rpm --test -i /home/gpadmin/GPDB/install/.tmp/madlib-1.7.1-1.x86_64.rpm --dbpath /home/gpadmin/GPDB/install/share/packages/database --prefix /home/gpadmin/GPDB/install'
      20160924:18:11:03:005508 gppkg:GPDB2-M1:gpadmin-[INFO]:-Installing rpms cmdStr='rpm -i /home/gpadmin/GPDB/install/.tmp/madlib-1.7.1-1.x86_64.rpm --dbpath /home/gpadmin/GPDB/install/share/packages/database --prefix=/home/gpadmin/GPDB/install'
      20160924:18:11:04:005508 gppkg:GPDB2-M1:gpadmin-[INFO]:-Completed local installation of madlib-ossv1.7.1_pv1.9.3_gpdb4.3orca-rhel5-x86_64.gppkg.
      20160924:18:11:04:005508 gppkg:GPDB2-M1:gpadmin-[INFO]:-Please run the following command to deploy MADlib
      usage: madpack install [-s schema_name] -p greenplum -c user@host:port/database
      Example:
      $ $GPHOME/madlib/bin/madpack install -s madlib -p greenplum -c gpadmin@mdw:5432/testdb
      This will install MADlib objects into a Greenplum database named "testdb"
      running on server "mdw" on port 5432. Installer will try to login as "gpadmin"
      and will prompt for password. The target schema will be "madlib".
      To upgrade to a new version of MADlib from version v1.0 or later, use option "upgrade",
      instead of "install"
      For additional options run:
      $ madpack --help
      Release notes and additional documentation can be found at http://madlib.net
      20160924:18:11:04:005508 gppkg:GPDB2-M1:gpadmin-[INFO]:-madlib-ossv1.7.1_pv1.9.3_gpdb4.3orca-rhel5-x86_64.gppkg successfully installed.

      but madlib installation has failed.

      [gpadmin@GPDB2-M1 ~]$ /home/gpadmin/GPDB/greenplum-db/madlib/bin/madpack -s madlib -p greenplum -c gpadmin@GPDB2-M1:5432/mdo install
      madpack.py : INFO : Detected Greenplum DB version 4.3ORCA.
      madpack.py : INFO : *** Installing MADlib ***
      madpack.py : INFO : MADlib tools version = 1.7.1 (/home/gpadmin/GPDB/install/madlib/Versions/1.7.1/bin/../madpack/madpack.py)
      madpack.py : INFO : MADlib database version = None (host=GPDB2-M1:5432, db=mdo, schema=mdo)
      madpack.py : INFO : Testing PL/Python environment...
      madpack.py : INFO : > PL/Python environment OK (version: 2.6.2)
      madpack.py : INFO : Installing MADlib into MDO schema...
      madpack.py : INFO : > Creating MDO schema
      madpack.py : INFO : > Creating MDO.MigrationHistory table
      madpack.py : INFO : > Writing version info in MigrationHistory table
      madpack.py : INFO : > Creating objects for modules:
      madpack.py : INFO : > - array_ops
      madpack.py : ERROR : Failed executing m4 on /home/gpadmin/GPDB/install/madlib/Versions/1.7.1/ports/greenplum/modules/array_ops/array_ops.sql_in
      madpack.py : INFO : Rolling back the installation...
      madpack.py : INFO : Rollback finished successfully.
      madpack.py : ERROR : MADlib installation failed.

      Underlying platform in this case is CentOS 7.

      [gpadmin@GPDB2-M1 ~]$ psql -c 'select version()'
      version

      ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
      ------------------
      PostgreSQL 8.2.15 (Greenplum Database 4.3.9.1 build commit:095e92e4ecbbbb6764897ca98b1cb7705ad0c805) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.4.2 compiled on Aug
      24 2016 06:30:45
      (1 row)

      Please note that I have tried to work with 1.7 / 1.8 and 1.9 all version break at the same point. Can you please guide me as what might be wrong.

      Following is the log output that i get:

        1. ****************************
          2016-09-24 19:55:49.411167 MYT,"gpadmin","mdo",p10815,th-741669056,"172.20.100.96","30637",2016-09-24 19:55:49 MYT,4416,con97,cmd1,seg-1,,dx93,x4416,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; DROP TABLE IF EXISTS madlib.migrationhistory;",,,,,,"set CLIENT_MIN_MESSAGES=error; DROP TABLE IF EXISTS madlib.migrationhistory;",0,,"postgres.c",1620,
          2016-09-24 19:55:49.463288 MYT,"gpadmin","mdo",p10823,th-741669056,"172.20.100.96","30643",2016-09-24 19:55:49 MYT,4418,con98,cmd1,seg-1,,dx94,x4418,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; CREATE TABLE madlib.migrationhistory
          (id serial, version varchar(255),
          applied timestamp default current_timestamp);",,,,,,"set CLIENT_MIN_MESSAGES=error; CREATE TABLE madlib.migrationhistory
          (id serial, version varchar(255),
          applied timestamp default current_timestamp);",0,,"postgres.c",1620,
          2016-09-24 19:55:49.566297 MYT,"gpadmin","mdo",p10837,th-741669056,"172.20.100.96","30649",2016-09-24 19:55:49 MYT,4420,con99,cmd1,seg-1,,dx95,x4420,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; INSERT INTO madlib.migrationhistory(version) VALUES('1.9.1')",,,,,,"set CLIENT_MIN_MESSAGES=error; INSERT INTO madlib.migrationhistory(version) VALUES('1.9.1')",0,,"postgres.c",1620,
          2016-09-24 19:55:49.771303 MYT,"gpadmin","mdo",p10870,th-741669056,"172.20.100.96","30663",2016-09-24 19:55:49 MYT,4422,con100,cmd1,seg-1,,dx96,x4422,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; DROP SCHEMA madlib CASCADE;",,,,,,"set CLIENT_MIN_MESSAGES=error; DROP SCHEMA madlib CASCADE;",0,,"postgres.c",1620,
          2016-09-24 19:56:19.427966 MYT,"gpadmin","mdo",p10902,th-741669056,"172.20.100.96","30673",2016-09-24 19:56:19 MYT,4424,con101,cmd1,seg-1,,dx97,x4424,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; SELECT 1",,,,,,"set CLIENT_MIN_MESSAGES=error; SELECT 1",0,,"postgres.c",1620,
          2016-09-24 19:56:19.468237 MYT,"gpadmin","mdo",p10910,th-741669056,"172.20.100.96","30679",2016-09-24 19:56:19 MYT,4426,con102,cmd1,seg-1,,dx98,x4426,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; SELECT pg_catalog.version()",,,,,,"set CLIENT_MIN_MESSAGES=error; SELECT pg_catalog.version()",0,,"postgres.c",1620,
          2016-09-24 19:56:19.507181 MYT,"gpadmin","mdo",p10918,th-741669056,"172.20.100.96","30685",2016-09-24 19:56:19 MYT,4428,con103,cmd1,seg-1,,dx99,x4428,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; SELECT count AS cnt FROM pg_tables WHERE schemaname='madlib' AND tablename='migrationhistory'",,,,,,"set CLIENT_MIN_MESSAGES=error; SELECT count AS cnt FROM pg_tables WHERE schemaname='madlib' AND tablename='migrationhistory'",0,,"postgres.c",1620,
          2016-09-24 19:56:19.551223 MYT,"gpadmin","mdo",p10926,th-741669056,"172.20.100.96","30691",2016-09-24 19:56:19 MYT,4430,con104,cmd1,seg-1,,dx100,x4430,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; SELECT version() AS version",,,,,,"set CLIENT_MIN_MESSAGES=error; SELECT version() AS version",0,,"postgres.c",1620,
          2016-09-24 19:56:19.613250 MYT,"gpadmin","mdo",p10934,th-741669056,"172.20.100.96","30697",2016-09-24 19:56:19 MYT,4432,con105,cmd1,seg-1,,dx101,x4432,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; SELECT count AS CNT FROM pg_language WHERE lanname = 'plpythonu'",,,,,,"set CLIENT_MIN_MESSAGES=error; SELECT count AS CNT FROM pg_language WHERE lanname = 'plpythonu'",0,,"postgres.c",1620,
          2016-09-24 19:56:19.654229 MYT,"gpadmin","mdo",p10942,th-741669056,"172.20.100.96","30703",2016-09-24 19:56:19 MYT,4434,con106,cmd1,seg-1,,dx102,x4434,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; DROP FUNCTION IF EXISTS plpy_version_for_madlib();",,,,,,"set CLIENT_MIN_MESSAGES=error; DROP FUNCTION IF EXISTS plpy_version_for_madlib();",0,,"postgres.c",1620,
          2016-09-24 19:56:19.695231 MYT,"gpadmin","mdo",p10950,th-741669056,"172.20.100.96","30709",2016-09-24 19:56:19 MYT,4436,con107,cmd1,seg-1,,dx103,x4436,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error;
          CREATE OR REPLACE FUNCTION plpy_version_for_madlib()
          RETURNS TEXT AS
          $$
          import sys
      2. return '.'.join(str(item) for item in sys.version_info[:3])
        return str(sys.version_info[:3]).replace(',','.').replace(' ','').replace(')','').replace('(','')
        $$
        LANGUAGE plpythonu;",,,,,,"set CLIENT_MIN_MESSAGES=error;
        CREATE OR REPLACE FUNCTION plpy_version_for_madlib()
        RETURNS TEXT AS
        $$
        import sys
      3. return '.'.join(str(item) for item in sys.version_info[:3])
        return str(sys.version_info[:3]).replace(',','.').replace(' ','').replace(')','').replace('(','')
        $$
        LANGUAGE plpythonu;
        ",0,,"postgres.c",1620,
        2016-09-24 19:56:19.766835 MYT,"gpadmin","mdo",p10961,th-741669056,"172.20.100.96","30715",2016-09-24 19:56:19 MYT,4438,con108,cmd1,seg-1,,dx104,x4438,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; SELECT plpy_version_for_madlib() AS ver;",,,,,,"set CLIENT_MIN_MESSAGES=error; SELECT plpy_version_for_madlib() AS ver;",0,,"postgres.c",1620,
        2016-09-24 19:56:19.820213 MYT,"gpadmin","mdo",p10969,th-741669056,"172.20.100.96","30721",2016-09-24 19:56:19 MYT,4440,con109,cmd1,seg-1,,dx105,x4440,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; DROP FUNCTION IF EXISTS plpy_version_for_madlib();",,,,,,"set CLIENT_MIN_MESSAGES=error; DROP FUNCTION IF EXISTS plpy_version_for_madlib();",0,,"postgres.c",1620,
        2016-09-24 19:56:19.870327 MYT,"gpadmin","mdo",p10980,th-741669056,"172.20.100.96","30727",2016-09-24 19:56:19 MYT,4442,con110,cmd1,seg-1,,dx106,x4442,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; CREATE TABLE madlib._madlib_test_table (A INT);",,,,,,"set CLIENT_MIN_MESSAGES=error; CREATE TABLE madlib._madlib_test_table (A INT);",0,,"postgres.c",1620,
        2016-09-24 19:56:19.896295 MYT,"gpadmin","mdo",p10980,th-741669056,"172.20.100.96","30727",2016-09-24 19:56:19 MYT,4442,con110,cmd1,seg-1,,dx106,x4442,sx1,"ERROR","3F000","schema ""madlib"" does not exist",,,,,,"set CLIENT_MIN_MESSAGES=error; CREATE TABLE madlib.__madlib_test_table (A INT);",0,,"namespace.c",477,
        2016-09-24 19:56:19.911351 MYT,"gpadmin","mdo",p10988,th-741669056,"172.20.100.96","30733",2016-09-24 19:56:19 MYT,4444,con111,cmd1,seg-1,,dx107,x4444,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; CREATE SCHEMA madlib;",,,,,,"set CLIENT_MIN_MESSAGES=error; CREATE SCHEMA madlib;",0,,"postgres.c",1620,
        2016-09-24 19:56:19.971440 MYT,"gpadmin","mdo",p10999,th-741669056,"172.20.100.96","30739",2016-09-24 19:56:19 MYT,4446,con112,cmd1,seg-1,,dx108,x4446,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; DROP TABLE IF EXISTS madlib.migrationhistory;",,,,,,"set CLIENT_MIN_MESSAGES=error; DROP TABLE IF EXISTS madlib.migrationhistory;",0,,"postgres.c",1620,
        2016-09-24 19:56:20.011259 MYT,"gpadmin","mdo",p11007,th-741669056,"172.20.100.96","30745",2016-09-24 19:56:20 MYT,4448,con113,cmd1,seg-1,,dx109,x4448,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; CREATE TABLE madlib.migrationhistory
        (id serial, version varchar(255),
        applied timestamp default current_timestamp);",,,,,,"set CLIENT_MIN_MESSAGES=error; CREATE TABLE madlib.migrationhistory
        (id serial, version varchar(255),
        applied timestamp default current_timestamp);",0,,"postgres.c",1620,
        2016-09-24 19:56:20.097290 MYT,"gpadmin","mdo",p11021,th-741669056,"172.20.100.96","30751",2016-09-24 19:56:20 MYT,4450,con114,cmd1,seg-1,,dx110,x4450,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; INSERT INTO madlib.migrationhistory(version) VALUES('1.9.1')",,,,,,"set CLIENT_MIN_MESSAGES=error; INSERT INTO madlib.migrationhistory(version) VALUES('1.9.1')",0,,"postgres.c",1620,
        2016-09-24 19:56:20.287206 MYT,"gpadmin","mdo",p11054,th-741669056,"172.20.100.96","30765",2016-09-24 19:56:20 MYT,4452,con115,cmd1,seg-1,,dx111,x4452,sx1,"LOG","00000","statement: set CLIENT_MIN_MESSAGES=error; DROP SCHEMA madlib CASCADE;",,,,,,"set CLIENT_MIN_MESSAGES=error; DROP SCHEMA madlib CASCADE;",0,,"postgres.c",1620,
        1. ****************************

      Attachments

        Activity

          People

            Unassigned Unassigned
            atifpmalik Atif
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: