Trafodion

update statistics for hive table reports ERROR[9200], ERROR[1002]

Bug #1320397 reported by Julie Thai
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Trafodion
Fix Released
High
Barry Fritchman
Trafodion r1.1

Bug Description

>>select count(*) from hive.hive.nation;

(EXPR)
--------------------

                  25

--- 1 row(s) selected.
>>
>>cqd ustat_log 'updstat_hive';

--- SQL operation complete.
>>update statistics log on;

--- SQL operation complete.
>>update statistics for table hive.hive.nation on every column;

*** ERROR[9200] UPDATE STATISTICS for table HIVE.HIVE.NATION encountered an error (1002) from statement Process_Query.

*** ERROR[1002] Catalog HIVESTATS does not exist or has not been registered on node .

*** ERROR[8822] The statement was not prepared.

--- SQL operation failed with errors.
>>update statistics for table hive.hive.mynation on every column;

*** ERROR[9200] UPDATE STATISTICS for table HIVE.HIVE.MYNATION encountered an error (1002) from statement Process_Query.

*** ERROR[1002] Catalog HIVESTATS does not exist or has not been registered on node .

*** ERROR[8822] The statement was not prepared.

--- SQL operation failed with errors.
>>update statistics log off;

--- SQL operation complete.
>>log off;

encountered on workstation, datalake_64_1 v40596
MY_SQROOT=/opt/home/thaiju/datalake_64_1
who@<email address hidden>
JAVA_HOME=/opt/home/tools/jdk1.7.0_09_64
linux=2.6.32-279.el6.x86_64
redhat=6.3
Release 0.7.0 (Build release [40596], branch 40596-project/datalake_64_1, date 16May14)

to reproduce, see attached hive_updstats.tar contents:
1. in hive, create and load tables nation/mynation; see hive_setup and nation.tbl files
2. in sqlci, obey traf.sql

Tags: sql-cmp
Revision history for this message
Julie Thai (julie-y-thai) wrote :
Anoop Sharma (anoop-sharma)
Changed in trafodion:
assignee: nobody → Barry Fritchman (barry-fritchman)
Julie Thai (julie-y-thai)
Changed in trafodion:
importance: High → Medium
Steve Varnau (steve-varnau)
information type: Proprietary → Public
Revision history for this message
Barry Fritchman (barry-fritchman) wrote :

The catalog used for storing histograms for a Hive table should be Trafodion instead of hivestats.

Barry Fritchman (barry-fritchman)
Changed in trafodion:
status: New → In Progress
importance: Medium → High
Barry Fritchman (barry-fritchman)
Changed in trafodion:
milestone: none → r1.0
Renu Varshneya (renu-varshneya)
Changed in trafodion:
milestone: r1.0 → r1.1
Revision history for this message
Trafodion-Gerrit (neo-devtools) wrote : Fix proposed to core (master)

Fix proposed to branch: master
Review: https://review.trafodion.org/1181

Revision history for this message
Trafodion-Gerrit (neo-devtools) wrote : Fix merged to core (master)

Reviewed: https://review.trafodion.org/1181
Committed: https://github.com/trafodion/core/commit/20c1470100060d32e38ba442fd45f794260d5fa8
Submitter: Trafodion Jenkins
Branch: master

commit 20c1470100060d32e38ba442fd45f794260d5fa8
Author: Barry Fritchman <email address hidden>
Date: Wed Feb 25 06:35:30 2015 +0000

    Errors reported for Update Stats on Hive tables

    Attempts to execute Update Statistics statements on Hive
    tables fail with error 1002 (catalog does not exist). The
    catalog used to store Hive stats was no longer being
    successfully created on demand. The Trafodion catalog is
    now used instead, with a schema for Hive stats created
    in it on first use. The tables for histograms and
    histogram intervals for Hive tables are created in that
    schema on first use.

    Change-Id: Ib57d0af4a3da6f52f0544d6c2fce3e77d2e823c1
    Closes-Bug: #1320397

Changed in trafodion:
status: In Progress → Fix Committed
Revision history for this message
Julie Thai (julie-y-thai) wrote :

verified on Traf 1.1.0rc0 build:
SQL>update statistics for table hive.tpch2x.customer on every column;
--- SQL operation complete.

SQL>showstats for table hive.tpch2x.customer on existing columns;

Histogram data for Table HIVE.TPCH2X.CUSTOMER
Table ID: 0

   Hist ID # Ints Rowcount UEC Colname(s)
========== ====== =========== =========== ===========================
1864945772 25 300000 25 C_NATIONKEY
1864945777 62 300000 300000 C_ADDRESS
1864945782 62 300000 300000 C_NAME
1864945787 48 300000 300000 C_CUSTKEY
1864945791 62 300000 280754 C_COMMENT
1864945796 5 300000 5 C_MKTSEGMENT
1864945801 36 300000 262499 C_ACCTBAL
1864945806 62 300000 300000 C_PHONE

--- SQL operation complete.

Changed in trafodion:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.