Trafodion 1.1 Sandboxは、Trafodionと Trafodionを動かすためのHBaseをはじめとした各Hadoop servicesが使える仮想アプライアンスです。
CentOSとHortonworks Data PlatformとTrafodionがインストールされていて、https://wiki.trafodion.org/wiki/index.php/Installing_the_Trafodion_Sandbox に添ってインポート後に仮想マシンを起動して使えます。
数日前にダウンロードできるようになりました。
VirtualBoxで こんな風に触ってみるまでの作業中、ちょっと「ん?」と思ったところがあったので、そのことを書いておきます。
8GBメモリと 4プロセッサにして動かしてみました
Checking System Resources
https://wiki.trafodion.org/wiki/index.php/Installing_the_Trafodion_Sandbox
To run the Trafodion sandbox successfully, you will need at least 16 GB of memory on your PC. The sandbox uses about 5 GB of memory while the Hadoop services and Trafodion are running, so make sure that you have enough available memory on your PC to support those processes. Otherwise, the sandbox will operate very slowly.
とのこと。*1
デフォルトでは 16GBメモリと8プロセッサです。
こんな風に8GBメモリと 4プロセッサへ変えて起動しました。
ちょっと触ってみる分には特に不都合はなかったです。
ログイン後は Ambari Serverを起動する必要がありました
[trafodion@sandbox ~]$ su - root Password: [root@sandbox ~]# ambari-server start Using python /usr/bin/python2.6 Starting ambari-server Ambari Server running with administrator privileges. Organizing resource files at /var/lib/ambari-server/resources... Server PID at: /var/run/ambari-server/ambari-server.pid Server out at: /var/log/ambari-server/ambari-server.out Server log at: /var/log/ambari-server/ambari-server.log Waiting for server start.................... Ambari Server 'start' completed successfully. [root@sandbox ~]#
dcs.dns.interfaceの設定変更は必要ありませんでした
[trafodion@sandbox ~]$ ifconfig
eth0 Link encap:Ethernet HWaddr 08:00:27:23:4E:D7
inet addr:10.0.2.15 Bcast:10.0.2.255 Mask:255.255.255.0
inet6 addr: fe80::a00:27ff:fe23:4ed7/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:40155 errors:0 dropped:0 overruns:0 frame:0
TX packets:21789 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:55944491 (53.3 MiB) TX bytes:1447785 (1.3 MiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:211169 errors:0 dropped:0 overruns:0 frame:0
TX packets:211169 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:406772380 (387.9 MiB) TX bytes:406772380 (387.9 MiB)
[trafodion@sandbox ~]$ more $MY_SQROOT/dcs*/conf/dcs-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
/**
*(C) Copyright 2013 Hewlett-Packard Development Company, L.P.
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/
-->
<!--
/**
* Copyright 2010 The Apache Software Foundation
*
* Licensed to the Apache Software Foundation (ASF) under one
* or more contributor license agreements. See the NOTICE file
* distributed with this work for additional information
* regarding copyright ownership. The ASF licenses this file
* to you under the Apache License, Version 2.0 (the
* "License"); you may not use this file except in compliance
* with the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/
-->
<configuration>
<property>
<name>dcs.zookeeper.quorum</name>
<value>sandbox</value>
</property>
<property>
<name>dcs.dns.interface</name>
<value>eth0</value>
</property>
</configuration>
[trafodion@sandbox ~]$
TEST1表は あらかじめ作成され2行データが入っていました
[trafodion@sandbox ~]$ cds
[trafodion@sandbox scripts]$ sqstart
Checking orphan processes.
Removing old mpijob* files from /home/trafodion/trafodion-1.1.0/tmp
Removing old monitor.port* files from /home/trafodion/trafodion-1.1.0/tmp
Executing sqipcrm (output to sqipcrm.out)
Starting the SQ Environment (Executing /home/trafodion/trafodion-1.1.0/sql/scripts/gomon.cold)
Background SQ Startup job (pid: 30223)
# of SQ processes: 15 .
SQ Startup script (/home/trafodion/trafodion-1.1.0/sql/scripts/gomon.cold) ran successfully. Performing further checks...
Checking if processes are up.
Checking attempt: 1; user specified max: 2. Execution time in seconds: 0.
The SQ environment is up!
Process Configured Actual Down
------- ---------- ------ ----
DTM 2 2
RMS 4 4
MXOSRVR 2 0 2
Fri May 29 21:54:55 PDT 2015
/home/trafodion/trafodion-1.1.0/dcs-1.1.0/bin/start-dcs.sh found.
Starting the DCS environment now
starting master, logging to /home/trafodion/trafodion-1.1.0/dcs-1.1.0/bin/../logs/dcs-trafodion-1-master-sandbox.out
sandbox: starting server, logging to /home/trafodion/trafodion-1.1.0/dcs-1.1.0/bin/../logs/dcs-trafodion-1-server-sandbox.out
Checking if processes are up.
Checking attempt: 1; user specified max: 2. Execution time in seconds: 1.
The SQ environment is up!
Process Configured Actual Down
------- ---------- ------ ----
DTM 2 2
RMS 4 4
MXOSRVR 2 0 2
Starting lob server processes
Successfully started $zlobsrv0
Successfully started $zlobsrv1
/home/trafodion/trafodion-1.1.0/rest-1.1.0/bin/start-rest.sh found.
Starting the REST environment now
starting rest, logging to /home/trafodion/trafodion-1.1.0/rest-1.1.0/bin/../logs/rest-trafodion-1-rest-sandbox.out
You can monitor the SQ shell log file : /home/trafodion/trafodion-1.1.0/logs/sqmon.log
Startup time 0 hour(s) 1 minute(s) 16 second(s)
[trafodion@sandbox scripts]$ sqcheck
Checking if processes are up.
Checking attempt: 1; user specified max: 2. Execution time in seconds: 0.
The SQ environment is up!
Process Configured Actual Down
------- ---------- ------ ----
DTM 2 2
RMS 4 4
MXOSRVR 2 2
[trafodion@sandbox scripts]$ cd ..
[trafodion@sandbox sql]$ cd ..
[trafodion@sandbox trafodion-1.1.0]$ sqlci
Trafodion Conversational Interface 1.1.0
(c) Copyright 2014 Hewlett-Packard Development Company, LP.
>>get version of software
+>;
System Version 1.1.0. Expected Version 1.1.0.
Software is current.
--- SQL operation complete.
>>get version of metadata;
Current Version 1.1.0. Expected Version 1.1.0.
Metadata is current.
--- SQL operation complete.
>>create table test1 (f1 int, f2 int);
*** ERROR[1390] Object TRAFODION.SEABASE.TEST1 already exists in Trafodion.
--- SQL operation failed with errors.
>>get tables;
Tables in Schema TRAFODION.SEABASE
==================================
TEST1
--- SQL operation complete.
>>select * from test1;
F1 F2
----------- -----------
1 1
2 2
--- 2 row(s) selected.
>>exit;
End of MXCI Session
[trafodion@sandbox trafodion-1.1.0]$
その他 今月の Trafodionトピック
4:10pm - 4:50pm
HBaseCon
Trafodion: Integrating Operational SQL into HBase
Trafodion, open sourced by HP, reflects 20+ years of investment in a full-fledged RDBMS built on Tandem's OLTP heritage and geared towards a wide set of mixed query workloads. In this talk, we will discuss how HP integrated Trafodion with HBase to take full advantage of the Trafodion database engine and the HBase storage engine, covering 3-tier architecture, storage, salting/partitioning, data movement, and more.
5pm - 5:40pm
HBaseCon
SQL-on-HBase Smackdown: Panel
Nothing is hotter than SQL-on-Hadoop, and now SQL-on-HBase is fast approaching equal hotness status. In this panel, a panel of developers deeply involved in this effort will discuss the work done so far across the ecosystem and the work still to be done.
I enjoyed chairing the SQL panel at #HBaseCon. Great audience, and thanks @ApacheDrill @ApachePhoenix @LeanXcale @trafodion @splicemachine
— Julian Hyde (@julianhyde) 2015, 5月 9Thursday, May 7, 2015, at the Westin St. Francisにて開催された HBaseCon 2015 Ecosystemトラックにて 2つ関連セッションがあったようです。録画やスライドが HBaseCon Archivesに載るのが待ち遠しいです。
Apache Trafodion (OLTP on HBase) enters incubation. Thanks to all the mentors and supporters @HBase @saintstack @cloudera @hortonworks Join!
— Hadoop RDBMS (@trafodion) 2015, 5月 26- [DISCUSS] Trafodion Incubation Proposal
- TrafodionProposal - Incubator Wiki
- [VOTE] Accept Trafodion into Apache Incubator
- Apache Trafodion Incubation Status - Apache Incubator
あらためて Apache Incubatorプロジェクトとして始動したようです。
@trafodion #bigdata #analytics Supercharge web scale operational data and real time reports with SQL RDBMS on Hadoop pic.twitter.com/ySsPx1RM9J
— Hadoop RDBMS (@trafodion) 2015, 3月 62015/06/28追記
HBaseCon 2015でのセッションの録画やスライドが公開されています。
HBaseCon 2015: Trafodion - Integrating Operational SQL into HBase from HBaseCon Published on Jun 05, 2015
HBaseCon 2015: Trafodion; Integrating Operational SQL into HBase from Cloudera on Vimeo. 2015年5月18日月曜日 16:47公開
Trafodion, open sourced by HP, reflects 20+ years of investment in a full-fledged RDBMS built on Tandem's OLTP heritage and geared towards a wide set of mixed query workloads. In this talk, we will discuss how HP integrated Trafodion with HBase to take full advantage of the Trafodion database engine and the HBase storage engine, covering 3-tier architecture, storage, salting/partitioning, data movement, and more.
Vimeo | We’ve got a thing for video.
via HBaseCon 2015 Presentations & Recordings
他にも このような資料が公開されてきています。
Trafodion Distributed Transaction Management from Rohit Jain Published on Jun 27, 2015
Trafodion brings a completely distributed scalable transaction management implementation integrated into HBase. It does not suffer from the scale and performance limitations of other transaction managers on HBase.
This presentation reviews the elegant architecture and how this architecture is leveraged to provide full ACID SQL transactional capabilities across multiple rows, tables, statements, and region servers. It discusses the life of a transaction from BEGIN WORK, to updates, to ABORT WORK, to COMMIT WORK, and then discusses recovery and high availability capabilities provided. An accompanying white paper goes into depth explaining this animated presentation in more detail.
Given the increasing interest for transaction managers on Hadoop, or to provide transactional capabilities for NoSQL users when needed, the Trafodion community can certainly open up this Distributed Transaction Management support to be leveraged by implementations other than Trafodion.
Trafodion Distributed Transaction Management
*1:Configuration - Trafodion open source software projectにはプロダクション・クラスタの推奨要件が記載されています。1ノードあたりのプロセッサはsmallで2コアなので、プロセッサは2でも動きはするようです。推奨は「8GBメモリあたり1コア」で16GBメモリ2コアから。
