I’ve run into problems trying to work through the GeoMesa GDELT Analysis tutorial at
http://geomesa.github.io/2014/04/17/geomesa-gdelt-analysis/ . I sent the following email to ‘geomesa-user@xxxxxxxxxxxxxxxx’
but it bounced with a non-existent user error. I don’t know if there are any GeoMesa communities of interest to whom I could send a description of my problem, so I’m directing my question to you in hopes that you could provide a (simple) solution, or direct
me to a person/site where I might find an answer.
I am running Accumulo 1.5.1, Hadoop 2.4.0 and Zookeeper 3.4.6.
I’ve been able to load the GDELT data file
http://data.gdeltproject.org/events/GDELT.MASTERREDUCEDV2.1979-2013.zip into Hadoop and am trying to ingest this data into Accumulo using the Hadoop command in the tutorial.
As shown in the execution trace below, the ingest process fails with the error:
java.lang.Exception: java.lang.RuntimeException: org.apache.accumulo.core.client.AccumuloSecurityException: Error BAD_AUTHORIZATIONS for user root - The user does not have the specified authorizations assigned
I don’t know to what “specified authorizations” this error might be referring. As shown below, the Accumulo “root” user has all possible System.* and Table.* permissions, including the ‘gdelt’ table:
$ accumulo shell –u root
root@ntc-irad> userpermissions -u root
System permissions: System.GRANT, System.CREATE_TABLE, System.DROP_TABLE, System.ALTER_TABLE, System.CREATE_USER, System.DROP_USER, System.ALTER_USER, System.SYSTEM
Table permissions (!METADATA): Table.READ, Table.ALTER_TABLE
Table permissions (gdelt): Table.READ, Table.WRITE, Table.BULK_IMPORT, Table.ALTER_TABLE, Table.GRANT, Table.DROP_TABLE
Table permissions (trace): Table.READ, Table.WRITE, Table.BULK_IMPORT, Table.ALTER_TABLE, Table.GRANT, Table.DROP_TABLE
I would be grateful for any assistance in getting the GDELT data ingesting into Accumulo so that I could complete my assessment of GeoMesa via the GDELT tutorial.
Best regards,
Bob Barnhart
Chief Systems Engineer | 858 826 5596 (Office) | 619 972 9489 (Mobile) |
barnhartr@xxxxxxxxxx
-----------------------------------------------------
Running: hadoop jar ./target/geomesa-gdelt-1.0-SNAPSHOT.jar
geomesa.gdelt.GDELTIngest
-instanceId ntc-irad
-zookeepers 127.0.0.1
-user root -password (r00t)
-auths Table.READ,Table.WRITE,Table.BULK_IMPORT,Table.ALTER_TABLE,Table.GRANT,Table.DROP_TABLE
-tableName gdelt -featureName event
-ingestFile hdfs:///gdelt/uncompressed/gdelt.tsv
-----------------------------------------------------
14/05/08 11:52:58 INFO HSQLDB45DD2E6EE0.ENGINE: dataFileCache open start
14/05/08 11:52:59 INFO HSQLDB45DD2E6EE0.ENGINE: Checkpoint start
14/05/08 11:52:59 INFO HSQLDB45DD2E6EE0.ENGINE: Checkpoint end
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:host.name=localhost
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_55
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.55.x86_64/jre
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/usr/local/hadoop-2.4.0/etc/hadoop:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/guava-11.0.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jsch-0.1.42.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/netty-3.6.2.Final.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-digester-1.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-el-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/stax-api-1.0-2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jersey-core-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/junit-4.8.2.jar:/usr/local/hadoop-2.4.0/share/had
oop/commo n/lib/jersey-server-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/xz-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/avro-1.7.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jettison-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jersey-json-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/xmlenc-0.52.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/zookeeper-3.4.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-io-2.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jetty-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/usr/lo
cal/hadoo p-2.4.0/share/hadoop/common/lib/httpclient-4.2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/log4j-1.2.17.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-collections-3.2.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-codec-1.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jsr305-1.3.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-net-3.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/asm-3.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-cli-1.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/hadoop-annotations-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/paranamer-2.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-lang-2.6.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop-2.4.0
/share/ha doop/common/lib/hadoop-auth-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jetty-util-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jsp-api-2.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/httpcore-4.2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jets3t-0.9.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/servlet-api-2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/usr/local/hadoop-2.4.0/share/hadoo
p/common/ hadoop-nfs-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/hadoop-common-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/hadoop-common-2.4.0-tests.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-io-2.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/log4
j-1.2.17. jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/asm-3.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/hadoop-hdfs-2.4.0-tests.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/hadoop-hdfs-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/g
uava-11.0 .2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/activation-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jackson-jaxrs-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/xz-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jettison-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib
/jersey-j son-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/zookeeper-3.4.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-io-2.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jackson-xc-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-collections-3.2.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-codec-1.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jsr305-1.3.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/guice-3.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/asm-3.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-cli-1.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jline-0.9.94.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-lan
g-2.6.jar :/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-httpclient-3.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-client-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/javax.inject-1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/servlet-api-2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-common-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-client-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.4.0.jar:/usr/local
/hadoop-2 .4.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-common-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-api-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/usr/local/hadoop-2.4.0/share/h
adoop/map reduce/lib/guice-servlet-3.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/usr/local/hadoop-2.4.0/share/h
adoop/map reduce/hadoop-mapreduce-client-jobclient-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.4.0-tests.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.4.0.jar:/usr/local/hadoop-2.4.0/contrib/capacity-scheduler/*.jar
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/usr/local/hadoop-2.4.0/lib/native
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-431.11.2.el6.x86_64
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:user.name=barnhartr
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/barnhartr
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client environment:user.dir=/usr/local/geomesa-gdelt-master
14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=127.0.0.1 sessionTimeout=30000
watcher=org.apache.accumulo.fate.zookeeper.ZooSession$ZooWatcher@1ec896d2
14/05/08 11:53:01 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
14/05/08 11:53:01 INFO zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
14/05/08 11:53:01 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x145dc8e7394000e, negotiated timeout = 30000
OpenJDK 64-Bit Server VM warning: You have loaded library /usr/local/hadoop-2.4.0/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
14/05/08 11:53:05 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/05/08 11:53:08 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
14/05/08 11:53:08 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
14/05/08 11:53:08 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
14/05/08 11:53:08 WARN mapreduce.JobSubmitter: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
14/05/08 11:53:08 INFO input.FileInputFormat: Total input paths to process : 1
14/05/08 11:53:08 INFO mapreduce.JobSubmitter: number of splits:49
14/05/08 11:53:09 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local422695915_0001
14/05/08 11:53:09 WARN conf.Configuration:
file:/hadoop/tmp/mapred/staging/barnhartr422695915/.staging/job_local422695915_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
14/05/08 11:53:09 WARN conf.Configuration:
file:/hadoop/tmp/mapred/staging/barnhartr422695915/.staging/job_local422695915_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
14/05/08 11:53:47 INFO mapred.LocalDistributedCacheManager: Creating symlink: /hadoop/tmp/mapred/local/1399575189575/geomesa-gdelt-1.0-SNAPSHOT.jar <- /usr/local/geomesa-gdelt-master/geomesa-gdelt-1.0-SNAPSHOT.jar
14/05/08 11:53:47 INFO mapred.LocalDistributedCacheManager: Localized hdfs://localhost:8020/tmp/geomesa-gdelt-1.0-SNAPSHOT.jar as
file:/hadoop/tmp/mapred/local/1399575189575/geomesa-gdelt-1.0-SNAPSHOT.jar
14/05/08 11:53:47 WARN conf.Configuration:
file:/hadoop/tmp/mapred/local/localRunner/barnhartr/job_local422695915_0001/job_local422695915_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
14/05/08 11:53:47 WARN conf.Configuration:
file:/hadoop/tmp/mapred/local/localRunner/barnhartr/job_local422695915_0001/job_local422695915_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
14/05/08 11:53:47 INFO mapred.LocalDistributedCacheManager:
file:/hadoop/tmp/mapred/local/1399575189575/geomesa-gdelt-1.0-SNAPSHOT.jar/
14/05/08 11:53:47 INFO mapreduce.Job: The url to track the job:
http://localhost:8080/
14/05/08 11:53:47 INFO mapreduce.Job: Running job: job_local422695915_0001
14/05/08 11:53:47 INFO mapred.LocalJobRunner: OutputCommitter set in config null
14/05/08 11:53:47 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
14/05/08 11:53:47 INFO mapred.LocalJobRunner: Waiting for map tasks
14/05/08 11:53:47 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000000_0
14/05/08 11:53:47 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:47 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:6442450944+138958463
14/05/08 11:53:47 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:48 INFO mapreduce.Job: Job job_local422695915_0001 running in uber mode : false
14/05/08 11:53:48 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:48 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:48 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:48 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:48 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:48 INFO mapreduce.Job: map 0% reduce 0%
14/05/08 11:53:49 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:49 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000001_0
14/05/08 11:53:49 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:49 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:0+134217728
14/05/08 11:53:49 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:49 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:49 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:49 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:49 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:49 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:49 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:49 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:49 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000002_0
14/05/08 11:53:49 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:49 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:134217728+134217728
14/05/08 11:53:49 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:49 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:49 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:49 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:49 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:49 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:49 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:49 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:49 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000003_0
14/05/08 11:53:49 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:49 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:268435456+134217728
14/05/08 11:53:49 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:49 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:49 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:49 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:49 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:49 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:49 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:49 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:49 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000004_0
14/05/08 11:53:49 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:49 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:402653184+134217728
14/05/08 11:53:49 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:49 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:49 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:49 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:49 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:49 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:49 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:49 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:49 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000005_0
14/05/08 11:53:49 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:49 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:536870912+134217728
14/05/08 11:53:49 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:49 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:49 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:49 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:49 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:49 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:49 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000006_0
14/05/08 11:53:50 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:50 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:671088640+134217728
14/05/08 11:53:50 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:50 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:50 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:50 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:50 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:50 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:50 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000007_0
14/05/08 11:53:50 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:50 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:805306368+134217728
14/05/08 11:53:50 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:50 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:50 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:50 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:50 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:50 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:50 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000008_0
14/05/08 11:53:50 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:50 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:939524096+134217728
14/05/08 11:53:50 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:50 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:50 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:50 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:50 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:50 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:50 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000009_0
14/05/08 11:53:50 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:50 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1073741824+134217728
14/05/08 11:53:50 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:50 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:50 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:50 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:50 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:50 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:50 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000010_0
14/05/08 11:53:50 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:50 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1207959552+134217728
14/05/08 11:53:50 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:50 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:50 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:50 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:50 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:50 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:50 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000011_0
14/05/08 11:53:50 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:50 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1342177280+134217728
14/05/08 11:53:50 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:50 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:50 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:50 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:50 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:50 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:50 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000012_0
14/05/08 11:53:50 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:50 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1476395008+134217728
14/05/08 11:53:50 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:51 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:51 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:51 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:51 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:51 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:51 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:51 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:51 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000013_0
14/05/08 11:53:51 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:51 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1610612736+134217728
14/05/08 11:53:51 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:51 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:51 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:51 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:51 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:51 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:51 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:51 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:51 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000014_0
14/05/08 11:53:51 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:51 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1744830464+134217728
14/05/08 11:53:51 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:51 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:51 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:51 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:51 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:51 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:51 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:51 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:51 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000015_0
14/05/08 11:53:51 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:51 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1879048192+134217728
14/05/08 11:53:51 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:51 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:51 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:51 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:51 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:51 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:51 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:51 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:51 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000016_0
14/05/08 11:53:51 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:51 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2013265920+134217728
14/05/08 11:53:51 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:51 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:51 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:51 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:51 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:51 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:51 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:51 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:51 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000017_0
14/05/08 11:53:51 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:51 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2147483648+134217728
14/05/08 11:53:51 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:51 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:51 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:51 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:51 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:51 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:51 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:51 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:51 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000018_0
14/05/08 11:53:51 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:51 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2281701376+134217728
14/05/08 11:53:51 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:52 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:52 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:52 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:52 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:52 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:52 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:52 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:52 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000019_0
14/05/08 11:53:52 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:52 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2415919104+134217728
14/05/08 11:53:52 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:52 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:52 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:52 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:52 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:52 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:52 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:52 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:52 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000020_0
14/05/08 11:53:52 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:52 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2550136832+134217728
14/05/08 11:53:52 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:52 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:52 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:52 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:52 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:52 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:52 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:52 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:52 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000021_0
14/05/08 11:53:52 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:52 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2684354560+134217728
14/05/08 11:53:52 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:52 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:52 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:52 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:52 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:52 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:52 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:52 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:52 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000022_0
14/05/08 11:53:52 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:52 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2818572288+134217728
14/05/08 11:53:52 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:52 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:52 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:52 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:52 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:52 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:52 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:52 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:52 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000023_0
14/05/08 11:53:52 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:52 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2952790016+134217728
14/05/08 11:53:52 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:52 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:52 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:52 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:52 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:52 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:52 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:52 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:52 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000024_0
14/05/08 11:53:52 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:52 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3087007744+134217728
14/05/08 11:53:52 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:53 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:53 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:53 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:53 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:53 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:53 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:53 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:53 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000025_0
14/05/08 11:53:53 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:53 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3221225472+134217728
14/05/08 11:53:53 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:53 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:53 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:53 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:53 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:53 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:53 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:53 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:53 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000026_0
14/05/08 11:53:53 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:53 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3355443200+134217728
14/05/08 11:53:53 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:53 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:53 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:53 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:53 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:53 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:53 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:53 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:53 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000027_0
14/05/08 11:53:53 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:53 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3489660928+134217728
14/05/08 11:53:53 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:53 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:53 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:53 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:53 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:53 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:53 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:53 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:53 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000028_0
14/05/08 11:53:53 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:53 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3623878656+134217728
14/05/08 11:53:53 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:53 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:53 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:53 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:53 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:53 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:53 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:53 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:53 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000029_0
14/05/08 11:53:53 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:53 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3758096384+134217728
14/05/08 11:53:53 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:53 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:53 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:53 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:53 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:53 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:53 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:53 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:53 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000030_0
14/05/08 11:53:53 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:53 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3892314112+134217728
14/05/08 11:53:53 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:54 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:54 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:54 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:54 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:54 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:54 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000031_0
14/05/08 11:53:54 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:54 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4026531840+134217728
14/05/08 11:53:54 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:54 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:54 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:54 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:54 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:54 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:54 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000032_0
14/05/08 11:53:54 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:54 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4160749568+134217728
14/05/08 11:53:54 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:54 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:54 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:54 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:54 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:54 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:54 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000033_0
14/05/08 11:53:54 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:54 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4294967296+134217728
14/05/08 11:53:54 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:54 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:54 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:54 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:54 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:54 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:54 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000034_0
14/05/08 11:53:54 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:54 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4429185024+134217728
14/05/08 11:53:54 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:54 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:54 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:54 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:54 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:54 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:54 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000035_0
14/05/08 11:53:54 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:54 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4563402752+134217728
14/05/08 11:53:54 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:54 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:54 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:54 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:54 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:54 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:54 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000036_0
14/05/08 11:53:54 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:54 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4697620480+134217728
14/05/08 11:53:54 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:54 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:54 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:55 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:55 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000037_0
14/05/08 11:53:55 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:55 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4831838208+134217728
14/05/08 11:53:55 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:55 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:55 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:55 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:55 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:55 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:55 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000038_0
14/05/08 11:53:55 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:55 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4966055936+134217728
14/05/08 11:53:55 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:55 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:55 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:55 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:55 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:55 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:55 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000039_0
14/05/08 11:53:55 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:55 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5100273664+134217728
14/05/08 11:53:55 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:55 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:55 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:55 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:55 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:55 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:55 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000040_0
14/05/08 11:53:55 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:55 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5234491392+134217728
14/05/08 11:53:55 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:55 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:55 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:55 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:55 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:55 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:55 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000041_0
14/05/08 11:53:55 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:55 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5368709120+134217728
14/05/08 11:53:55 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:55 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:55 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:55 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:55 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:55 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:55 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000042_0
14/05/08 11:53:55 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:55 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5502926848+134217728
14/05/08 11:53:55 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:55 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:55 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:55 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:55 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:56 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:56 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000043_0
14/05/08 11:53:56 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:56 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5637144576+134217728
14/05/08 11:53:56 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:56 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:56 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:56 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:56 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:56 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:56 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:56 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:56 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000044_0
14/05/08 11:53:56 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:56 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5771362304+134217728
14/05/08 11:53:56 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:56 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:56 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:56 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:56 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:56 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:56 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:56 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:56 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000045_0
14/05/08 11:53:56 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:56 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5905580032+134217728
14/05/08 11:53:56 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:56 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:56 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:56 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:56 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:56 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:56 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:56 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:56 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000046_0
14/05/08 11:53:56 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:56 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:6039797760+134217728
14/05/08 11:53:56 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:56 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:56 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:56 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:56 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:56 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:56 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:56 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:56 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000047_0
14/05/08 11:53:56 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:56 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:6174015488+134217728
14/05/08 11:53:56 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:56 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:56 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:56 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:56 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:56 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:56 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:56 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:56 INFO mapred.LocalJobRunner: Starting task: attempt_local422695915_0001_m_000048_0
14/05/08 11:53:56 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ]
14/05/08 11:53:56 INFO mapred.MapTask: Processing split: hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:6308233216+134217728
14/05/08 11:53:56 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/05/08 11:53:57 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:57 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/05/08 11:53:57 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/05/08 11:53:57 INFO mapred.MapTask: soft limit at 83886080
14/05/08 11:53:57 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/05/08 11:53:57 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/05/08 11:53:57 INFO mapred.MapTask: Starting flush of map output
14/05/08 11:53:57 INFO mapred.LocalJobRunner: map task executor complete.
14/05/08 11:53:57 WARN mapred.LocalJobRunner: job_local422695915_0001
java.lang.Exception: java.lang.RuntimeException: org.apache.accumulo.core.client.AccumuloSecurityException: Error BAD_AUTHORIZATIONS for user root - The user does not have the specified authorizations assigned
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.RuntimeException: org.apache.accumulo.core.client.AccumuloSecurityException: Error BAD_AUTHORIZATIONS for user root - The user does not have the specified authorizations assigned
at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.hasNext(TabletServerBatchReaderIterator.java:210)
at geomesa.core.data.AccumuloDataStore$$anonfun$readMetadataItem$1.apply(AccumuloDataStore.scala:169)
at geomesa.core.data.AccumuloDataStore$$anonfun$readMetadataItem$1.apply(AccumuloDataStore.scala:157)
at scala.collection.MapLike$class.getOrElse(MapLike.scala:128)
at scala.collection.AbstractMap.getOrElse(Map.scala:58)
at geomesa.core.data.AccumuloDataStore.readMetadataItem(AccumuloDataStore.scala:157)
at geomesa.core.data.AccumuloDataStore.getAttributes(AccumuloDataStore.scala:220)
at geomesa.core.data.AccumuloDataStore.getSchema(AccumuloDataStore.scala:267)
at geomesa.gdelt.GDELTIngestMapper.setup(GDELTIngestMapper.java:53)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.accumulo.core.client.AccumuloSecurityException: Error BAD_AUTHORIZATIONS for user root - The user does not have the specified authorizations assigned
at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.doLookup(TabletServerBatchReaderIterator.java:701)
at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator$QueryTask.run(TabletServerBatchReaderIterator.java:361)
at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
... 1 more
Caused by: ThriftSecurityException(user:root, code:BAD_AUTHORIZATIONS)
at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$startMultiScan_result$startMultiScan_resultStandardScheme.read(TabletClientService.java:8165)
at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$startMultiScan_result$startMultiScan_resultStandardScheme.read(TabletClientService.java:8142)
at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$startMultiScan_result.read(TabletClientService.java:8081)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Client.recv_startMultiScan(TabletClientService.java:294)
at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Client.startMultiScan(TabletClientService.java:274)
at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.doLookup(TabletServerBatchReaderIterator.java:644)
... 7 more
14/05/08 11:53:57 WARN impl.TabletServerBatchReader: TabletServerBatchReader not shutdown; did you forget to call close()?
14/05/08 11:53:58 INFO mapreduce.Job: Job job_local422695915_0001 failed with state FAILED due to: NA
14/05/08 11:53:58 INFO mapreduce.Job: Counters: 0
Exception in thread "main" java.lang.Exception: Job failed
at geomesa.gdelt.GDELTIngest.runMapReduceJob(GDELTIngest.java:152)
at geomesa.gdelt.GDELTIngest.main(GDELTIngest.java:110)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
