Re: [geomesa-dev] Problems running GeoMesa GDELT tutorial

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [geomesa-dev] Problems running GeoMesa GDELT tutorial
From: Chris Eichelberger <cne1x@xxxxxxxx>
Date: Fri, 09 May 2014 10:33:03 -0400
Delivered-to: geomesa-dev@xxxxxxxxxxxxxxxx
List-archive: <https://locationtech.org/mhonarc/lists/geomesa-dev>
List-help: <mailto:geomesa-dev-request@locationtech.org?subject=help>
List-subscribe: <http://locationtech.org/mailman/listinfo/geomesa-dev>, <mailto:geomesa-dev-request@locationtech.org?subject=subscribe>
List-unsubscribe: <http://locationtech.org/mailman/options/geomesa-dev>, <mailto:geomesa-dev-request@locationtech.org?subject=unsubscribe>
Organization: Commonwealth Computer Research, Inc.
Bob,

I've checked the Mapper, and it does appear that it's trying to access
the fields without first checking that the line is split into the
requisite number of parts.

You and Chris seem to be on the right track:  There is probably
something wrong with the input data.  I'm going to add a new ticket here
for us to add the "are there enough fields?" check to the mapper so that
it does not throw an exception in this case.

We will post back to this list when the project is updated.

Thanks for writing in.  Please let us know -- either here or on
geomesa-users@xxxxxxxxxxxxxxxx -- if/as you encounter additional issues.

Sincerely,
  -- Chris

_______________

Chris Eichelberger
Commonwealth Computer Research, Inc.
434-284-9422 (work)






On Thu, 2014-05-08 at 22:20 +0000, Chris Snider wrote:
> Bob,
> 
>  
> 
> I haven’t run the gdelt dataset myself yet.  That is something I plan
> on doing tomorrow or early next week as I learn more about Hadoop.
> However, when I see errors like that, it is usually my data that I
> have messed up somehow.  I agree that it would be a good thing to try
> a smaller dataset and see if the job completes.
> 
>  
> 
> I’ll post back to the list if I am successful or run into the
> same/other issues.
> 
>  
> 
> Chris Snider
> 
> Senior Software Engineer
> 
> Intelligent Software Solutions, Inc.
> 
> Direct (719) 452-7257
> 
> Description: Description: Description:
> cid:image001.png@01CA1F1F.CBC93990
> 
> 
>  
> 
> From: Barnhart, Bob M. [mailto:ROBERT.M.BARNHART@xxxxxxxxxx] 
> Sent: Thursday, May 08, 2014 3:26 PM
> To: Chris Snider; Discussions between GeoMesa committers
> Subject: RE: [geomesa-dev] Problems running GeoMesa GDELT tutorial
> 
> 
>  
> 
> Chris,
> 
>  
> 
> Thanks for the fix…it worked fine using an ad-hoc authorization
> (“GDELT” vs. “COMMA”).
> 
>  
> 
> I don’t know whether I can collaborate with you directly (as opposed
> to mailing to geomesa-dev@xxxxxxxxxxxxxxxx) but I thought I’d see if
> you were willing to take a look at another issue.
> 
>  
> 
> Still trying to ingest the data loaded into Hadoop
> fromhttp://data.gdeltproject.org/events/GDELT.MASTERREDUCEDV2.1979-2013.zip, I’m now getting an “ArrayIndexOutOfBoundsException” error (see below).
> 
>  
> 
> I’m not sure if (1) the data might be at issue, or (2) my
> Accumulo/Hadoop installation might be at issue. I’m tempted to try
> loading a smaller dataset, perhaps only (some of) the 2014 files from
> http://data.gdeltproject.org/events/index.html.
> 
>  
> 
> Any ideas what might be going on here?
> 
>  
> 
> Thanks,
> 
> Bob Barnhart
> 
>  
> 
> (ingest log…)
> 
>  
> 
> -----------------------------------------------------
> 
> Running: hadoop jar ./target/geomesa-gdelt-1.0-SNAPSHOT.jar
>                  geomesa.gdelt.GDELTIngest
>                 -instanceId ntc-irad
>    -zookeepers localhost:2181                         -user root
> -password (r00t)                         -auths GDELT
>                    -tableName gdelt -featureName event
>    -ingestFile hdfs:///gdelt/uncompressed/gdelt.tsv
> 
> -----------------------------------------------------
> 
> 14/05/08 13:39:09 INFO HSQLDB45DD8FA39A.ENGINE: dataFileCache open
> start
> 
> 14/05/08 13:39:09 INFO HSQLDB45DD8FA39A.ENGINE: Checkpoint start
> 
> 14/05/08 13:39:09 INFO HSQLDB45DD8FA39A.ENGINE: Checkpoint end
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52
> GMT
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:host.name=localhost
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:java.version=1.7.0_55
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:java.vendor=Oracle Corporation
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.55.x86_64/jre
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:java.class.path=/usr/local/hadoop-2.4.0/etc/hadoop:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/guava-11.0.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jsch-0.1.42.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/netty-3.6.2.Final.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-digester-1.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-el-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/stax-api-1.0-2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jersey-core-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/junit-4.8.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jersey-server-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/xz-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/avro-1.7.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jettison-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jersey-json-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/xmlenc-0.52.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/zookeeper-3.4.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-io-2.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jetty-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/httpclient-4.2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/log4j-1.2.17.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-collections-3.2.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-codec-1.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jsr305-1.3.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-net-3.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/asm-3.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-cli-1.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/hadoop-annotations-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/paranamer-2.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-lang-2.6.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/hadoop-auth-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jetty-util-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jsp-api-2.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/httpcore-4.2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jets3t-0.9.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/servlet-api-2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/hadoop-nfs-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/hadoop-common-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/hadoop-common-2.4.0-tests.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-io-2.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/asm-3.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/hadoop-hdfs-2.4.0-tests.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/hadoop-hdfs-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/guava-11.0.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/activation-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jackson-jaxrs-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/xz-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jettison-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-json-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/zookeeper-3.4.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-io-2.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jackson-xc-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-collections-3.2.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-codec-1.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jsr305-1.3.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/guice-3.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/asm-3.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-cli-1.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jline-0.9.94.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-lang-2.6.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-httpclient-3.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-client-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/javax.inject-1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/servlet-api-2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-common-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-client-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-common-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-api-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.4.0-tests.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.4.0.jar:/usr/local/hadoop-2.4.0/contrib/capacity-scheduler/*.jar
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:java.library.path=/usr/local/hadoop-2.4.0/lib/native
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:java.io.tmpdir=/tmp
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:java.compiler=<NA>
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:os.name=Linux
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:os.arch=amd64
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:os.version=2.6.32-431.11.2.el6.x86_64
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:user.name=barnhartr
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:user.home=/home/barnhartr
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Client
> environment:user.dir=/usr/local/geomesa-gdelt-master
> 
> 14/05/08 13:39:11 INFO zookeeper.ZooKeeper: Initiating client
> connection, connectString=localhost:2181 sessionTimeout=30000
> watcher=org.apache.accumulo.fate.zookeeper.ZooSession
> $ZooWatcher@325c4c8
> 
> 14/05/08 13:39:11 INFO zookeeper.ClientCnxn: Opening socket connection
> to server localhost/127.0.0.1:2181. Will not attempt to authenticate
> using SASL (unknown error)
> 
> 14/05/08 13:39:11 INFO zookeeper.ClientCnxn: Socket connection
> established to localhost/127.0.0.1:2181, initiating session
> 
> 14/05/08 13:39:11 INFO zookeeper.ClientCnxn: Session establishment
> complete on server localhost/127.0.0.1:2181, sessionid =
> 0x145dd8bc67d0007, negotiated timeout = 30000
> 
> OpenJDK 64-Bit Server VM warning: You have loaded
> library /usr/local/hadoop-2.4.0/lib/native/libhadoop.so.1.0.0 which
> might have disabled stack guard. The VM will try to fix the stack
> guard now.
> 
> It's highly recommended that you fix the library with 'execstack -c
> <libfile>', or link it with '-z noexecstack'.
> 
> 14/05/08 13:39:15 WARN util.NativeCodeLoader: Unable to load
> native-hadoop library for your platform... using builtin-java classes
> where applicable
> 
> 14/05/08 13:39:18 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 
> 14/05/08 13:39:18 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> 
> 14/05/08 13:39:19 WARN mapreduce.JobSubmitter: Hadoop command-line
> option parsing not performed. Implement the Tool interface and execute
> your application with ToolRunner to remedy this.
> 
> 14/05/08 13:39:19 WARN mapreduce.JobSubmitter: No job jar file set.
> User classes may not be found. See Job or Job#setJar(String).
> 
> 14/05/08 13:39:19 INFO input.FileInputFormat: Total input paths to
> process : 1
> 
> 14/05/08 13:39:19 INFO mapreduce.JobSubmitter: number of splits:49
> 
> 14/05/08 13:39:19 INFO mapreduce.JobSubmitter: Submitting tokens for
> job: job_local1091701005_0001
> 
> 14/05/08 13:39:19 WARN conf.Configuration:
> file:/hadoop/tmp/mapred/staging/barnhartr1091701005/.staging/job_local1091701005_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
> 
> 14/05/08 13:39:19 WARN conf.Configuration:
> file:/hadoop/tmp/mapred/staging/barnhartr1091701005/.staging/job_local1091701005_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
> 
> 14/05/08 13:39:58 INFO mapred.LocalDistributedCacheManager: Creating
> symlink: /hadoop/tmp/mapred/local/1399581560010/geomesa-gdelt-1.0-SNAPSHOT.jar <- /usr/local/geomesa-gdelt-master/geomesa-gdelt-1.0-SNAPSHOT.jar
> 
> 14/05/08 13:39:58 INFO mapred.LocalDistributedCacheManager: Localized
> hdfs://localhost:8020/tmp/geomesa-gdelt-1.0-SNAPSHOT.jar as
> file:/hadoop/tmp/mapred/local/1399581560010/geomesa-gdelt-1.0-SNAPSHOT.jar
> 
> 14/05/08 13:39:58 WARN conf.Configuration:
> file:/hadoop/tmp/mapred/local/localRunner/barnhartr/job_local1091701005_0001/job_local1091701005_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
> 
> 14/05/08 13:39:58 WARN conf.Configuration:
> file:/hadoop/tmp/mapred/local/localRunner/barnhartr/job_local1091701005_0001/job_local1091701005_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
> 
> 14/05/08 13:39:58 INFO mapred.LocalDistributedCacheManager:
> file:/hadoop/tmp/mapred/local/1399581560010/geomesa-gdelt-1.0-SNAPSHOT.jar/
> 
> 14/05/08 13:39:58 INFO mapreduce.Job: The url to track the job:
> http://localhost:8080/
> 
> 14/05/08 13:39:58 INFO mapreduce.Job: Running job:
> job_local1091701005_0001
> 
> 14/05/08 13:39:58 INFO mapred.LocalJobRunner: OutputCommitter set in
> config null
> 
> 14/05/08 13:39:58 INFO mapred.LocalJobRunner: OutputCommitter is
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
> 
> 14/05/08 13:39:59 INFO mapred.LocalJobRunner: Waiting for map tasks
> 
> 14/05/08 13:39:59 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000000_0
> 
> 14/05/08 13:39:59 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:39:59 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:6442450944
> +138958463
> 
> 14/05/08 13:39:59 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:39:59 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:39:59 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:39:59 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:39:59 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:39:59 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:39:59 INFO mapreduce.Job: Job job_local1091701005_0001
> running in uber mode : false
> 
> 14/05/08 13:39:59 INFO mapreduce.Job:  map 0% reduce 0%
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:01 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000001_0
> 
> 14/05/08 13:40:01 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:0+134217728
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:01 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000002_0
> 
> 14/05/08 13:40:01 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:134217728+134217728
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:01 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:02 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000003_0
> 
> 14/05/08 13:40:02 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:268435456+134217728
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:02 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000004_0
> 
> 14/05/08 13:40:02 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:402653184+134217728
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:02 WARN impl.ThriftTransportPool: Server
> 127.0.0.1:9997:9997 (120000) had 20 failures in a short time period,
> will not complain anymore 
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:02 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000005_0
> 
> 14/05/08 13:40:02 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:536870912+134217728
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:02 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:03 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000006_0
> 
> 14/05/08 13:40:03 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:671088640+134217728
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:03 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000007_0
> 
> 14/05/08 13:40:03 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:805306368+134217728
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:03 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000008_0
> 
> 14/05/08 13:40:03 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:939524096+134217728
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:03 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000009_0
> 
> 14/05/08 13:40:03 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1073741824
> +134217728
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:03 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:04 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000010_0
> 
> 14/05/08 13:40:04 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1207959552
> +134217728
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:04 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000011_0
> 
> 14/05/08 13:40:04 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1342177280
> +134217728
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:04 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000012_0
> 
> 14/05/08 13:40:04 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1476395008
> +134217728
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:04 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000013_0
> 
> 14/05/08 13:40:04 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1610612736
> +134217728
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:04 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:05 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000014_0
> 
> 14/05/08 13:40:05 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1744830464
> +134217728
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:05 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:05 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000015_0
> 
> 14/05/08 13:40:05 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1879048192
> +134217728
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:05 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000016_0
> 
> 14/05/08 13:40:05 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2013265920
> +134217728
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:05 INFO mapreduce.Job:  map 2% reduce 0%
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:05 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000017_0
> 
> 14/05/08 13:40:05 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2147483648
> +134217728
> 
> 14/05/08 13:40:05 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:06 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000018_0
> 
> 14/05/08 13:40:06 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2281701376
> +134217728
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:06 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000019_0
> 
> 14/05/08 13:40:06 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2415919104
> +134217728
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:06 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000020_0
> 
> 14/05/08 13:40:06 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2550136832
> +134217728
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:06 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000021_0
> 
> 14/05/08 13:40:06 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2684354560
> +134217728
> 
> 14/05/08 13:40:06 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:07 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:07 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000022_0
> 
> 14/05/08 13:40:07 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2818572288
> +134217728
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:07 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000023_0
> 
> 14/05/08 13:40:07 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2952790016
> +134217728
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:07 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000024_0
> 
> 14/05/08 13:40:07 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3087007744
> +134217728
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:07 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:07 INFO mapreduce.Job:  map 6% reduce 0%
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:07 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000025_0
> 
> 14/05/08 13:40:07 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3221225472
> +134217728
> 
> 14/05/08 13:40:07 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:08 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:08 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000026_0
> 
> 14/05/08 13:40:08 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3355443200
> +134217728
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:08 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:08 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000027_0
> 
> 14/05/08 13:40:08 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3489660928
> +134217728
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:08 INFO mapreduce.Job:  map 10% reduce 0%
> 
> 14/05/08 13:40:08 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:08 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:09 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000028_0
> 
> 14/05/08 13:40:09 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3623878656
> +134217728
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:09 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:09 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:09 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000029_0
> 
> 14/05/08 13:40:09 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3758096384
> +134217728
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:09 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:09 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000030_0
> 
> 14/05/08 13:40:09 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3892314112
> +134217728
> 
> 14/05/08 13:40:09 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:09 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:09 INFO mapreduce.Job:  map 20% reduce 0%
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:10 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:10 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000031_0
> 
> 14/05/08 13:40:10 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4026531840
> +134217728
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:10 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:10 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000032_0
> 
> 14/05/08 13:40:10 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4160749568
> +134217728
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:10 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:10 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000033_0
> 
> 14/05/08 13:40:10 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4294967296
> +134217728
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:10 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:10 INFO mapreduce.Job:  map 29% reduce 0%
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:10 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:11 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000034_0
> 
> 14/05/08 13:40:11 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4429185024
> +134217728
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:11 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:11 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:11 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000035_0
> 
> 14/05/08 13:40:11 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4563402752
> +134217728
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:11 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:11 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000036_0
> 
> 14/05/08 13:40:11 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4697620480
> +134217728
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:11 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000037_0
> 
> 14/05/08 13:40:11 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4831838208
> +134217728
> 
> 14/05/08 13:40:11 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:12 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:12 INFO mapreduce.Job:  map 37% reduce 0%
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:12 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000038_0
> 
> 14/05/08 13:40:12 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4966055936
> +134217728
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:12 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:12 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000039_0
> 
> 14/05/08 13:40:12 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5100273664
> +134217728
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:12 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:12 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000040_0
> 
> 14/05/08 13:40:12 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5234491392
> +134217728
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:12 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:12 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000041_0
> 
> 14/05/08 13:40:12 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5368709120
> +134217728
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:12 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:13 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000042_0
> 
> 14/05/08 13:40:13 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5502926848
> +134217728
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:13 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:13 INFO mapreduce.Job:  map 45% reduce 0%
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:13 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000043_0
> 
> 14/05/08 13:40:13 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5637144576
> +134217728
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:13 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:13 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000044_0
> 
> 14/05/08 13:40:13 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5771362304
> +134217728
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:13 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:13 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000045_0
> 
> 14/05/08 13:40:13 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5905580032
> +134217728
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:13 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:13 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000046_0
> 
> 14/05/08 13:40:13 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:6039797760
> +134217728
> 
> 14/05/08 13:40:13 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:14 INFO mapreduce.Job:  map 51% reduce 0%
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:14 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000047_0
> 
> 14/05/08 13:40:14 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:6174015488
> +134217728
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:14 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:14 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:14 INFO mapred.LocalJobRunner: Starting task:
> attempt_local1091701005_0001_m_000048_0
> 
> 14/05/08 13:40:14 INFO mapred.Task:  Using
> ResourceCalculatorProcessTree : [ ]
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: Processing split:
> hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:6308233216
> +134217728
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: Map output collector class =
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: (EQUATOR) 0 kvi
> 26214396(104857584)
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: soft limit at 83886080
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: bufstart = 0; bufvoid =
> 104857600
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: kvstart = 26214396; length =
> 6553600
> 
> 14/05/08 13:40:14 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:14 INFO mapred.MapTask: Starting flush of map output
> 
> 14/05/08 13:40:14 INFO mapred.LocalJobRunner: map task executor
> complete.
> 
> 14/05/08 13:40:14 WARN mapred.LocalJobRunner: job_local1091701005_0001
> 
> java.lang.Exception: java.lang.ArrayIndexOutOfBoundsException: 39
> 
>                 at org.apache.hadoop.mapred.LocalJobRunner
> $Job.runTasks(LocalJobRunner.java:462)
> 
>                 at org.apache.hadoop.mapred.LocalJobRunner
> $Job.run(LocalJobRunner.java:522)
> 
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 39
> 
>                 at
> geomesa.gdelt.GDELTIngestMapper.map(GDELTIngestMapper.java:60)
> 
>                 at
> geomesa.gdelt.GDELTIngestMapper.map(GDELTIngestMapper.java:27)
> 
>                 at
> org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
> 
>                 at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> 
>                 at
> org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
> 
>                 at org.apache.hadoop.mapred.LocalJobRunner$Job
> $MapTaskRunnable.run(LocalJobRunner.java:243)
> 
>                 at java.util.concurrent.Executors
> $RunnableAdapter.call(Executors.java:471)
> 
>                 at
> java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 
>                 at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 
>                 at java.util.concurrent.ThreadPoolExecutor
> $Worker.run(ThreadPoolExecutor.java:615)
> 
>                 at java.lang.Thread.run(Thread.java:744)
> 
> 14/05/08 13:40:15 INFO mapreduce.Job:  map 57% reduce 0%
> 
> 14/05/08 13:40:15 INFO mapreduce.Job: Job job_local1091701005_0001
> failed with state FAILED due to: NA
> 
> 14/05/08 13:40:15 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:15 INFO mapreduce.Job: Counters: 25
> 
>                 File System Counters
> 
>                                 FILE: Number of bytes read=1100796112
> 
>                                 FILE: Number of bytes
> written=1112405102
> 
>                                 FILE: Number of read operations=0
> 
>                                 FILE: Number of large read
> operations=0
> 
>                                 FILE: Number of write operations=0
> 
>                                 HDFS: Number of bytes read=1101293020
> 
>                                 HDFS: Number of bytes
> written=1097385436
> 
>                                 HDFS: Number of read operations=1465
> 
>                                 HDFS: Number of large read
> operations=0
> 
>                                 HDFS: Number of write operations=112
> 
>                 Map-Reduce Framework
> 
>                                 Map input records=28
> 
>                                 Map output records=0
> 
>                                 Map output bytes=0
> 
>                                 Map output materialized bytes=168
> 
>                                 Input split bytes=3220
> 
>                                 Combine input records=0
> 
>                                 Spilled Records=0
> 
>                                 Failed Shuffles=0
> 
>                                 Merged Map outputs=0
> 
>                                 GC time elapsed (ms)=70902
> 
>                                 CPU time spent (ms)=0
> 
>                                 Physical memory (bytes) snapshot=0
> 
>                                 Virtual memory (bytes) snapshot=0
> 
>                                 Total committed heap usage
> (bytes)=6046191616
> 
>                 File Input Format Counters 
> 
>                                 Bytes Read=114688
> 
> Exception in thread "main" java.lang.Exception: Job failed
> 
>                 at
> geomesa.gdelt.GDELTIngest.runMapReduceJob(GDELTIngest.java:152)
> 
>                 at
> geomesa.gdelt.GDELTIngest.main(GDELTIngest.java:110)
> 
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> 
>                 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 
>                 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 
>                 at java.lang.reflect.Method.invoke(Method.java:606)
> 
>                 at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> 
> 14/05/08 13:40:15 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:15 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:16 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:16 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:16 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:17 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:17 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:17 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:18 INFO mapred.LocalJobRunner: map > sort
> 
> 14/05/08 13:40:18 INFO mapred.LocalJobRunner: map > sort
> 
>  
> 
> From: Chris Snider [mailto:chris.snider@xxxxxxxxxx] 
> Sent: Thursday, May 08, 2014 1:01 PM
> To: Discussions between GeoMesa committers; Barnhart, Bob M.
> Subject: RE: [geomesa-dev] Problems running GeoMesa GDELT tutorial
> 
> 
>  
> 
> Bob,
> 
>  
> 
> I think there may be a misunderstanding between the DB permissions and
> the user authorizations inherent in the Accumulo Schema.
> 
>  
> 
> In an accumulo shell, run a 
> 
> getauths –u root
> 
>  
> 
> This is the Authorizations that the connector is expecting.  
> 
>  
> 
> You can set authorizations for the root user with the following
> accumulo shell
> 
> setauths –s “MY,COMMA,DELIMITED,AUTHS” –u root
> 
>  
> 
> Use the new auths in the connection block for-auths COMMA (for
> example)
> 
>  
> 
> Chris Snider
> 
> Senior Software Engineer
> 
> Intelligent Software Solutions, Inc.
> 
> Description: Description: Description:
> cid:image001.png@01CA1F1F.CBC93990
> 
> 
>  
> 
> From:geomesa-dev-bounces@xxxxxxxxxxxxxxxx
> [mailto:geomesa-dev-bounces@xxxxxxxxxxxxxxxx] On Behalf Of Andrew Ross
> Sent: Thursday, May 08, 2014 1:47 PM
> To: Barnhart, Bob M.; geomesa-dev@xxxxxxxxxxxxxxxx
> Subject: Re: [geomesa-dev] Problems running GeoMesa GDELT tutorial
> 
> 
>  
> 
> Hi Bob,
> 
> Thank you so much for your interest in Geomesa.
> 
> I'll check into what's up with geomesa-user. In the meantime, I've
> added geomesa-dev, which has the developer team on it.
> 
> Cheers!
> 
> Andrew
> 
> On 08/05/14 21:39, Barnhart, Bob M. wrote:
> 
> 
>         I’ve run into problems trying to work through the GeoMesa
>         GDELT Analysis tutorial at
>         http://geomesa.github.io/2014/04/17/geomesa-gdelt-analysis/ .
>         I sent the following email to ‘geomesa-user@xxxxxxxxxxxxxxxx’
>         but it bounced with a non-existent user error. I don’t know if
>         there are any GeoMesa communities of interest to whom I could
>         send a description of my problem, so I’m directing my question
>         to you in hopes that you could provide a (simple) solution, or
>         direct me to a person/site where I might find an answer.
>         
>          
>         
>         I am running Accumulo 1.5.1, Hadoop 2.4.0 and Zookeeper 3.4.6.
>         
>          
>         
>         I’ve been able to load the GDELT data file
>         http://data.gdeltproject.org/events/GDELT.MASTERREDUCEDV2.1979-2013.zip into Hadoop and am trying to ingest this data into Accumulo using the Hadoop command in the tutorial.
>         
>          
>         
>         As shown in the execution trace below, the ingest process
>         fails with the error:
>         
>          
>         
>         java.lang.Exception: java.lang.RuntimeException:
>         org.apache.accumulo.core.client.AccumuloSecurityException:
>         Error BAD_AUTHORIZATIONS for user root - The user does not
>         have the specified authorizations assigned
>         
>          
>         
>         I don’t know to what “specified authorizations” this error
>         might be referring. As shown below, the Accumulo “root” user
>         has all possible System.* and Table.* permissions, including
>         the ‘gdelt’ table:
>         
>          
>         
>         $ accumulo shell –u root
>         
>         root@ntc-irad> userpermissions -u root
>         
>         System permissions: System.GRANT, System.CREATE_TABLE,
>         System.DROP_TABLE, System.ALTER_TABLE, System.CREATE_USER,
>         System.DROP_USER, System.ALTER_USER, System.SYSTEM
>         
>          
>         
>         Table permissions (!METADATA): Table.READ, Table.ALTER_TABLE
>         
>         Table permissions (gdelt): Table.READ, Table.WRITE,
>         Table.BULK_IMPORT, Table.ALTER_TABLE, Table.GRANT,
>         Table.DROP_TABLE
>         
>         Table permissions (trace): Table.READ, Table.WRITE,
>         Table.BULK_IMPORT, Table.ALTER_TABLE, Table.GRANT,
>         Table.DROP_TABLE
>         
>          
>         
>         I would be grateful for any assistance in getting the GDELT
>         data ingesting into Accumulo so that I could complete my
>         assessment of GeoMesa via the GDELT tutorial.
>         
>          
>         
>         Best regards,
>         
>         Bob Barnhart
>         
>         Chief Systems Engineer | 858 826 5596 (Office) | 619 972 9489
>         (Mobile) | barnhartr@xxxxxxxxxx 
>         
>          
>         
>         -----------------------------------------------------
>         
>         Running:   hadoop jar ./target/geomesa-gdelt-1.0-SNAPSHOT.jar
>                        
>         
>         geomesa.gdelt.GDELTIngest
>                            
>         
>         -instanceId ntc-irad                            
>         
>         -zookeepers 127.0.0.1                      
>         
>         -user root -password (r00t)           
>         
>          -auths
>         Table.READ,Table.WRITE,Table.BULK_IMPORT,Table.ALTER_TABLE,Table.GRANT,Table.DROP_TABLE       
>         
>          -tableName gdelt -featureName event                  
>         
>          -ingestFile hdfs:///gdelt/uncompressed/gdelt.tsv
>         
>         -----------------------------------------------------
>         
>         14/05/08 11:52:58 INFO HSQLDB45DD2E6EE0.ENGINE: dataFileCache
>         open start
>         
>         14/05/08 11:52:59 INFO HSQLDB45DD2E6EE0.ENGINE: Checkpoint
>         start
>         
>         14/05/08 11:52:59 INFO HSQLDB45DD2E6EE0.ENGINE: Checkpoint end
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:zookeeper.version=3.4.5-1392090, built on
>         09/30/2012 17:52 GMT
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:host.name=localhost
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:java.version=1.7.0_55
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:java.vendor=Oracle Corporation
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.55.x86_64/jre
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:java.class.path=/usr/local/hadoop-2.4.0/etc/hadoop:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/guava-11.0.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jsch-0.1.42.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/netty-3.6.2.Final.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-digester-1.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-el-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/stax-api-1.0-2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jersey-core-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/junit-4.8.2.jar:/usr/local/hadoop-2.4.0/share/had oop/commo n/lib/jersey-server-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/xz-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/avro-1.7.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jettison-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jersey-json-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/xmlenc-0.52.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/zookeeper-3.4.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-io-2.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jetty-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/usr/lo cal/hadoo p-2.4.0/share/hadoop/common/lib/httpclient-4.2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/log4j-1.2.17.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-collections-3.2.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-codec-1.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jsr305-1.3.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-net-3.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/asm-3.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-cli-1.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/hadoop-annotations-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/paranamer-2.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-lang-2.6.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop-2.4.0 /share/ha doop/common/lib/hadoop-auth-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jetty-util-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jsp-api-2.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/httpcore-4.2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/jets3t-0.9.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/servlet-api-2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/usr/local/hadoop-2.4.0/share/hadoo p/common/ hadoop-nfs-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/hadoop-common-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/common/hadoop-common-2.4.0-tests.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-io-2.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/log4 j-1.2.17. jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/asm-3.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/hadoop-hdfs-2.4.0-tests.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/hadoop-hdfs-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/g uava-11.0 .2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/activation-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jackson-jaxrs-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/xz-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jettison-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib /jersey-j son-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/zookeeper-3.4.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-io-2.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jackson-xc-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-collections-3.2.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-codec-1.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jsr305-1.3.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/guice-3.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/asm-3.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-cli-1.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jline-0.9.94.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-lan g-2.6.jar :/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-httpclient-3.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-client-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/javax.inject-1.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/servlet-api-2.5.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-common-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-client-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.4.0.jar:/usr/local /hadoop-2 .4.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-common-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-api-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/usr/local/hadoop-2.4.0/share/h adoop/map reduce/lib/guice-servlet-3.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/usr/local/hadoop-2.4.0/share/h adoop/map reduce/hadoop-mapreduce-client-jobclient-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.4.0-tests.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.4.0.jar:/usr/local/hadoop-2.4.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.4.0.jar:/usr/local/hadoop-2.4.0/contrib/capacity-scheduler/*.jar
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:java.library.path=/usr/local/hadoop-2.4.0/lib/native
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:java.io.tmpdir=/tmp
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:java.compiler=<NA>
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:os.name=Linux
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:os.arch=amd64
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:os.version=2.6.32-431.11.2.el6.x86_64
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:user.name=barnhartr
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:user.home=/home/barnhartr
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Client
>         environment:user.dir=/usr/local/geomesa-gdelt-master
>         
>         14/05/08 11:53:01 INFO zookeeper.ZooKeeper: Initiating client
>         connection, connectString=127.0.0.1 sessionTimeout=30000
>         watcher=org.apache.accumulo.fate.zookeeper.ZooSession
>         $ZooWatcher@1ec896d2
>         
>         14/05/08 11:53:01 INFO zookeeper.ClientCnxn: Opening socket
>         connection to server localhost/127.0.0.1:2181. Will not
>         attempt to authenticate using SASL (unknown error)
>         
>         14/05/08 11:53:01 INFO zookeeper.ClientCnxn: Socket connection
>         established to localhost/127.0.0.1:2181, initiating session
>         
>         14/05/08 11:53:01 INFO zookeeper.ClientCnxn: Session
>         establishment complete on server localhost/127.0.0.1:2181,
>         sessionid = 0x145dc8e7394000e, negotiated timeout = 30000
>         
>         OpenJDK 64-Bit Server VM warning: You have loaded
>         library /usr/local/hadoop-2.4.0/lib/native/libhadoop.so.1.0.0
>         which might have disabled stack guard. The VM will try to fix
>         the stack guard now.
>         
>         It's highly recommended that you fix the library with
>         'execstack -c <libfile>', or link it with '-z noexecstack'.
>         
>         14/05/08 11:53:05 WARN util.NativeCodeLoader: Unable to load
>         native-hadoop library for your platform... using builtin-java
>         classes where applicable
>         
>         14/05/08 11:53:08 INFO Configuration.deprecation: session.id
>         is deprecated. Instead, use dfs.metrics.session-id
>         
>         14/05/08 11:53:08 INFO jvm.JvmMetrics: Initializing JVM
>         Metrics with processName=JobTracker, sessionId=
>         
>         14/05/08 11:53:08 WARN mapreduce.JobSubmitter: Hadoop
>         command-line option parsing not performed. Implement the Tool
>         interface and execute your application with ToolRunner to
>         remedy this.
>         
>         14/05/08 11:53:08 WARN mapreduce.JobSubmitter: No job jar file
>         set.  User classes may not be found. See Job or
>         Job#setJar(String).
>         
>         14/05/08 11:53:08 INFO input.FileInputFormat: Total input
>         paths to process : 1
>         
>         14/05/08 11:53:08 INFO mapreduce.JobSubmitter: number of
>         splits:49
>         
>         14/05/08 11:53:09 INFO mapreduce.JobSubmitter: Submitting
>         tokens for job: job_local422695915_0001
>         
>         14/05/08 11:53:09 WARN conf.Configuration:
>         file:/hadoop/tmp/mapred/staging/barnhartr422695915/.staging/job_local422695915_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
>         
>         14/05/08 11:53:09 WARN conf.Configuration:
>         file:/hadoop/tmp/mapred/staging/barnhartr422695915/.staging/job_local422695915_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
>         
>         14/05/08 11:53:47 INFO mapred.LocalDistributedCacheManager:
>         Creating
>         symlink: /hadoop/tmp/mapred/local/1399575189575/geomesa-gdelt-1.0-SNAPSHOT.jar <- /usr/local/geomesa-gdelt-master/geomesa-gdelt-1.0-SNAPSHOT.jar
>         
>         14/05/08 11:53:47 INFO mapred.LocalDistributedCacheManager:
>         Localized
>         hdfs://localhost:8020/tmp/geomesa-gdelt-1.0-SNAPSHOT.jar as
>         file:/hadoop/tmp/mapred/local/1399575189575/geomesa-gdelt-1.0-SNAPSHOT.jar
>         
>         14/05/08 11:53:47 WARN conf.Configuration:
>         file:/hadoop/tmp/mapred/local/localRunner/barnhartr/job_local422695915_0001/job_local422695915_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
>         
>         14/05/08 11:53:47 WARN conf.Configuration:
>         file:/hadoop/tmp/mapred/local/localRunner/barnhartr/job_local422695915_0001/job_local422695915_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
>         
>         14/05/08 11:53:47 INFO mapred.LocalDistributedCacheManager:
>         file:/hadoop/tmp/mapred/local/1399575189575/geomesa-gdelt-1.0-SNAPSHOT.jar/
>         
>         14/05/08 11:53:47 INFO mapreduce.Job: The url to track the
>         job: http://localhost:8080/
>         
>         14/05/08 11:53:47 INFO mapreduce.Job: Running job:
>         job_local422695915_0001
>         
>         14/05/08 11:53:47 INFO mapred.LocalJobRunner: OutputCommitter
>         set in config null
>         
>         14/05/08 11:53:47 INFO mapred.LocalJobRunner: OutputCommitter
>         is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
>         
>         14/05/08 11:53:47 INFO mapred.LocalJobRunner: Waiting for map
>         tasks
>         
>         14/05/08 11:53:47 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000000_0
>         
>         14/05/08 11:53:47 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:47 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:6442450944
>         +138958463
>         
>         14/05/08 11:53:47 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:48 INFO mapreduce.Job: Job
>         job_local422695915_0001 running in uber mode : false
>         
>         14/05/08 11:53:48 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:48 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:48 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:48 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:48 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:48 INFO mapreduce.Job:  map 0% reduce 0%
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:49 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000001_0
>         
>         14/05/08 11:53:49 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:0+134217728
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:49 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:49 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:49 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000002_0
>         
>         14/05/08 11:53:49 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:134217728
>         +134217728
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:49 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:49 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:49 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000003_0
>         
>         14/05/08 11:53:49 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:268435456
>         +134217728
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:49 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:49 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:49 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000004_0
>         
>         14/05/08 11:53:49 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:402653184
>         +134217728
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:49 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:49 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:49 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000005_0
>         
>         14/05/08 11:53:49 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:536870912
>         +134217728
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:49 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:49 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:49 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000006_0
>         
>         14/05/08 11:53:50 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:671088640
>         +134217728
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:50 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:50 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000007_0
>         
>         14/05/08 11:53:50 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:805306368
>         +134217728
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:50 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:50 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000008_0
>         
>         14/05/08 11:53:50 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:939524096
>         +134217728
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:50 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:50 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000009_0
>         
>         14/05/08 11:53:50 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1073741824
>         +134217728
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:50 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:50 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000010_0
>         
>         14/05/08 11:53:50 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1207959552
>         +134217728
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:50 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:50 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000011_0
>         
>         14/05/08 11:53:50 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1342177280
>         +134217728
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:50 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:50 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:50 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000012_0
>         
>         14/05/08 11:53:50 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1476395008
>         +134217728
>         
>         14/05/08 11:53:50 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:51 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:51 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:51 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000013_0
>         
>         14/05/08 11:53:51 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1610612736
>         +134217728
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:51 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:51 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:51 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000014_0
>         
>         14/05/08 11:53:51 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1744830464
>         +134217728
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:51 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:51 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:51 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000015_0
>         
>         14/05/08 11:53:51 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:1879048192
>         +134217728
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:51 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:51 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:51 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000016_0
>         
>         14/05/08 11:53:51 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2013265920
>         +134217728
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:51 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:51 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:51 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000017_0
>         
>         14/05/08 11:53:51 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2147483648
>         +134217728
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:51 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:51 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:51 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000018_0
>         
>         14/05/08 11:53:51 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2281701376
>         +134217728
>         
>         14/05/08 11:53:51 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:52 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:52 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:52 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000019_0
>         
>         14/05/08 11:53:52 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2415919104
>         +134217728
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:52 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:52 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:52 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000020_0
>         
>         14/05/08 11:53:52 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2550136832
>         +134217728
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:52 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:52 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:52 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000021_0
>         
>         14/05/08 11:53:52 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2684354560
>         +134217728
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:52 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:52 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:52 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000022_0
>         
>         14/05/08 11:53:52 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2818572288
>         +134217728
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:52 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:52 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:52 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000023_0
>         
>         14/05/08 11:53:52 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:2952790016
>         +134217728
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:52 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:52 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:52 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000024_0
>         
>         14/05/08 11:53:52 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3087007744
>         +134217728
>         
>         14/05/08 11:53:52 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:53 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:53 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:53 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000025_0
>         
>         14/05/08 11:53:53 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3221225472
>         +134217728
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:53 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:53 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:53 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000026_0
>         
>         14/05/08 11:53:53 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3355443200
>         +134217728
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:53 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:53 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:53 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000027_0
>         
>         14/05/08 11:53:53 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3489660928
>         +134217728
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:53 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:53 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:53 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000028_0
>         
>         14/05/08 11:53:53 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3623878656
>         +134217728
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:53 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:53 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:53 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000029_0
>         
>         14/05/08 11:53:53 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3758096384
>         +134217728
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:53 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:53 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:53 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000030_0
>         
>         14/05/08 11:53:53 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:3892314112
>         +134217728
>         
>         14/05/08 11:53:53 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:54 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:54 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:54 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000031_0
>         
>         14/05/08 11:53:54 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4026531840
>         +134217728
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:54 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:54 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:54 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000032_0
>         
>         14/05/08 11:53:54 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4160749568
>         +134217728
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:54 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:54 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:54 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000033_0
>         
>         14/05/08 11:53:54 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4294967296
>         +134217728
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:54 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:54 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:54 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000034_0
>         
>         14/05/08 11:53:54 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4429185024
>         +134217728
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:54 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:54 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:54 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000035_0
>         
>         14/05/08 11:53:54 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4563402752
>         +134217728
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:54 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:54 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:54 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000036_0
>         
>         14/05/08 11:53:54 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4697620480
>         +134217728
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:54 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:54 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:54 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:55 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000037_0
>         
>         14/05/08 11:53:55 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4831838208
>         +134217728
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:55 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:55 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:55 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000038_0
>         
>         14/05/08 11:53:55 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:4966055936
>         +134217728
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:55 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:55 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:55 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000039_0
>         
>         14/05/08 11:53:55 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5100273664
>         +134217728
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:55 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:55 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:55 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000040_0
>         
>         14/05/08 11:53:55 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5234491392
>         +134217728
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:55 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:55 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:55 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000041_0
>         
>         14/05/08 11:53:55 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5368709120
>         +134217728
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:55 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:55 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:55 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000042_0
>         
>         14/05/08 11:53:55 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5502926848
>         +134217728
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:55 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:55 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:55 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:56 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000043_0
>         
>         14/05/08 11:53:56 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5637144576
>         +134217728
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:56 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:56 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:56 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000044_0
>         
>         14/05/08 11:53:56 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5771362304
>         +134217728
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:56 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:56 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:56 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000045_0
>         
>         14/05/08 11:53:56 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:5905580032
>         +134217728
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:56 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:56 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:56 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000046_0
>         
>         14/05/08 11:53:56 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:6039797760
>         +134217728
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:56 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:56 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:56 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000047_0
>         
>         14/05/08 11:53:56 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:6174015488
>         +134217728
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:56 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:56 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:56 INFO mapred.LocalJobRunner: Starting task:
>         attempt_local422695915_0001_m_000048_0
>         
>         14/05/08 11:53:56 INFO mapred.Task:  Using
>         ResourceCalculatorProcessTree : [ ]
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Processing split:
>         hdfs://localhost:8020/gdelt/uncompressed/gdelt.tsv:6308233216
>         +134217728
>         
>         14/05/08 11:53:56 INFO mapred.MapTask: Map output collector
>         class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
>         
>         14/05/08 11:53:57 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:57 INFO mapred.MapTask: (EQUATOR) 0 kvi
>         26214396(104857584)
>         
>         14/05/08 11:53:57 INFO mapred.MapTask:
>         mapreduce.task.io.sort.mb: 100
>         
>         14/05/08 11:53:57 INFO mapred.MapTask: soft limit at 83886080
>         
>         14/05/08 11:53:57 INFO mapred.MapTask: bufstart = 0; bufvoid =
>         104857600
>         
>         14/05/08 11:53:57 INFO mapred.MapTask: kvstart = 26214396;
>         length = 6553600
>         
>         14/05/08 11:53:57 INFO mapred.MapTask: Starting flush of map
>         output
>         
>         14/05/08 11:53:57 INFO mapred.LocalJobRunner: map task
>         executor complete.
>         
>         14/05/08 11:53:57 WARN mapred.LocalJobRunner:
>         job_local422695915_0001
>         
>         java.lang.Exception: java.lang.RuntimeException:
>         org.apache.accumulo.core.client.AccumuloSecurityException:
>         Error BAD_AUTHORIZATIONS for user root - The user does not
>         have the specified authorizations assigned
>         
>                         at org.apache.hadoop.mapred.LocalJobRunner
>         $Job.runTasks(LocalJobRunner.java:462)
>         
>                         at org.apache.hadoop.mapred.LocalJobRunner
>         $Job.run(LocalJobRunner.java:522)
>         
>         Caused by: java.lang.RuntimeException:
>         org.apache.accumulo.core.client.AccumuloSecurityException:
>         Error BAD_AUTHORIZATIONS for user root - The user does not
>         have the specified authorizations assigned
>         
>                         at
>         org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.hasNext(TabletServerBatchReaderIterator.java:210)
>         
>                         at geomesa.core.data.AccumuloDataStore
>         $$anonfun$readMetadataItem
>         $1.apply(AccumuloDataStore.scala:169)
>         
>                         at geomesa.core.data.AccumuloDataStore
>         $$anonfun$readMetadataItem
>         $1.apply(AccumuloDataStore.scala:157)
>         
>                         at scala.collection.MapLike
>         $class.getOrElse(MapLike.scala:128)
>         
>                         at
>         scala.collection.AbstractMap.getOrElse(Map.scala:58)
>         
>                         at
>         geomesa.core.data.AccumuloDataStore.readMetadataItem(AccumuloDataStore.scala:157)
>         
>                         at
>         geomesa.core.data.AccumuloDataStore.getAttributes(AccumuloDataStore.scala:220)
>         
>                         at
>         geomesa.core.data.AccumuloDataStore.getSchema(AccumuloDataStore.scala:267)
>         
>                         at
>         geomesa.gdelt.GDELTIngestMapper.setup(GDELTIngestMapper.java:53)
>         
>                         at
>         org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
>         
>                         at
>         org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
>         
>                         at
>         org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
>         
>                         at org.apache.hadoop.mapred.LocalJobRunner$Job
>         $MapTaskRunnable.run(LocalJobRunner.java:243)
>         
>                         at java.util.concurrent.Executors
>         $RunnableAdapter.call(Executors.java:471)
>         
>                         at
>         java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         
>                         at
>         java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         
>                         at java.util.concurrent.ThreadPoolExecutor
>         $Worker.run(ThreadPoolExecutor.java:615)
>         
>                         at java.lang.Thread.run(Thread.java:744)
>         
>         Caused by:
>         org.apache.accumulo.core.client.AccumuloSecurityException:
>         Error BAD_AUTHORIZATIONS for user root - The user does not
>         have the specified authorizations assigned
>         
>                         at
>         org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.doLookup(TabletServerBatchReaderIterator.java:701)
>         
>                         at
>         org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator$QueryTask.run(TabletServerBatchReaderIterator.java:361)
>         
>                         at
>         org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
>         
>                         at
>         java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         
>                         at java.util.concurrent.ThreadPoolExecutor
>         $Worker.run(ThreadPoolExecutor.java:615)
>         
>                         at
>         org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
>         
>                         at
>         org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
>         
>                         ... 1 more
>         
>         Caused by: ThriftSecurityException(user:root,
>         code:BAD_AUTHORIZATIONS)
>         
>                         at
>         org.apache.accumulo.core.tabletserver.thrift.TabletClientService$startMultiScan_result$startMultiScan_resultStandardScheme.read(TabletClientService.java:8165)
>         
>                         at
>         org.apache.accumulo.core.tabletserver.thrift.TabletClientService$startMultiScan_result$startMultiScan_resultStandardScheme.read(TabletClientService.java:8142)
>         
>                         at
>         org.apache.accumulo.core.tabletserver.thrift.TabletClientService$startMultiScan_result.read(TabletClientService.java:8081)
>         
>                         at
>         org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
>         
>                         at
>         org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Client.recv_startMultiScan(TabletClientService.java:294)
>         
>                         at
>         org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Client.startMultiScan(TabletClientService.java:274)
>         
>                         at
>         org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.doLookup(TabletServerBatchReaderIterator.java:644)
>         
>                         ... 7 more
>         
>         14/05/08 11:53:57 WARN impl.TabletServerBatchReader:
>         TabletServerBatchReader not shutdown; did you forget to call
>         close()?
>         
>         14/05/08 11:53:58 INFO mapreduce.Job: Job
>         job_local422695915_0001 failed with state FAILED due to: NA
>         
>         14/05/08 11:53:58 INFO mapreduce.Job: Counters: 0
>         
>         Exception in thread "main" java.lang.Exception: Job failed
>         
>                         at
>         geomesa.gdelt.GDELTIngest.runMapReduceJob(GDELTIngest.java:152)
>         
>                         at
>         geomesa.gdelt.GDELTIngest.main(GDELTIngest.java:110)
>         
>                         at
>         sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         
>                         at
>         sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         
>                         at
>         sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         
>                         at
>         java.lang.reflect.Method.invoke(Method.java:606)
>         
>                         at
>         org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>         
> 
>  
> 
> 
> _______________________________________________
> geomesa-dev mailing list
> geomesa-dev@xxxxxxxxxxxxxxxx
> http://locationtech.org/mailman/listinfo/geomesa-dev
Follow-Ups:
- Re: [geomesa-dev] Problems running GeoMesa GDELT tutorial
  - From: Chris Eichelberger
References:
- Re: [geomesa-dev] Problems running GeoMesa GDELT tutorial
  - From: Andrew Ross
- Re: [geomesa-dev] Problems running GeoMesa GDELT tutorial
  - From: Chris Snider
- Re: [geomesa-dev] Problems running GeoMesa GDELT tutorial
  - From: Chris Snider
Prev by Date: Re: [geomesa-dev] Problems running GeoMesa GDELT tutorial
Next by Date: Re: [geomesa-dev] Problems running GeoMesa GDELT tutorial
Previous by thread: Re: [geomesa-dev] Problems running GeoMesa GDELT tutorial
Next by thread: Re: [geomesa-dev] Problems running GeoMesa GDELT tutorial
Index(es):
- Date
- Thread
Breadcrumbs
