Search Google

Wednesday, April 04, 2018

How to correctly access rocksdb in flink stream task?

complete trace of "/Users/abc/MyFiles/workspace/flink-java-project/hs_err_pid64626.log":

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x000000012c94cf55, pid=64626, tid=39683
#
# JRE version: Java(TM) SE Runtime Environment (8.0_60-b27) (build 1.8.0_60-b27)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.60-b23 mixed mode bsd-amd64 compressed oops)
# Problematic frame:
# C  [librocksdbjni-osx.jnilib+0x3ff55]  _Z18rocksdb_get_helperP7JNIEnv_PN7rocksdb2DBERKNS1_11ReadOptionsEPNS1_18ColumnFamilyHandleEP11_jbyteArrayii+0xe5
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

---------------  T H R E A D  ---------------

Current thread (0x00007fb7a5026800):  JavaThread "Process -> Sink: Unnamed (2/8)" [_thread_in_native, id=39683, stack(0x00007000082ac000,0x00007000083ac000)]

siginfo: si_signo: 11 (SIGSEGV), si_code: 0 (unknown), si_addr: 0x0000000000000000

Registers:
RAX=0x6176616a2e697061, RBX=0x00007fb7a50269f8, RCX=0x0000000000000000, RDX=0x00007000083ab2e8
RSP=0x00007000083ab220, RBP=0x00007000083ab2d0, RSI=0x00007fb7a6daca00, RDI=0x00007000083ab1f0
R8 =0x00007fb7a16474c0, R9 =0x0000000000000000, R10=0x000000010c949928, R11=0x00007fb02e038cf8
R12=0x00007000083ab3f8, R13=0x0000000000000000, R14=0x00007fb7a16474c0, R15=0x0000000000000024
RIP=0x000000012c94cf55, EFLAGS=0x0000000000010246, ERR=0x0000000000000000
  TRAPNO=0x000000000000000d

Top of Stack: (sp=0x00007000083ab220)
0x00007000083ab220:   00007fb7a1606840 00007fb7a16474c0
0x00007000083ab230:   0000000000000024 0000000000000000
0x00007000083ab240:   00007000083ab2e8 00007fb7a6daca00
0x00007000083ab250:   0000000000000000 0000000000000000
0x00007000083ab260:   0000000000000000 0000000000000008
0x00007000083ab270:   0000000129a69b20 00007fb7a5026800
0x00007000083ab280:   00007000083ab458 0000000129a69b20
0x00007000083ab290:   0000000000000000 0000000000000000
0x00007000083ab2a0:   00007000083ab2c0 0000000000000024
0x00007000083ab2b0:   00007fb7a6daca00 00007fb7a50269f8
0x00007000083ab2c0:   0000000000000000 00007000083ab3f8
0x00007000083ab2d0:   00007000083ab340 000000012c94d103
0x00007000083ab2e0:   00007fb700000024 0000000000000000
0x00007000083ab2f0:   0000000000000000 0000000000000000
0x00007000083ab300:   0000000000000000 0000010100000000
0x00007000083ab310:   0000000000000000 0000000129a69b20
0x00007000083ab320:   0000000000000000 0000000129a69b18
0x00007000083ab330:   00007000083ab410 00007fb7a5026800
0x00007000083ab340:   00007000083ab3c8 000000010c949954
0x00007000083ab350:   00007fb7a5026800 00007fb7a5026800
0x00007000083ab360:   0000000129a69b20 00007000083ab410
0x00007000083ab370:   00007000083ab3c8 000000010c9496e7
0x00007000083ab380:   000000010c9496a2 00007000083ab388
0x00007000083ab390:   0000000129a69b18 00007000083ab410
0x00007000083ab3a0:   000000012bcdaca0 0000000000000000
0x00007000083ab3b0:   0000000129a69b20 0000000000000000
0x00007000083ab3c0:   00007000083ab3e8 00007000083ab458
0x00007000083ab3d0:   000000010c93b9d0 0000000000000000
0x00007000083ab3e0:   000000010c94357b 0000000000000024
0x00007000083ab3f0:   0000000000000000 000000077360e7b8
0x00007000083ab400:   00007fb7a6daca00 000000076f2b9200
0x00007000083ab410:   000000076f2b9200 00007000083ab418

Instructions: (pc=0x000000012c94cf55)
0x000000012c94cf35:   48 8b 06 48 8b 80 90 00 00 00 48 8d 7d b0 4c 8d
0x000000012c94cf45:   85 58 ff ff ff 4c 8d 4d 80 ff d0 eb 1b 48 8b 06
0x000000012c94cf55:   48 8b 80 a0 00 00 00 48 8d 7d b0 48 8d 8d 58 ff
0x000000012c94cf65:   ff ff 4c 8d 45 80 ff d0 48 8b 45 b0 89 45 c0 c7

Register to memory mapping:

RAX=0x6176616a2e697061 is an unknown value
RBX=0x00007fb7a50269f8 is an unknown value
RCX=0x0000000000000000 is an unknown value
RDX=0x00007000083ab2e8 is pointing into the stack for thread: 0x00007fb7a5026800
RSP=0x00007000083ab220 is pointing into the stack for thread: 0x00007fb7a5026800
RBP=0x00007000083ab2d0 is pointing into the stack for thread: 0x00007fb7a5026800
RSI=0x00007fb7a6daca00 is an unknown value
RDI=0x00007000083ab1f0 is pointing into the stack for thread: 0x00007fb7a5026800
R8 =0x00007fb7a16474c0 is an unknown value
R9 =0x0000000000000000 is an unknown value
R10=0x000000010c949928 is at code_begin+808 in an Interpreter codelet
method entry point (kind = native)  [0x000000010c949600, 0x000000010c949f00]  2304 bytes
R11=0x00007fb02e038cf8 is an unknown value
R12=0x00007000083ab3f8 is pointing into the stack for thread: 0x00007fb7a5026800
R13=0x0000000000000000 is an unknown value
R14=0x00007fb7a16474c0 is an unknown value
R15=0x0000000000000024 is an unknown value


Stack: [0x00007000082ac000,0x00007000083ac000],  sp=0x00007000083ab220,  free space=1020k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  [librocksdbjni-osx.jnilib+0x3ff55]  _Z18rocksdb_get_helperP7JNIEnv_PN7rocksdb2DBERKNS1_11ReadOptionsEPNS1_18ColumnFamilyHandleEP11_jbyteArrayii+0xe5
C  [librocksdbjni-osx.jnilib+0x40103]  Java_org_rocksdb_RocksDB_get__J_3BII+0x43
j  org.rocksdb.RocksDB.get(J[BII)[B+0
j  org.rocksdb.RocksDB.get([B)[B+9
j  exercise.CheckpointedLongRides$MatchFunction.processElement(Lcom/dataartisans/flinktraining/exercises/datastream_java/datatypes/TaxiRide;Lorg/apache/flink/streaming/api/functions/ProcessFunction$Context;Lorg/apache/flink/util/Collector;)V+19
j  exercise.CheckpointedLongRides$MatchFunction.processElement(Ljava/lang/Object;Lorg/apache/flink/streaming/api/functions/ProcessFunction$Context;Lorg/apache/flink/util/Collector;)V+7
j  org.apache.flink.streaming.api.operators.KeyedProcessOperator.processElement(Lorg/apache/flink/streaming/runtime/streamrecord/StreamRecord;)V+36
J 2612 C1 org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput()Z (387 bytes) @ 0x000000010d0218f4 [0x000000010d020c60+0xc94]
j  org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run()V+13
j  org.apache.flink.streaming.runtime.tasks.StreamTask.invoke()V+221
j  org.apache.flink.runtime.taskmanager.Task.run()V+832
j  java.lang.Thread.run()V+11
v  ~StubRoutines::call_stub
V  [libjvm.dylib+0x2eab0e]
V  [libjvm.dylib+0x2eb29c]
V  [libjvm.dylib+0x2eb448]
V  [libjvm.dylib+0x345965]
V  [libjvm.dylib+0x5612d3]
V  [libjvm.dylib+0x5629ce]
V  [libjvm.dylib+0x48343a]
C  [libsystem_pthread.dylib+0x36c1]  _pthread_body+0x154
C  [libsystem_pthread.dylib+0x356d]  _pthread_body+0x0
C  [libsystem_pthread.dylib+0x2c5d]  thread_start+0xd
C  0x0000000000000000

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j  org.rocksdb.RocksDB.get(J[BII)[B+0
j  org.rocksdb.RocksDB.get([B)[B+9
j  exercise.CheckpointedLongRides$MatchFunction.processElement(Lcom/dataartisans/flinktraining/exercises/datastream_java/datatypes/TaxiRide;Lorg/apache/flink/streaming/api/functions/ProcessFunction$Context;Lorg/apache/flink/util/Collector;)V+19
j  exercise.CheckpointedLongRides$MatchFunction.processElement(Ljava/lang/Object;Lorg/apache/flink/streaming/api/functions/ProcessFunction$Context;Lorg/apache/flink/util/Collector;)V+7
j  org.apache.flink.streaming.api.operators.KeyedProcessOperator.processElement(Lorg/apache/flink/streaming/runtime/streamrecord/StreamRecord;)V+36
J 2612 C1 org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput()Z (387 bytes) @ 0x000000010d0218f4 [0x000000010d020c60+0xc94]
j  org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run()V+13
j  org.apache.flink.streaming.runtime.tasks.StreamTask.invoke()V+221
j  org.apache.flink.runtime.taskmanager.Task.run()V+832
j  java.lang.Thread.run()V+11
v  ~StubRoutines::call_stub

---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
  0x00007fb7a77d3000 JavaThread "pool-13-thread-1" [_thread_blocked, id=65347, stack(0x000070000a69b000,0x000070000a79b000)]
  0x00007fb7a5c0a000 JavaThread "pool-11-thread-1" [_thread_blocked, id=63531, stack(0x000070000a598000,0x000070000a698000)]
  0x00007fb7a485b800 JavaThread "pool-17-thread-1" [_thread_blocked, id=54699, stack(0x000070000a495000,0x000070000a595000)]
  0x00007fb7a42f9000 JavaThread "pool-18-thread-1" [_thread_blocked, id=58655, stack(0x000070000a392000,0x000070000a492000)]
  0x00007fb7a5c0d800 JavaThread "pool-16-thread-1" [_thread_blocked, id=63287, stack(0x000070000a28f000,0x000070000a38f000)]
  0x00007fb7a4183000 JavaThread "pool-14-thread-1" [_thread_blocked, id=66655, stack(0x000070000a18c000,0x000070000a28c000)]
  0x00007fb7a75b6000 JavaThread "pool-12-thread-1" [_thread_blocked, id=59987, stack(0x000070000a089000,0x000070000a189000)]
  0x00007fb7a75b7800 JavaThread "Abandoned connection cleanup thread" daemon [_thread_blocked, id=56083, stack(0x0000700009f86000,0x000070000a086000)]
  0x00007fb7a6e3a800 JavaThread "pool-2-thread-1" [_thread_blocked, id=52995, stack(0x0000700009cfa000,0x0000700009dfa000)]
  0x00007fb7a584a800 JavaThread "pool-3-thread-1" [_thread_blocked, id=52483, stack(0x0000700009bf7000,0x0000700009cf7000)]
  0x00007fb7a491d800 JavaThread "pool-9-thread-1" [_thread_blocked, id=51971, stack(0x0000700009af4000,0x0000700009bf4000)]
  0x00007fb7a4125800 JavaThread "pool-5-thread-1" [_thread_blocked, id=51459, stack(0x00007000099f1000,0x0000700009af1000)]
  0x00007fb7a5045000 JavaThread "pool-6-thread-1" [_thread_blocked, id=50947, stack(0x00007000098ee000,0x00007000099ee000)]
  0x00007fb7a491d000 JavaThread "pool-7-thread-1" [_thread_blocked, id=50435, stack(0x00007000097eb000,0x00007000098eb000)]
  0x00007fb7a4122800 JavaThread "pool-10-thread-1" [_thread_blocked, id=49923, stack(0x00007000096e8000,0x00007000097e8000)]
  0x00007fb7a491c000 JavaThread "pool-8-thread-1" [_thread_blocked, id=49411, stack(0x00007000095e5000,0x00007000096e5000)]
  0x00007fb7a491b800 JavaThread "pool-4-thread-1" [_thread_blocked, id=48899, stack(0x00007000094e2000,0x00007000095e2000)]
  0x00007fb7a4122000 JavaThread "Time Trigger for Source: Custom Source (1/1)" daemon [_thread_blocked, id=48387, stack(0x00007000093df000,0x00007000094df000)]
  0x00007fb7a7090000 JavaThread "flink-akka.actor.default-dispatcher-6" [_thread_in_Java, id=22279, stack(0x0000700006046000,0x0000700006146000)]
  0x00007fb7a3ff7000 JavaThread "Async calls on Source: Custom Source (1/1)" daemon [_thread_blocked, id=47875, stack(0x00007000092dc000,0x00007000093dc000)]
  0x00007fb7a34b6000 JavaThread "Process -> Sink: Unnamed (8/8)" [_thread_in_vm, id=47363, stack(0x00007000091d9000,0x00007000092d9000)]
  0x00007fb7a5080000 JavaThread "OutputFlusher" daemon [_thread_blocked, id=46851, stack(0x00007000090d6000,0x00007000091d6000)]
  0x00007fb7a3c1d000 JavaThread "Process -> Sink: Unnamed (7/8)" [_thread_in_native, id=46339, stack(0x0000700008fd3000,0x00007000090d3000)]
  0x00007fb7a507e800 JavaThread "OutputFlusher" daemon [_thread_blocked, id=45827, stack(0x0000700008ed0000,0x0000700008fd0000)]
  0x00007fb7a40fe800 JavaThread "OutputFlusher" daemon [_thread_blocked, id=45315, stack(0x0000700008dcd000,0x0000700008ecd000)]
  0x00007fb7a1ef5000 JavaThread "OutputFlusher" daemon [_thread_blocked, id=44803, stack(0x0000700008cca000,0x0000700008dca000)]
  0x00007fb7a38e1800 JavaThread "OutputFlusher" daemon [_thread_blocked, id=44291, stack(0x0000700008bc7000,0x0000700008cc7000)]
  0x00007fb7a58d5000 JavaThread "OutputFlusher" daemon [_thread_blocked, id=43779, stack(0x0000700008ac4000,0x0000700008bc4000)]
  0x00007fb7a58d4800 JavaThread "OutputFlusher" daemon [_thread_blocked, id=43267, stack(0x00007000089c1000,0x0000700008ac1000)]
  0x00007fb7a1ef4000 JavaThread "OutputFlusher" daemon [_thread_blocked, id=42755, stack(0x00007000088be000,0x00007000089be000)]
  0x00007fb7a4066000 JavaThread "OutputFlusher" daemon [_thread_blocked, id=42243, stack(0x00007000087bb000,0x00007000088bb000)]
  0x00007fb7a48ba000 JavaThread "Process -> Sink: Unnamed (6/8)" [_thread_blocked, id=41731, stack(0x00007000086b8000,0x00007000087b8000)]
  0x00007fb7a48b9000 JavaThread "Process -> Sink: Unnamed (5/8)" [_thread_in_vm, id=41219, stack(0x00007000085b5000,0x00007000086b5000)]
  0x00007fb7a34ae000 JavaThread "Process -> Sink: Unnamed (4/8)" [_thread_blocked, id=40707, stack(0x00007000084b2000,0x00007000085b2000)]
  0x00007fb7a58ad800 JavaThread "Process -> Sink: Unnamed (3/8)" [_thread_in_vm, id=40195, stack(0x00007000083af000,0x00007000084af000)]
=>0x00007fb7a5026800 JavaThread "Process -> Sink: Unnamed (2/8)" [_thread_in_native, id=39683, stack(0x00007000082ac000,0x00007000083ac000)]
  0x00007fb7a4021000 JavaThread "Process -> Sink: Unnamed (1/8)" [_thread_in_native, id=39171, stack(0x00007000081a9000,0x00007000082a9000)]
  0x00007fb7a4941000 JavaThread "Filter (8/8)" [_thread_blocked, id=38659, stack(0x00007000080a6000,0x00007000081a6000)]
  0x00007fb7a2584000 JavaThread "Filter (7/8)" [_thread_blocked, id=38147, stack(0x0000700007fa3000,0x00007000080a3000)]
  0x00007fb7a40c8800 JavaThread "Filter (6/8)" [_thread_blocked, id=37635, stack(0x0000700007ea0000,0x0000700007fa0000)]
  0x00007fb7a3899000 JavaThread "Filter (5/8)" [_thread_blocked, id=37123, stack(0x0000700007d9d000,0x0000700007e9d000)]
  0x00007fb7a1f3d000 JavaThread "Filter (4/8)" [_thread_blocked, id=36611, stack(0x0000700007c9a000,0x0000700007d9a000)]
  0x00007fb7a24b5800 JavaThread "Filter (3/8)" [_thread_blocked, id=36099, stack(0x0000700007b97000,0x0000700007c97000)]
  0x00007fb7a40c8000 JavaThread "Filter (2/8)" [_thread_blocked, id=35587, stack(0x0000700007a94000,0x0000700007b94000)]
  0x00007fb7a1d83000 JavaThread "Filter (1/8)" [_thread_blocked, id=35075, stack(0x0000700007991000,0x0000700007a91000)]
  0x00007fb7a1d82000 JavaThread "CloseableReaperThread" daemon [_thread_blocked, id=34563, stack(0x000070000788e000,0x000070000798e000)]
  0x00007fb7a2637000 JavaThread "Source: Custom Source (1/1)" [_thread_in_vm, id=34051, stack(0x000070000778b000,0x000070000788b000)]
  0x00007fb7a5040000 JavaThread "Flink-MetricRegistry-thread-1" daemon [_thread_blocked, id=33539, stack(0x0000700007688000,0x0000700007788000)]
  0x00007fb7a25c4800 JavaThread "flink-akka.actor.default-dispatcher-5" [_thread_in_Java, id=33027, stack(0x0000700007585000,0x0000700007685000)]
  0x00007fb7a34ad800 JavaThread "Checkpoint Timer" daemon [_thread_blocked, id=32515, stack(0x0000700007482000,0x0000700007582000)]
  0x00007fb7a21f7000 JavaThread "Timer-2" daemon [_thread_blocked, id=32003, stack(0x000070000737f000,0x000070000747f000)]
  0x00007fb7a34aa000 JavaThread "Timer-1" daemon [_thread_blocked, id=31491, stack(0x000070000727c000,0x000070000737c000)]
  0x00007fb7a21f3000 JavaThread "mini-cluster-future-thread-8" daemon [_thread_blocked, id=30979, stack(0x0000700007179000,0x0000700007279000)]
  0x00007fb7a21f2800 JavaThread "mini-cluster-future-thread-7" daemon [_thread_blocked, id=30467, stack(0x0000700007076000,0x0000700007176000)]
  0x00007fb7a1d81800 JavaThread "mini-cluster-future-thread-6" daemon [_thread_blocked, id=29955, stack(0x0000700006f73000,0x0000700007073000)]
  0x00007fb7a1d80800 JavaThread "mini-cluster-future-thread-5" daemon [_thread_blocked, id=29443, stack(0x0000700006e70000,0x0000700006f70000)]
  0x00007fb7a1c61000 JavaThread "mini-cluster-future-thread-4" daemon [_thread_blocked, id=28931, stack(0x0000700006d6d000,0x0000700006e6d000)]
  0x00007fb7a1e28000 JavaThread "mini-cluster-future-thread-3" daemon [_thread_blocked, id=28419, stack(0x0000700006c6a000,0x0000700006d6a000)]
  0x00007fb7a34a4800 JavaThread "mini-cluster-future-thread-2" daemon [_thread_blocked, id=27907, stack(0x0000700006b67000,0x0000700006c67000)]
  0x00007fb7a34a3800 JavaThread "mini-cluster-future-thread-1" daemon [_thread_blocked, id=27395, stack(0x0000700006a64000,0x0000700006b64000)]
  0x00007fb7a21f6800 JavaThread "IOManager reader thread #1" daemon [_thread_blocked, id=26883, stack(0x0000700006961000,0x0000700006a61000)]
  0x00007fb7a349d000 JavaThread "IOManager writer thread #1" daemon [_thread_blocked, id=26371, stack(0x000070000685e000,0x000070000695e000)]
  0x00007fb7a31ed000 JavaThread "ForkJoinPool-1-worker-9" daemon [_thread_blocked, id=25859, stack(0x000070000675b000,0x000070000685b000)]
  0x00007fb7a1c60800 JavaThread "ForkJoinPool-1-worker-11" daemon [_thread_blocked, id=25347, stack(0x0000700006658000,0x0000700006758000)]
  0x00007fb7a34a1000 JavaThread "ForkJoinPool-1-worker-13" daemon [_thread_blocked, id=24835, stack(0x0000700006555000,0x0000700006655000)]
  0x00007fb7a2331800 JavaThread "BLOB Server listener at 52652" daemon [_thread_in_native, id=24323, stack(0x0000700006452000,0x0000700006552000)]
  0x00007fb7a3491800 JavaThread "Timer-0" daemon [_thread_blocked, id=23811, stack(0x000070000634f000,0x000070000644f000)]
  0x00007fb7a3bdf000 JavaThread "flink-akka.actor.default-dispatcher-4" [_thread_in_vm, id=23299, stack(0x000070000624c000,0x000070000634c000)]
  0x00007fb7a1c04800 JavaThread "flink-akka.actor.default-dispatcher-3" [_thread_blocked, id=22787, stack(0x0000700006149000,0x0000700006249000)]
  0x00007fb7a347a800 JavaThread "flink-scheduler-1" [_thread_blocked, id=3847, stack(0x0000700005f43000,0x0000700006043000)]
  0x00007fb7a20cc800 JavaThread "Service Thread" daemon [_thread_blocked, id=21251, stack(0x0000700005d3d000,0x0000700005e3d000)]
  0x00007fb7a387b000 JavaThread "C1 CompilerThread3" daemon [_thread_in_vm, id=20739, stack(0x0000700005c3a000,0x0000700005d3a000)]
  0x00007fb7a3872800 JavaThread "C2 CompilerThread2" daemon [_thread_in_native, id=20227, stack(0x0000700005b37000,0x0000700005c37000)]
  0x00007fb7a383d800 JavaThread "C2 CompilerThread1" daemon [_thread_in_native, id=19715, stack(0x0000700005a34000,0x0000700005b34000)]
  0x00007fb7a31e8000 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=19203, stack(0x0000700005931000,0x0000700005a31000)]
  0x00007fb7a31e6800 JavaThread "Monitor Ctrl-Break" daemon [_thread_in_native, id=18691, stack(0x000070000582e000,0x000070000592e000)]
  0x00007fb7a181c800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=18439, stack(0x000070000572b000,0x000070000582b000)]
  0x00007fb7a181b800 JavaThread "Finalizer" daemon [_thread_blocked, id=14851, stack(0x0000700005628000,0x0000700005728000)]
  0x00007fb7a3822800 JavaThread "Reference Handler" daemon [_thread_blocked, id=14339, stack(0x0000700005525000,0x0000700005625000)]
  0x00007fb7a3005000 JavaThread "main" [_thread_blocked, id=6659, stack(0x0000700004b07000,0x0000700004c07000)]

Other Threads:
  0x00007fb7a3004000 VMThread [stack: 0x0000700005422000,0x0000700005522000] [id=13827]
  0x00007fb7a1b44000 WatcherThread [stack: 0x0000700005e40000,0x0000700005f40000] [id=21763]

VM state:synchronizing (normal execution)

VM Mutex/Monitor currently owned by a thread:  ([mutex/lock_event])
[0x00007fb7a2901be0] Safepoint_lock - owner thread: 0x00007fb7a3004000
[0x00007fb7a2901c60] Threads_lock - owner thread: 0x00007fb7a3004000

Heap:
 PSYoungGen      total 273408K, used 233548K [0x000000076ab00000, 0x0000000787900000, 0x00000007c0000000)
  eden space 151040K, 95% used [0x000000076ab00000,0x00000007737a68a8,0x0000000773e80000)
  from space 122368K, 73% used [0x000000077bf80000,0x00000007816ec8b0,0x0000000783700000)
  to   space 132096K, 0% used [0x0000000773e80000,0x0000000773e80000,0x000000077bf80000)
 ParOldGen       total 533504K, used 293669K [0x00000006c0000000, 0x00000006e0900000, 0x000000076ab00000)
  object space 533504K, 55% used [0x00000006c0000000,0x00000006d1ec96f0,0x00000006e0900000)
 Metaspace       used 32606K, capacity 33314K, committed 33536K, reserved 1079296K
  class space    used 4405K, capacity 4585K, committed 4608K, reserved 1048576K

Card table byte_map: [0x000000010bd89000,0x000000010c58a000] byte_map_base: 0x0000000108789000

Marking Bits: (ParMarkBitMap*) 0x000000010b2dee20
 Begin Bits: [0x000000011be8a000, 0x000000011fe8a000)
 End Bits:   [0x000000011fe8a000, 0x0000000123e8a000)

Polling page: 0x0000000109985000

CodeCache: size=245760Kb used=7425Kb max_used=7425Kb free=238334Kb
 bounds [0x000000010c934000, 0x000000010d084000, 0x000000011b934000]
 total_blobs=3013 nmethods=2460 adapters=464
 compilation: enabled

Compilation events (10 events):
Event: 12.626 Thread 0x00007fb7a387b000 2781       1       java.io.ObjectStreamClass$Caches::access$200 (4 bytes)
Event: 12.626 Thread 0x00007fb7a387b000 nmethod 2781 0x000000010d077bd0 code [0x000000010d077d20, 0x000000010d077e10]
Event: 12.626 Thread 0x00007fb7a387b000 2786   !   2       java.lang.StringCoding$StringEncoder::encode (179 bytes)
Event: 12.633 Thread 0x00007fb7a387b000 nmethod 2786 0x000000010d077e50 code [0x000000010d0780a0, 0x000000010d078bd8]
Event: 12.633 Thread 0x00007fb7a387b000 2783       2       org.apache.flink.core.memory.ByteArrayOutputStreamWithPos::write (66 bytes)
Event: 12.633 Thread 0x00007fb7a387b000 nmethod 2783 0x000000010d079590 code [0x000000010d079720, 0x000000010d079a68]
Event: 12.633 Thread 0x00007fb7a387b000 2779       2       org.apache.flink.runtime.state.NonClosingCheckpointOutputStream::write (9 bytes)
Event: 12.634 Thread 0x00007fb7a387b000 nmethod 2779 0x000000010d079c10 code [0x000000010d079d80, 0x000000010d079f08]
Event: 12.634 Thread 0x00007fb7a387b000 2776       2       org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory$FsCheckpointStateOutputStream::write (35 bytes)
Event: 12.644 Thread 0x00007fb7a387b000 nmethod 2776 0x000000010d07a550 code [0x000000010d07a6c0, 0x000000010d07a888]

GC Heap History (10 events):
Event: 6.454 GC heap before
{Heap before GC invocations=8 (full 3):
 PSYoungGen      total 76288K, used 10738K [0x000000076ab00000, 0x0000000774000000, 0x00000007c0000000)
  eden space 65536K, 0% used [0x000000076ab00000,0x000000076ab00000,0x000000076eb00000)
  from space 10752K, 99% used [0x000000076eb00000,0x000000076f57ca08,0x000000076f580000)
  to   space 10752K, 0% used [0x0000000773580000,0x0000000773580000,0x0000000774000000)
 ParOldGen       total 175104K, used 125033K [0x00000006c0000000, 0x00000006cab00000, 0x000000076ab00000)
  object space 175104K, 71% used [0x00000006c0000000,0x00000006c7a1a578,0x00000006cab00000)
 Metaspace       used 22104K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3055K, capacity 3163K, committed 3200K, reserved 1048576K
Event: 6.492 GC heap after
Heap after GC invocations=8 (full 3):
 PSYoungGen      total 76288K, used 0K [0x000000076ab00000, 0x0000000774000000, 0x00000007c0000000)
  eden space 65536K, 0% used [0x000000076ab00000,0x000000076ab00000,0x000000076eb00000)
  from space 10752K, 0% used [0x000000076eb00000,0x000000076eb00000,0x000000076f580000)
  to   space 10752K, 0% used [0x0000000773580000,0x0000000773580000,0x0000000774000000)
 ParOldGen       total 297984K, used 130700K [0x00000006c0000000, 0x00000006d2300000, 0x000000076ab00000)
  object space 297984K, 43% used [0x00000006c0000000,0x00000006c7fa3340,0x00000006d2300000)
 Metaspace       used 22104K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3055K, capacity 3163K, committed 3200K, reserved 1048576K
}
Event: 6.501 GC heap before
{Heap before GC invocations=9 (full 3):
 PSYoungGen      total 76288K, used 65536K [0x000000076ab00000, 0x0000000774000000, 0x00000007c0000000)
  eden space 65536K, 100% used [0x000000076ab00000,0x000000076eb00000,0x000000076eb00000)
  from space 10752K, 0% used [0x000000076eb00000,0x000000076eb00000,0x000000076f580000)
  to   space 10752K, 0% used [0x0000000773580000,0x0000000773580000,0x0000000774000000)
 ParOldGen       total 297984K, used 130700K [0x00000006c0000000, 0x00000006d2300000, 0x000000076ab00000)
  object space 297984K, 43% used [0x00000006c0000000,0x00000006c7fa3340,0x00000006d2300000)
 Metaspace       used 22115K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3057K, capacity 3163K, committed 3200K, reserved 1048576K
Event: 6.528 GC heap after
Heap after GC invocations=9 (full 3):
 PSYoungGen      total 111104K, used 10725K [0x000000076ab00000, 0x0000000774000000, 0x00000007c0000000)
  eden space 100352K, 0% used [0x000000076ab00000,0x000000076ab00000,0x0000000770d00000)
  from space 10752K, 99% used [0x0000000773580000,0x0000000773ff9470,0x0000000774000000)
  to   space 10752K, 0% used [0x0000000772b00000,0x0000000772b00000,0x0000000773580000)
 ParOldGen       total 297984K, used 184399K [0x00000006c0000000, 0x00000006d2300000, 0x000000076ab00000)
  object space 297984K, 61% used [0x00000006c0000000,0x00000006cb413c10,0x00000006d2300000)
 Metaspace       used 22115K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3057K, capacity 3163K, committed 3200K, reserved 1048576K
}
Event: 6.543 GC heap before
{Heap before GC invocations=10 (full 3):
 PSYoungGen      total 111104K, used 111077K [0x000000076ab00000, 0x0000000774000000, 0x00000007c0000000)
  eden space 100352K, 100% used [0x000000076ab00000,0x0000000770d00000,0x0000000770d00000)
  from space 10752K, 99% used [0x0000000773580000,0x0000000773ff9470,0x0000000774000000)
  to   space 10752K, 0% used [0x0000000772b00000,0x0000000772b00000,0x0000000773580000)
 ParOldGen       total 297984K, used 184399K [0x00000006c0000000, 0x00000006d2300000, 0x000000076ab00000)
  object space 297984K, 61% used [0x00000006c0000000,0x00000006cb413c10,0x00000006d2300000)
 Metaspace       used 22115K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3057K, capacity 3163K, committed 3200K, reserved 1048576K
Event: 6.649 GC heap after
Heap after GC invocations=10 (full 3):
 PSYoungGen      total 141824K, used 10725K [0x000000076ab00000, 0x0000000783700000, 0x00000007c0000000)
  eden space 131072K, 0% used [0x000000076ab00000,0x000000076ab00000,0x0000000772b00000)
  from space 10752K, 99% used [0x0000000772b00000,0x0000000773579470,0x0000000773580000)
  to   space 122368K, 0% used [0x000000077bf80000,0x000000077bf80000,0x0000000783700000)
 ParOldGen       total 297984K, used 283063K [0x00000006c0000000, 0x00000006d2300000, 0x000000076ab00000)
  object space 297984K, 94% used [0x00000006c0000000,0x00000006d146dca0,0x00000006d2300000)
 Metaspace       used 22115K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3057K, capacity 3163K, committed 3200K, reserved 1048576K
}
Event: 6.649 GC heap before
{Heap before GC invocations=11 (full 4):
 PSYoungGen      total 141824K, used 10725K [0x000000076ab00000, 0x0000000783700000, 0x00000007c0000000)
  eden space 131072K, 0% used [0x000000076ab00000,0x000000076ab00000,0x0000000772b00000)
  from space 10752K, 99% used [0x0000000772b00000,0x0000000773579470,0x0000000773580000)
  to   space 122368K, 0% used [0x000000077bf80000,0x000000077bf80000,0x0000000783700000)
 ParOldGen       total 297984K, used 283063K [0x00000006c0000000, 0x00000006d2300000, 0x000000076ab00000)
  object space 297984K, 94% used [0x00000006c0000000,0x00000006d146dca0,0x00000006d2300000)
 Metaspace       used 22115K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3057K, capacity 3163K, committed 3200K, reserved 1048576K
Event: 6.696 GC heap after
Heap after GC invocations=11 (full 4):
 PSYoungGen      total 141824K, used 0K [0x000000076ab00000, 0x0000000783700000, 0x00000007c0000000)
  eden space 131072K, 0% used [0x000000076ab00000,0x000000076ab00000,0x0000000772b00000)
  from space 10752K, 0% used [0x0000000772b00000,0x0000000772b00000,0x0000000773580000)
  to   space 122368K, 0% used [0x000000077bf80000,0x000000077bf80000,0x0000000783700000)
 ParOldGen       total 533504K, used 293661K [0x00000006c0000000, 0x00000006e0900000, 0x000000076ab00000)
  object space 533504K, 55% used [0x00000006c0000000,0x00000006d1ec76f0,0x00000006e0900000)
 Metaspace       used 22115K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3057K, capacity 3163K, committed 3200K, reserved 1048576K
}
Event: 6.966 GC heap before
{Heap before GC invocations=12 (full 4):
 PSYoungGen      total 141824K, used 131072K [0x000000076ab00000, 0x0000000783700000, 0x00000007c0000000)
  eden space 131072K, 100% used [0x000000076ab00000,0x0000000772b00000,0x0000000772b00000)
  from space 10752K, 0% used [0x0000000772b00000,0x0000000772b00000,0x0000000773580000)
  to   space 122368K, 0% used [0x000000077bf80000,0x000000077bf80000,0x0000000783700000)
 ParOldGen       total 533504K, used 293661K [0x00000006c0000000, 0x00000006e0900000, 0x000000076ab00000)
  object space 533504K, 55% used [0x00000006c0000000,0x00000006d1ec76f0,0x00000006e0900000)
 Metaspace       used 25756K, capacity 26140K, committed 26240K, reserved 1071104K
  class space    used 3538K, capacity 3656K, committed 3712K, reserved 1048576K
Event: 7.009 GC heap after
Heap after GC invocations=12 (full 4):
 PSYoungGen      total 273408K, used 89522K [0x000000076ab00000, 0x0000000787900000, 0x00000007c0000000)
  eden space 151040K, 0% used [0x000000076ab00000,0x000000076ab00000,0x0000000773e80000)
  from space 122368K, 73% used [0x000000077bf80000,0x00000007816ec8b0,0x0000000783700000)
  to   space 132096K, 0% used [0x0000000773e80000,0x0000000773e80000,0x000000077bf80000)
 ParOldGen       total 533504K, used 293669K [0x00000006c0000000, 0x00000006e0900000, 0x000000076ab00000)
  object space 533504K, 55% used [0x00000006c0000000,0x00000006d1ec96f0,0x00000006e0900000)
 Metaspace       used 25756K, capacity 26140K, committed 26240K, reserved 1071104K
  class space    used 3538K, capacity 3656K, committed 3712K, reserved 1048576K
}

Deoptimization events (10 events):
Event: 12.365 Thread 0x00007fb7a3c1d000 Uncommon trap: reason=unstable_if action=reinterpret pc=0x000000010ce83030 method=java.net.URI.match(CJJ)Z @ 19
Event: 12.365 Thread 0x00007fb7a58ad800 Uncommon trap: reason=unstable_if action=reinterpret pc=0x000000010ce83030 method=java.net.URI.match(CJJ)Z @ 19
Event: 12.575 Thread 0x00007fb7a2637000 Uncommon trap: reason=unstable_if action=reinterpret pc=0x000000010d04eeb4 method=org.apache.flink.runtime.io.network.api.serialization.SpanningRecordSerializer.getSerializationResult()Lorg/apache/flink/runtime/io/network/api/serialization/RecordSerialize
Event: 12.618 Thread 0x00007fb7a3c1d000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151
Event: 12.618 Thread 0x00007fb7a34b6000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151
Event: 12.618 Thread 0x00007fb7a5026800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151
Event: 12.618 Thread 0x00007fb7a48b9000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151
Event: 12.618 Thread 0x00007fb7a48ba000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151
Event: 12.618 Thread 0x00007fb7a34ae000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151
Event: 12.618 Thread 0x00007fb7a58ad800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151

Internal exceptions (10 events):
Event: 5.504 Thread 0x00007fb7a3005000 Exception > (0x000000076d47b4c8) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp, line 1591]
Event: 5.511 Thread 0x00007fb7a3005000 Exception > (0x000000076d51f560) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp, line 1591]
Event: 5.524 Thread 0x00007fb7a3005000 Exception > (0x000000076d650750) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp, line 1591]
Event: 5.583 Thread 0x00007fb7a3005000 Exception (0x000000076db94e30) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/methodHandles.cpp, line 1146]
Event: 5.587 Thread 0x00007fb7a3005000 Exception (0x000000076dba29c0) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/methodHandles.cpp, line 1146]
Event: 5.618 Thread 0x00007fb7a3005000 Exception > (0x000000076de56a48) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp, line 1591]
Event: 5.636 Thread 0x00007fb7a3005000 Exception > (0x000000076df9ce50) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp, line 1591]
Event: 5.997 Thread 0x00007fb7a3005000 Implicit null exception at 0x000000010cb30c75 to 0x000000010cb30fe1
Event: 5.997 Thread 0x00007fb7a3005000 Implicit null exception at 0x000000010cb216b5 to 0x000000010cb21a15
Event: 11.780 Thread 0x00007fb7a1c04800 Exception > (0x000000076b876898) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp, line 1591]

Events (10 events):
Event: 12.646 loading class org/joda/time/chrono/ISOChronologyConstructorAccess
Event: 12.646 loading class org/joda/time/chrono/ISOChronologyConstructorAccess done
Event: 12.646 loading class org/joda/time/chrono/ISOChronologyConstructorAccess
Event: 12.646 loading class org/joda/time/chrono/ISOChronologyConstructorAccess done
Event: 12.646 loading class org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend$RocksDBMergeIterator$1
Event: 12.646 loading class org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend$RocksDBMergeIterator$1 done
Event: 12.646 loading class org/joda/time/chrono/ISOChronologyConstructorAccess
Event: 12.646 loading class org/joda/time/chrono/ISOChronologyConstructorAccess done
Event: 12.646 loading class org/joda/time/chrono/GregorianChronologyConstructorAccess
Event: 12.646 loading class org/joda/time/chrono/GregorianChronologyConstructorAccess done


Dynamic libraries:
0x000000002a235000 /System/Library/Frameworks/Cocoa.framework/Versions/A/Cocoa
0x000000002a235000 /System/Library/Frameworks/Security.framework/Versions/A/Security
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/ApplicationServices
0x000000002a235000 /usr/lib/libz.1.dylib
0x000000002a235000 /usr/lib/libSystem.B.dylib
0x000000002a235000 /usr/lib/libobjc.A.dylib
0x000000002a235000 /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
0x000000002a235000 /System/Library/Frameworks/Foundation.framework/Versions/C/Foundation
0x000000002a235000 /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
0x000000002a235000 /System/Library/Frameworks/CoreData.framework/Versions/A/CoreData
0x000000002a235000 /System/Library/PrivateFrameworks/RemoteViewServices.framework/Versions/A/RemoteViewServices
0x000000002a235000 /System/Library/PrivateFrameworks/UIFoundation.framework/Versions/A/UIFoundation
0x000000002a235000 /System/Library/PrivateFrameworks/DFRFoundation.framework/Versions/A/DFRFoundation
0x000000002a235000 /System/Library/Frameworks/Metal.framework/Versions/A/Metal
0x000000002a235000 /System/Library/PrivateFrameworks/DesktopServicesPriv.framework/Versions/A/DesktopServicesPriv
0x000000002a235000 /usr/lib/libenergytrace.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/SkyLight.framework/Versions/A/SkyLight
0x000000002a235000 /System/Library/Frameworks/CoreGraphics.framework/Versions/A/CoreGraphics
0x000000002a235000 /usr/lib/libScreenReader.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Accelerate
0x000000002a235000 /System/Library/Frameworks/IOSurface.framework/Versions/A/IOSurface
0x000000002a235000 /System/Library/Frameworks/AudioToolbox.framework/Versions/A/AudioToolbox
0x000000002a235000 /System/Library/Frameworks/AudioUnit.framework/Versions/A/AudioUnit
0x000000002a235000 /System/Library/PrivateFrameworks/DataDetectorsCore.framework/Versions/A/DataDetectorsCore
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HIToolbox.framework/Versions/A/HIToolbox
0x000000002a235000 /usr/lib/libicucore.A.dylib
0x000000002a235000 /System/Library/Frameworks/QuartzCore.framework/Versions/A/QuartzCore
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/SpeechRecognition.framework/Versions/A/SpeechRecognition
0x000000002a235000 /usr/lib/libauto.dylib
0x000000002a235000 /usr/lib/libxml2.2.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/CoreUI.framework/Versions/A/CoreUI
0x000000002a235000 /System/Library/Frameworks/CoreAudio.framework/Versions/A/CoreAudio
0x000000002a235000 /System/Library/Frameworks/DiskArbitration.framework/Versions/A/DiskArbitration
0x000000002a235000 /usr/lib/liblangid.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/MultitouchSupport.framework/Versions/A/MultitouchSupport
0x000000002a235000 /System/Library/Frameworks/IOKit.framework/Versions/A/IOKit
0x000000002a235000 /usr/lib/libDiagnosticMessagesClient.dylib
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/CoreServices
0x000000002a235000 /System/Library/PrivateFrameworks/PerformanceAnalysis.framework/Versions/A/PerformanceAnalysis
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/OpenGL
0x000000002a235000 /System/Library/Frameworks/ColorSync.framework/Versions/A/ColorSync
0x000000002a235000 /System/Library/Frameworks/CoreImage.framework/Versions/A/CoreImage
0x000000002a235000 /System/Library/Frameworks/CoreText.framework/Versions/A/CoreText
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/ImageIO
0x000000002a235000 /System/Library/PrivateFrameworks/Backup.framework/Versions/A/Backup
0x000000002a235000 /usr/lib/libarchive.2.dylib
0x000000002a235000 /System/Library/Frameworks/CFNetwork.framework/Versions/A/CFNetwork
0x000000002a235000 /System/Library/Frameworks/SystemConfiguration.framework/Versions/A/SystemConfiguration
0x000000002a235000 /usr/lib/libCRFSuite.dylib
0x000000002a235000 /usr/lib/libc++.1.dylib
0x000000002a235000 /usr/lib/libc++abi.dylib
0x000000002a235000 /usr/lib/system/libcache.dylib
0x000000002a235000 /usr/lib/system/libcommonCrypto.dylib
0x000000002a235000 /usr/lib/system/libcompiler_rt.dylib
0x000000002a235000 /usr/lib/system/libcopyfile.dylib
0x000000002a235000 /usr/lib/system/libcorecrypto.dylib
0x000000002a235000 /usr/lib/system/libdispatch.dylib
0x000000002a235000 /usr/lib/system/libdyld.dylib
0x000000002a235000 /usr/lib/system/libkeymgr.dylib
0x000000002a235000 /usr/lib/system/liblaunch.dylib
0x000000002a235000 /usr/lib/system/libmacho.dylib
0x000000002a235000 /usr/lib/system/libquarantine.dylib
0x000000002a235000 /usr/lib/system/libremovefile.dylib
0x000000002a235000 /usr/lib/system/libsystem_asl.dylib
0x000000002a235000 /usr/lib/system/libsystem_blocks.dylib
0x000000002a235000 /usr/lib/system/libsystem_c.dylib
0x000000002a235000 /usr/lib/system/libsystem_configuration.dylib
0x000000002a235000 /usr/lib/system/libsystem_coreservices.dylib
0x000000002a235000 /usr/lib/system/libsystem_darwin.dylib
0x000000002a235000 /usr/lib/system/libsystem_dnssd.dylib
0x000000002a235000 /usr/lib/system/libsystem_info.dylib
0x000000002a235000 /usr/lib/system/libsystem_m.dylib
0x000000002a235000 /usr/lib/system/libsystem_malloc.dylib
0x000000002a235000 /usr/lib/system/libsystem_network.dylib
0x000000002a235000 /usr/lib/system/libsystem_networkextension.dylib
0x000000002a235000 /usr/lib/system/libsystem_notify.dylib
0x000000002a235000 /usr/lib/system/libsystem_sandbox.dylib
0x000000002a235000 /usr/lib/system/libsystem_secinit.dylib
0x000000002a235000 /usr/lib/system/libsystem_kernel.dylib
0x000000002a235000 /usr/lib/system/libsystem_platform.dylib
0x000000002a235000 /usr/lib/system/libsystem_pthread.dylib
0x000000002a235000 /usr/lib/system/libsystem_symptoms.dylib
0x000000002a235000 /usr/lib/system/libsystem_trace.dylib
0x000000002a235000 /usr/lib/system/libunwind.dylib
0x000000002a235000 /usr/lib/system/libxpc.dylib
0x000000002a235000 /usr/lib/closure/libclosured.dylib
0x000000002a235000 /usr/lib/libbsm.0.dylib
0x000000002a235000 /usr/lib/system/libkxld.dylib
0x000000002a235000 /usr/lib/libOpenScriptingUtil.dylib
0x000000002a235000 /usr/lib/libcoretls.dylib
0x000000002a235000 /usr/lib/libcoretls_cfhelpers.dylib
0x000000002a235000 /usr/lib/libpam.2.dylib
0x000000002a235000 /usr/lib/libsqlite3.dylib
0x000000002a235000 /usr/lib/libxar.1.dylib
0x000000002a235000 /usr/lib/libbz2.1.0.dylib
0x000000002a235000 /usr/lib/liblzma.5.dylib
0x000000002a235000 /usr/lib/libnetwork.dylib
0x000000002a235000 /usr/lib/libapple_nghttp2.dylib
0x000000002a235000 /usr/lib/libpcap.A.dylib
0x000000002a235000 /usr/lib/libboringssl.dylib
0x000000002a235000 /usr/lib/libusrtcp.dylib
0x000000002a235000 /usr/lib/libapple_crypto.dylib
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/FSEvents.framework/Versions/A/FSEvents
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CarbonCore.framework/Versions/A/CarbonCore
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Metadata.framework/Versions/A/Metadata
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/OSServices.framework/Versions/A/OSServices
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/SearchKit.framework/Versions/A/SearchKit
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/AE.framework/Versions/A/AE
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/LaunchServices.framework/Versions/A/LaunchServices
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/DictionaryServices.framework/Versions/A/DictionaryServices
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/SharedFileList.framework/Versions/A/SharedFileList
0x000000002a235000 /System/Library/Frameworks/NetFS.framework/Versions/A/NetFS
0x000000002a235000 /System/Library/PrivateFrameworks/NetAuth.framework/Versions/A/NetAuth
0x000000002a235000 /System/Library/PrivateFrameworks/login.framework/Versions/A/Frameworks/loginsupport.framework/Versions/A/loginsupport
0x000000002a235000 /System/Library/PrivateFrameworks/TCC.framework/Versions/A/TCC
0x000000002a235000 /usr/lib/libmecabra.dylib
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ATS.framework/Versions/A/ATS
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ColorSyncLegacy.framework/Versions/A/ColorSyncLegacy
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/HIServices.framework/Versions/A/HIServices
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/LangAnalysis.framework/Versions/A/LangAnalysis
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/PrintCore.framework/Versions/A/PrintCore
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/QD.framework/Versions/A/QD
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/SpeechSynthesis.framework/Versions/A/SpeechSynthesis
0x000000002a235000 /System/Library/Frameworks/CoreDisplay.framework/Versions/A/CoreDisplay
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vImage.framework/Versions/A/vImage
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/vecLib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libvDSP.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBNNS.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libQuadrature.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libvMisc.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libLAPACK.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libLinearAlgebra.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libSparse.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libSparseBLAS.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/IOAccelerator.framework/Versions/A/IOAccelerator
0x000000002a235000 /System/Library/PrivateFrameworks/IOPresentment.framework/Versions/A/IOPresentment
0x000000002a235000 /System/Library/PrivateFrameworks/DSExternalDisplay.framework/Versions/A/DSExternalDisplay
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCoreFSCache.dylib
0x000000002a235000 /System/Library/Frameworks/CoreVideo.framework/Versions/A/CoreVideo
0x000000002a235000 /System/Library/PrivateFrameworks/GraphVisualizer.framework/Versions/A/GraphVisualizer
0x000000002a235000 /System/Library/Frameworks/MetalPerformanceShaders.framework/Versions/A/MetalPerformanceShaders
0x000000002a235000 /usr/lib/libFosl_dynamic.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/FaceCore.framework/Versions/A/FaceCore
0x000000002a235000 /System/Library/Frameworks/OpenCL.framework/Versions/A/OpenCL
0x000000002a235000 /usr/lib/libcompression.dylib
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ATS.framework/Versions/A/Resources/libFontParser.dylib
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ATS.framework/Versions/A/Resources/libFontRegistry.dylib
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libJPEG.dylib
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libTIFF.dylib
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libPng.dylib
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libGIF.dylib
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libJP2.dylib
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libRadiance.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/AppleJPEG.framework/Versions/A/AppleJPEG
0x000000002a235000 /System/Library/PrivateFrameworks/MetalTools.framework/Versions/A/MetalTools
0x000000002a235000 /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSCore.framework/Versions/A/MPSCore
0x000000002a235000 /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSImage.framework/Versions/A/MPSImage
0x000000002a235000 /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSMatrix.framework/Versions/A/MPSMatrix
0x000000002a235000 /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSNeuralNetwork.framework/Versions/A/MPSNeuralNetwork
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGLU.dylib
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGFXShared.dylib
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGL.dylib
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGLImage.dylib
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCVMSPluginSupport.dylib
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCoreVMClient.dylib
0x000000002a235000 /usr/lib/libcups.2.dylib
0x000000002a235000 /System/Library/Frameworks/Kerberos.framework/Versions/A/Kerberos
0x000000002a235000 /System/Library/Frameworks/GSS.framework/Versions/A/GSS
0x000000002a235000 /usr/lib/libresolv.9.dylib
0x000000002a235000 /usr/lib/libiconv.2.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/Heimdal.framework/Versions/A/Heimdal
0x000000002a235000 /usr/lib/libheimdal-asn1.dylib
0x000000002a235000 /System/Library/Frameworks/OpenDirectory.framework/Versions/A/OpenDirectory
0x000000002a235000 /System/Library/PrivateFrameworks/CommonAuth.framework/Versions/A/CommonAuth
0x000000002a235000 /System/Library/Frameworks/OpenDirectory.framework/Versions/A/Frameworks/CFOpenDirectory.framework/Versions/A/CFOpenDirectory
0x000000002a235000 /System/Library/Frameworks/SecurityFoundation.framework/Versions/A/SecurityFoundation
0x000000002a235000 /System/Library/PrivateFrameworks/APFS.framework/Versions/A/APFS
0x000000002a235000 /usr/lib/libutil.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/AppleSauce.framework/Versions/A/AppleSauce
0x000000002a235000 /System/Library/PrivateFrameworks/LinguisticData.framework/Versions/A/LinguisticData
0x000000002a235000 /usr/lib/libmarisa.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/Lexicon.framework/Versions/A/Lexicon
0x000000002a235000 /usr/lib/libChineseTokenizer.dylib
0x000000002a235000 /usr/lib/libcmph.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/LanguageModeling.framework/Versions/A/LanguageModeling
0x000000002a235000 /System/Library/PrivateFrameworks/CoreEmoji.framework/Versions/A/CoreEmoji
0x000000002a235000 /System/Library/Frameworks/ServiceManagement.framework/Versions/A/ServiceManagement
0x000000002a235000 /System/Library/PrivateFrameworks/BackgroundTaskManagement.framework/Versions/A/BackgroundTaskManagement
0x000000002a235000 /usr/lib/libxslt.1.dylib
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Ink.framework/Versions/A/Ink
0x000000002a235000 /System/Library/PrivateFrameworks/TextureIO.framework/Versions/A/TextureIO
0x000000002a235000 /usr/lib/libate.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/CrashReporterSupport.framework/Versions/A/CrashReporterSupport
0x000000002a235000 /System/Library/PrivateFrameworks/Sharing.framework/Versions/A/Sharing
0x000000002a235000 /System/Library/PrivateFrameworks/IconServices.framework/Versions/A/IconServices
0x000000002a235000 /System/Library/PrivateFrameworks/ProtocolBuffer.framework/Versions/A/ProtocolBuffer
0x000000002a235000 /System/Library/PrivateFrameworks/Apple80211.framework/Versions/A/Apple80211
0x000000002a235000 /System/Library/Frameworks/CoreWLAN.framework/Versions/A/CoreWLAN
0x000000002a235000 /System/Library/PrivateFrameworks/CoreUtils.framework/Versions/A/CoreUtils
0x000000002a235000 /System/Library/Frameworks/IOBluetooth.framework/Versions/A/IOBluetooth
0x000000002a235000 /System/Library/PrivateFrameworks/CoreWiFi.framework/Versions/A/CoreWiFi
0x000000002a235000 /System/Library/Frameworks/CoreBluetooth.framework/Versions/A/CoreBluetooth
0x000000002a235000 /System/Library/PrivateFrameworks/SignpostNotification.framework/Versions/A/SignpostNotification
0x000000002a235000 /System/Library/PrivateFrameworks/DebugSymbols.framework/Versions/A/DebugSymbols
0x000000002a235000 /System/Library/PrivateFrameworks/CoreSymbolication.framework/Versions/A/CoreSymbolication
0x000000002a235000 /System/Library/PrivateFrameworks/Symbolication.framework/Versions/A/Symbolication
0x000000002a235000 /System/Library/PrivateFrameworks/AppleFSCompression.framework/Versions/A/AppleFSCompression
0x000000002a235000 /System/Library/PrivateFrameworks/SpeechRecognitionCore.framework/Versions/A/SpeechRecognitionCore
0x000000010aa00000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/server/libjvm.dylib
0x000000002a235000 /usr/lib/libstdc++.6.0.9.dylib
0x0000000109942000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libverify.dylib
0x0000000109950000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libjava.dylib
0x0000000109986000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libinstrument.dylib
0x00000001099e4000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libzip.dylib
0x000000002a235000 /System/Library/Frameworks/JavaVM.framework/Versions/A/Frameworks/JavaRuntimeSupport.framework/Versions/A/JavaRuntimeSupport
0x000000002a235000 /System/Library/Frameworks/JavaVM.framework/Versions/A/Frameworks/JavaNativeFoundation.framework/Versions/A/JavaNativeFoundation
0x000000002a235000 /System/Library/Frameworks/JavaVM.framework/Versions/A/JavaVM
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Carbon
0x000000002a235000 /System/Library/PrivateFrameworks/JavaLaunching.framework/Versions/A/JavaLaunching
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/CommonPanels.framework/Versions/A/CommonPanels
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Help.framework/Versions/A/Help
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/ImageCapture.framework/Versions/A/ImageCapture
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/OpenScripting.framework/Versions/A/OpenScripting
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Print.framework/Versions/A/Print
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/SecurityHI.framework/Versions/A/SecurityHI
0x00000001296ce000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libnet.dylib
0x0000000129847000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libmanagement.dylib
0x0000000129855000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libnio.dylib
0x000000012c90d000 /private/var/folders/c2/wvlg_dts42bgc1gm6ws8n9gr0000gn/T/rocksdb-lib-6445759b5387d9c63be049324c56e5b4/librocksdbjni-osx.jnilib

VM Arguments:
jvm_args: -javaagent:/Applications/IntelliJ IDEA CE.app/Contents/lib/idea_rt.jar=52632:/Applications/IntelliJ IDEA CE.app/Contents/bin -Dfile.encoding=UTF-8
java_command: exercise.CheckpointedLongRides --input /Users/abc/MyFiles/workspace/flink-java-project/data/nycTaxiRides.gz
java_class_path (initial): /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/lib/dt.jar:/Library/Ja
Launcher Type: SUN_STANDARD

Environment Variables:
PATH=/opt/local/bin:/opt/local/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/go/bin:/opt/X11/bin:/usr/local/share/dotnet:/Library/Frameworks/Mono.framework/Versions/Current/Commands:/Users/abc/Downloads/:/Applications/TextMate.app/Contents/Resources/:/Users/abc/MyFiles/apache-maven-3.3.3/bin:/Users/abc/MyFiles/apache-ant-1.8.4/bin
SHELL=/bin/bash
DISPLAY=/private/tmp/com.apple.launchd.325nrLM7WW/org.macosforge.xquartz:0

Signal Handlers:
SIGSEGV: [libjvm.dylib+0x5a6d31], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_ONSTACK|SA_RESTART|SA_SIGINFO
SIGBUS: [libjvm.dylib+0x5a6d31], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGFPE: [libjvm.dylib+0x480a4c], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGPIPE: [libjvm.dylib+0x480a4c], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGXFSZ: [libjvm.dylib+0x480a4c], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGILL: [libjvm.dylib+0x480a4c], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGUSR1: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none
SIGUSR2: [libjvm.dylib+0x48056a], sa_mask[0]=00100000000000000000000000000000, sa_flags=SA_RESTART|SA_SIGINFO
SIGHUP: [libjvm.dylib+0x47eb41], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGINT: [libjvm.dylib+0x47eb41], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGTERM: [libjvm.dylib+0x47eb41], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGQUIT: [libjvm.dylib+0x47eb41], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO


---------------  S Y S T E M  ---------------

OS:Bsduname:Darwin 17.2.0 Darwin Kernel Version 17.2.0: Fri Sep 29 18:27:05 PDT 2017; root:xnu-4570.20.62~3/RELEASE_X86_64 x86_64
rlimit: STACK 8192k, CORE 0k, NPROC 1418, NOFILE 10240, AS infinity
load average:3.48 2.38 2.25

CPU:total 8 (4 cores per cpu, 2 threads per core) family 6 model 70 stepping 1, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, lzcnt, ht, tsc, tscinvbit, bmi1, bmi2

Memory: 4k page, physical 16777216k(38744k free)

/proc/meminfo:


vm_info: Java HotSpot(TM) 64-Bit Server VM (25.60-b23) for bsd-amd64 JRE (1.8.0_60-b27), built on Aug  4 2015 10:47:24 by "java_re" with gcc 4.2.1 (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)

time: Wed Apr  4 06:52:56 2018
elapsed time: 12 seconds (0d 0h 0m 12s)

Monday, March 05, 2018

hadoop-101

雖然懶人包的標題是hadoop-101, 但並不完全只是hadoop, 而是補蹲若干年前沒好好蹲的馬步, 首先從過程中參考到眾多文獻裡節錄多次翻閱的連結:

https://www.jianshu.com/p/d862337247b1

懶人包涵蓋了zookeeper + hadoop(HA + federation) + hbase + phoenix, 首先我們先看到懶人包所需要4台機器, 每台機器的配置如下圖所示:
懶人包所需resource可以從github下載:
https://github.com/cyu021/hadoop-101

以下是懶人包的使用步驟:
>> step-01
- download hadoop-base.box and import to vagrant box
- download vagrant resources for hadoop-01, hadoop-02, hadoop-03, hadoop-04

>> step-02 [apply to hadoop-01, hadoop-02, hadoop-03, hadoop-04]
$ cd {path-hadoop-xx}
$ vagrant up && vagrant ssh -c 'sudo su -'
$ ifconfig eth1
把ip記下來並更新到各自node下的hosts-iphone (eg. .../hadoop-01/cfg/hosts/hosts-iphone)檔案中

$ exit
離開vm

$ vagrant provision && vagrant ssh -c 'sudo su -'


>> step-03 [apply to hadoop-01, hadoop-02, hadoop-03]
$ /opt/zookeeper/bin/zkServer.sh start

$ /opt/zookeeper/bin/zkCli.sh
addauth digest super:AAAaaa111
quit
第一次做就可以, 之後啟動VM時不用做

$ echo stat | nc localhost 2181

>> step-04 [apply to hadoop-01]
$ /opt/hadoop/bin/hdfs zkfc -formatZK
第一次做就可以, 之後啟動VM時不用做

>> step-05 [apply to hadoop-01, hadoop-02, hadoop-03]
$ /opt/hadoop/sbin/hadoop-daemon.sh start journalnode

>> step-06 [apply to hadoop-01]
$ /opt/hadoop/bin/hdfs namenode -format
第一次做就可以, 之後啟動VM時不用做

>> step-07 [apply to hadoop-01]
$ /opt/hadoop/sbin/hadoop-daemon.sh start namenode

>> step-08 [apply to hadoop-02]
$ /opt/hadoop/bin/hdfs namenode -bootstrapStandby && /opt/hadoop/sbin/hadoop-daemon.sh start namenode
第一次做就可以, 之後啟動VM時用下面的command
$ /opt/hadoop/sbin/hadoop-daemon.sh start namenode

>> step-09 [apply to hadoop-01, hadoop-02]
$ /opt/hadoop/sbin/hadoop-daemon.sh start zkfc

>> step-10 [apply to hadoop-01, hadoop-02, hadoop-03]
$ /opt/hadoop/sbin/hadoop-daemon.sh start datanode

>> step-11 [apply to hadoop-01, hadoop-02]
$ /opt/hadoop/sbin/yarn-daemon.sh start resourcemanager

>> step-12 [apply to hadoop-01, hadoop-02, hadoop-03]
$ jps
每個node應該看到的process (ignore PID):
-- hadoop-01
3282 QuorumPeerMain
3827 ResourceManager
3365 JournalNode
3461 NameNode
3701 DataNode
3878 Jps
3613 DFSZKFailoverController

-- hadoop-02
3360 JournalNode
3457 NameNode
3713 DataNode
3608 DFSZKFailoverController
3278 QuorumPeerMain
3839 ResourceManager
4063 Jps

-- hadoop-03
3539 Jps
3368 JournalNode
3467 DataNode
3279 QuorumPeerMain

>> step-13
open http://{hadoop-01}:9870/ in browser

open http://{hadoop-02}:9870/ in browser

>> step-14 [apply to hadoop-04]
$ cd /opt/hbase/bin && ./start-hbase.sh
$ jps
應該看到的prcoess (ignore PID):
3996 Jps
3582 HMaster
3727 HRegionServer

$ cd /opt/phoenix/bin && ./queryserver.py

>> step-14 [apply on laptop]
- copy phoenix-4.13.1-HBase-1.3-thin-client.jar from hadoop-04 (/opt/phoenix/phoenix-4.13.1-HBase-1.3-thin-client.jar) to laptop
- add jar to squirrel or any other db client
- setup jdbc driver with phoenix-4.13.1-HBase-1.3-thin-client.jar

- setup connection and connect

Friday, March 02, 2018

Unable to connect to Apache Phoenix with Squirrel

I can run sqlline.py without a problem, but I am unable to connect to Phoenix with Squirrel.

sqlline.py's screenshot:


Squirrel's screenshot:

In Squirrel's screenshot, we can see the hostname "hadoop-01" is successfully translated into IP and the connection is established. The zookeeper's log also shows the establishment:

Following is the phoenix client driver config and jdbc url setting:







Sunday, July 30, 2017

Private cloud deployment end to end walkthrough

之前已經有試過在local開發環境佈建kubernetes派的private cloud, 但光有cloud的基礎設施而沒有上層APP對開發者而言還時沒什麼用, 所以趁颱風天試著把最後一哩路走通, 雖然cloud這件事已經被講爛了, 我還是要用下面這張圖當作開頭

* 想要玩玩ICP的朋友們可以參照這裡的安裝步驟(https://github.com/cyu021/ICP_Local_Install), 安裝完畢之後我們就得到了一個可立即提供服務的private cloud.

我們自建的private cloud當然也能使用public APP store所提供的APP services, 但是會自建private cloud一定是想要跑自建的APP, 而這些自建的APP又不方便放到public APP store中, 因此今天要探討的是要如何將自建的APP deploy上我們的private cloud.

首先我們可以看到透過kubernetes所建置的cluster所運行的runtime service其實都是透過docker image所提供, 為了讓kubernetes有效率的部署這些docker images, 有人跳出來做了HELM (https://helm.sh/), 上圖所提到的Charts便是HELM裡面的一個模組, 專門封裝docker image資訊供kubernetes的部署時參考.

因此為了要能夠將自建的APP部署至kubernetes cluster中, 我們需要先建置自己的repo與相對應的image & package, 這方面的資訊其實也不少可以參照以下連結:
建置docker repo --> https://www.linuxtechi.com/setup-docker-private-registry-centos-7-rhel-7/
打包自建APP的docker image --> https://docs.docker.com/engine/userguide/eng-image/baseimages/
建置charts repo --> https://kairen.github.io/2017/03/25/kubernetes/helm-quickstart/
打包自建APP的chart package --> https://deis.com/blog/2016/getting-started-authoring-helm-charts/

建置完成之後我們需要將新建立的charts repo設定至ICP中, 這樣ICP才會知道多了一個source可安裝APP, 設定過程如下:
1. 點擊左上角的功能鍵
2. 選擇System
3. 選擇Repositories
4. 選擇Add Repository
5. 輸入所需資訊存檔後便會在清單中看到新的charts repo

新增完成Charts repo後, 我們便可以安裝我們自建的APP, 過程如下:
1. 點擊左上角的功能鍵
2. 選擇App Center
3. 從App Center裡面即可看到新增repo中的APP
4. 點擊Install Package並填寫必要資訊
5. 安裝成功後即可使用該APP提供的服務


好的, 介紹到這裡相信各位朋友已經對如何將自建APP部署至我們自建的private cloud了然於胸, 從開發者的角度來看或許這樣已經足夠, 但對於專營cloud事業的朋友們這樣算是非常淺薄, 更深入的介紹就留待未來細細探討了.