Search Google

Wednesday, April 04, 2018

How to correctly access rocksdb in flink stream task?

complete trace of "/Users/abc/MyFiles/workspace/flink-java-project/hs_err_pid64626.log":

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x000000012c94cf55, pid=64626, tid=39683
#
# JRE version: Java(TM) SE Runtime Environment (8.0_60-b27) (build 1.8.0_60-b27)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.60-b23 mixed mode bsd-amd64 compressed oops)
# Problematic frame:
# C  [librocksdbjni-osx.jnilib+0x3ff55]  _Z18rocksdb_get_helperP7JNIEnv_PN7rocksdb2DBERKNS1_11ReadOptionsEPNS1_18ColumnFamilyHandleEP11_jbyteArrayii+0xe5
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

---------------  T H R E A D  ---------------

Current thread (0x00007fb7a5026800):  JavaThread "Process -> Sink: Unnamed (2/8)" [_thread_in_native, id=39683, stack(0x00007000082ac000,0x00007000083ac000)]

siginfo: si_signo: 11 (SIGSEGV), si_code: 0 (unknown), si_addr: 0x0000000000000000

Registers:
RAX=0x6176616a2e697061, RBX=0x00007fb7a50269f8, RCX=0x0000000000000000, RDX=0x00007000083ab2e8
RSP=0x00007000083ab220, RBP=0x00007000083ab2d0, RSI=0x00007fb7a6daca00, RDI=0x00007000083ab1f0
R8 =0x00007fb7a16474c0, R9 =0x0000000000000000, R10=0x000000010c949928, R11=0x00007fb02e038cf8
R12=0x00007000083ab3f8, R13=0x0000000000000000, R14=0x00007fb7a16474c0, R15=0x0000000000000024
RIP=0x000000012c94cf55, EFLAGS=0x0000000000010246, ERR=0x0000000000000000
  TRAPNO=0x000000000000000d

Top of Stack: (sp=0x00007000083ab220)
0x00007000083ab220:   00007fb7a1606840 00007fb7a16474c0
0x00007000083ab230:   0000000000000024 0000000000000000
0x00007000083ab240:   00007000083ab2e8 00007fb7a6daca00
0x00007000083ab250:   0000000000000000 0000000000000000
0x00007000083ab260:   0000000000000000 0000000000000008
0x00007000083ab270:   0000000129a69b20 00007fb7a5026800
0x00007000083ab280:   00007000083ab458 0000000129a69b20
0x00007000083ab290:   0000000000000000 0000000000000000
0x00007000083ab2a0:   00007000083ab2c0 0000000000000024
0x00007000083ab2b0:   00007fb7a6daca00 00007fb7a50269f8
0x00007000083ab2c0:   0000000000000000 00007000083ab3f8
0x00007000083ab2d0:   00007000083ab340 000000012c94d103
0x00007000083ab2e0:   00007fb700000024 0000000000000000
0x00007000083ab2f0:   0000000000000000 0000000000000000
0x00007000083ab300:   0000000000000000 0000010100000000
0x00007000083ab310:   0000000000000000 0000000129a69b20
0x00007000083ab320:   0000000000000000 0000000129a69b18
0x00007000083ab330:   00007000083ab410 00007fb7a5026800
0x00007000083ab340:   00007000083ab3c8 000000010c949954
0x00007000083ab350:   00007fb7a5026800 00007fb7a5026800
0x00007000083ab360:   0000000129a69b20 00007000083ab410
0x00007000083ab370:   00007000083ab3c8 000000010c9496e7
0x00007000083ab380:   000000010c9496a2 00007000083ab388
0x00007000083ab390:   0000000129a69b18 00007000083ab410
0x00007000083ab3a0:   000000012bcdaca0 0000000000000000
0x00007000083ab3b0:   0000000129a69b20 0000000000000000
0x00007000083ab3c0:   00007000083ab3e8 00007000083ab458
0x00007000083ab3d0:   000000010c93b9d0 0000000000000000
0x00007000083ab3e0:   000000010c94357b 0000000000000024
0x00007000083ab3f0:   0000000000000000 000000077360e7b8
0x00007000083ab400:   00007fb7a6daca00 000000076f2b9200
0x00007000083ab410:   000000076f2b9200 00007000083ab418

Instructions: (pc=0x000000012c94cf55)
0x000000012c94cf35:   48 8b 06 48 8b 80 90 00 00 00 48 8d 7d b0 4c 8d
0x000000012c94cf45:   85 58 ff ff ff 4c 8d 4d 80 ff d0 eb 1b 48 8b 06
0x000000012c94cf55:   48 8b 80 a0 00 00 00 48 8d 7d b0 48 8d 8d 58 ff
0x000000012c94cf65:   ff ff 4c 8d 45 80 ff d0 48 8b 45 b0 89 45 c0 c7

Register to memory mapping:

RAX=0x6176616a2e697061 is an unknown value
RBX=0x00007fb7a50269f8 is an unknown value
RCX=0x0000000000000000 is an unknown value
RDX=0x00007000083ab2e8 is pointing into the stack for thread: 0x00007fb7a5026800
RSP=0x00007000083ab220 is pointing into the stack for thread: 0x00007fb7a5026800
RBP=0x00007000083ab2d0 is pointing into the stack for thread: 0x00007fb7a5026800
RSI=0x00007fb7a6daca00 is an unknown value
RDI=0x00007000083ab1f0 is pointing into the stack for thread: 0x00007fb7a5026800
R8 =0x00007fb7a16474c0 is an unknown value
R9 =0x0000000000000000 is an unknown value
R10=0x000000010c949928 is at code_begin+808 in an Interpreter codelet
method entry point (kind = native)  [0x000000010c949600, 0x000000010c949f00]  2304 bytes
R11=0x00007fb02e038cf8 is an unknown value
R12=0x00007000083ab3f8 is pointing into the stack for thread: 0x00007fb7a5026800
R13=0x0000000000000000 is an unknown value
R14=0x00007fb7a16474c0 is an unknown value
R15=0x0000000000000024 is an unknown value


Stack: [0x00007000082ac000,0x00007000083ac000],  sp=0x00007000083ab220,  free space=1020k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  [librocksdbjni-osx.jnilib+0x3ff55]  _Z18rocksdb_get_helperP7JNIEnv_PN7rocksdb2DBERKNS1_11ReadOptionsEPNS1_18ColumnFamilyHandleEP11_jbyteArrayii+0xe5
C  [librocksdbjni-osx.jnilib+0x40103]  Java_org_rocksdb_RocksDB_get__J_3BII+0x43
j  org.rocksdb.RocksDB.get(J[BII)[B+0
j  org.rocksdb.RocksDB.get([B)[B+9
j  exercise.CheckpointedLongRides$MatchFunction.processElement(Lcom/dataartisans/flinktraining/exercises/datastream_java/datatypes/TaxiRide;Lorg/apache/flink/streaming/api/functions/ProcessFunction$Context;Lorg/apache/flink/util/Collector;)V+19
j  exercise.CheckpointedLongRides$MatchFunction.processElement(Ljava/lang/Object;Lorg/apache/flink/streaming/api/functions/ProcessFunction$Context;Lorg/apache/flink/util/Collector;)V+7
j  org.apache.flink.streaming.api.operators.KeyedProcessOperator.processElement(Lorg/apache/flink/streaming/runtime/streamrecord/StreamRecord;)V+36
J 2612 C1 org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput()Z (387 bytes) @ 0x000000010d0218f4 [0x000000010d020c60+0xc94]
j  org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run()V+13
j  org.apache.flink.streaming.runtime.tasks.StreamTask.invoke()V+221
j  org.apache.flink.runtime.taskmanager.Task.run()V+832
j  java.lang.Thread.run()V+11
v  ~StubRoutines::call_stub
V  [libjvm.dylib+0x2eab0e]
V  [libjvm.dylib+0x2eb29c]
V  [libjvm.dylib+0x2eb448]
V  [libjvm.dylib+0x345965]
V  [libjvm.dylib+0x5612d3]
V  [libjvm.dylib+0x5629ce]
V  [libjvm.dylib+0x48343a]
C  [libsystem_pthread.dylib+0x36c1]  _pthread_body+0x154
C  [libsystem_pthread.dylib+0x356d]  _pthread_body+0x0
C  [libsystem_pthread.dylib+0x2c5d]  thread_start+0xd
C  0x0000000000000000

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j  org.rocksdb.RocksDB.get(J[BII)[B+0
j  org.rocksdb.RocksDB.get([B)[B+9
j  exercise.CheckpointedLongRides$MatchFunction.processElement(Lcom/dataartisans/flinktraining/exercises/datastream_java/datatypes/TaxiRide;Lorg/apache/flink/streaming/api/functions/ProcessFunction$Context;Lorg/apache/flink/util/Collector;)V+19
j  exercise.CheckpointedLongRides$MatchFunction.processElement(Ljava/lang/Object;Lorg/apache/flink/streaming/api/functions/ProcessFunction$Context;Lorg/apache/flink/util/Collector;)V+7
j  org.apache.flink.streaming.api.operators.KeyedProcessOperator.processElement(Lorg/apache/flink/streaming/runtime/streamrecord/StreamRecord;)V+36
J 2612 C1 org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput()Z (387 bytes) @ 0x000000010d0218f4 [0x000000010d020c60+0xc94]
j  org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run()V+13
j  org.apache.flink.streaming.runtime.tasks.StreamTask.invoke()V+221
j  org.apache.flink.runtime.taskmanager.Task.run()V+832
j  java.lang.Thread.run()V+11
v  ~StubRoutines::call_stub

---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
  0x00007fb7a77d3000 JavaThread "pool-13-thread-1" [_thread_blocked, id=65347, stack(0x000070000a69b000,0x000070000a79b000)]
  0x00007fb7a5c0a000 JavaThread "pool-11-thread-1" [_thread_blocked, id=63531, stack(0x000070000a598000,0x000070000a698000)]
  0x00007fb7a485b800 JavaThread "pool-17-thread-1" [_thread_blocked, id=54699, stack(0x000070000a495000,0x000070000a595000)]
  0x00007fb7a42f9000 JavaThread "pool-18-thread-1" [_thread_blocked, id=58655, stack(0x000070000a392000,0x000070000a492000)]
  0x00007fb7a5c0d800 JavaThread "pool-16-thread-1" [_thread_blocked, id=63287, stack(0x000070000a28f000,0x000070000a38f000)]
  0x00007fb7a4183000 JavaThread "pool-14-thread-1" [_thread_blocked, id=66655, stack(0x000070000a18c000,0x000070000a28c000)]
  0x00007fb7a75b6000 JavaThread "pool-12-thread-1" [_thread_blocked, id=59987, stack(0x000070000a089000,0x000070000a189000)]
  0x00007fb7a75b7800 JavaThread "Abandoned connection cleanup thread" daemon [_thread_blocked, id=56083, stack(0x0000700009f86000,0x000070000a086000)]
  0x00007fb7a6e3a800 JavaThread "pool-2-thread-1" [_thread_blocked, id=52995, stack(0x0000700009cfa000,0x0000700009dfa000)]
  0x00007fb7a584a800 JavaThread "pool-3-thread-1" [_thread_blocked, id=52483, stack(0x0000700009bf7000,0x0000700009cf7000)]
  0x00007fb7a491d800 JavaThread "pool-9-thread-1" [_thread_blocked, id=51971, stack(0x0000700009af4000,0x0000700009bf4000)]
  0x00007fb7a4125800 JavaThread "pool-5-thread-1" [_thread_blocked, id=51459, stack(0x00007000099f1000,0x0000700009af1000)]
  0x00007fb7a5045000 JavaThread "pool-6-thread-1" [_thread_blocked, id=50947, stack(0x00007000098ee000,0x00007000099ee000)]
  0x00007fb7a491d000 JavaThread "pool-7-thread-1" [_thread_blocked, id=50435, stack(0x00007000097eb000,0x00007000098eb000)]
  0x00007fb7a4122800 JavaThread "pool-10-thread-1" [_thread_blocked, id=49923, stack(0x00007000096e8000,0x00007000097e8000)]
  0x00007fb7a491c000 JavaThread "pool-8-thread-1" [_thread_blocked, id=49411, stack(0x00007000095e5000,0x00007000096e5000)]
  0x00007fb7a491b800 JavaThread "pool-4-thread-1" [_thread_blocked, id=48899, stack(0x00007000094e2000,0x00007000095e2000)]
  0x00007fb7a4122000 JavaThread "Time Trigger for Source: Custom Source (1/1)" daemon [_thread_blocked, id=48387, stack(0x00007000093df000,0x00007000094df000)]
  0x00007fb7a7090000 JavaThread "flink-akka.actor.default-dispatcher-6" [_thread_in_Java, id=22279, stack(0x0000700006046000,0x0000700006146000)]
  0x00007fb7a3ff7000 JavaThread "Async calls on Source: Custom Source (1/1)" daemon [_thread_blocked, id=47875, stack(0x00007000092dc000,0x00007000093dc000)]
  0x00007fb7a34b6000 JavaThread "Process -> Sink: Unnamed (8/8)" [_thread_in_vm, id=47363, stack(0x00007000091d9000,0x00007000092d9000)]
  0x00007fb7a5080000 JavaThread "OutputFlusher" daemon [_thread_blocked, id=46851, stack(0x00007000090d6000,0x00007000091d6000)]
  0x00007fb7a3c1d000 JavaThread "Process -> Sink: Unnamed (7/8)" [_thread_in_native, id=46339, stack(0x0000700008fd3000,0x00007000090d3000)]
  0x00007fb7a507e800 JavaThread "OutputFlusher" daemon [_thread_blocked, id=45827, stack(0x0000700008ed0000,0x0000700008fd0000)]
  0x00007fb7a40fe800 JavaThread "OutputFlusher" daemon [_thread_blocked, id=45315, stack(0x0000700008dcd000,0x0000700008ecd000)]
  0x00007fb7a1ef5000 JavaThread "OutputFlusher" daemon [_thread_blocked, id=44803, stack(0x0000700008cca000,0x0000700008dca000)]
  0x00007fb7a38e1800 JavaThread "OutputFlusher" daemon [_thread_blocked, id=44291, stack(0x0000700008bc7000,0x0000700008cc7000)]
  0x00007fb7a58d5000 JavaThread "OutputFlusher" daemon [_thread_blocked, id=43779, stack(0x0000700008ac4000,0x0000700008bc4000)]
  0x00007fb7a58d4800 JavaThread "OutputFlusher" daemon [_thread_blocked, id=43267, stack(0x00007000089c1000,0x0000700008ac1000)]
  0x00007fb7a1ef4000 JavaThread "OutputFlusher" daemon [_thread_blocked, id=42755, stack(0x00007000088be000,0x00007000089be000)]
  0x00007fb7a4066000 JavaThread "OutputFlusher" daemon [_thread_blocked, id=42243, stack(0x00007000087bb000,0x00007000088bb000)]
  0x00007fb7a48ba000 JavaThread "Process -> Sink: Unnamed (6/8)" [_thread_blocked, id=41731, stack(0x00007000086b8000,0x00007000087b8000)]
  0x00007fb7a48b9000 JavaThread "Process -> Sink: Unnamed (5/8)" [_thread_in_vm, id=41219, stack(0x00007000085b5000,0x00007000086b5000)]
  0x00007fb7a34ae000 JavaThread "Process -> Sink: Unnamed (4/8)" [_thread_blocked, id=40707, stack(0x00007000084b2000,0x00007000085b2000)]
  0x00007fb7a58ad800 JavaThread "Process -> Sink: Unnamed (3/8)" [_thread_in_vm, id=40195, stack(0x00007000083af000,0x00007000084af000)]
=>0x00007fb7a5026800 JavaThread "Process -> Sink: Unnamed (2/8)" [_thread_in_native, id=39683, stack(0x00007000082ac000,0x00007000083ac000)]
  0x00007fb7a4021000 JavaThread "Process -> Sink: Unnamed (1/8)" [_thread_in_native, id=39171, stack(0x00007000081a9000,0x00007000082a9000)]
  0x00007fb7a4941000 JavaThread "Filter (8/8)" [_thread_blocked, id=38659, stack(0x00007000080a6000,0x00007000081a6000)]
  0x00007fb7a2584000 JavaThread "Filter (7/8)" [_thread_blocked, id=38147, stack(0x0000700007fa3000,0x00007000080a3000)]
  0x00007fb7a40c8800 JavaThread "Filter (6/8)" [_thread_blocked, id=37635, stack(0x0000700007ea0000,0x0000700007fa0000)]
  0x00007fb7a3899000 JavaThread "Filter (5/8)" [_thread_blocked, id=37123, stack(0x0000700007d9d000,0x0000700007e9d000)]
  0x00007fb7a1f3d000 JavaThread "Filter (4/8)" [_thread_blocked, id=36611, stack(0x0000700007c9a000,0x0000700007d9a000)]
  0x00007fb7a24b5800 JavaThread "Filter (3/8)" [_thread_blocked, id=36099, stack(0x0000700007b97000,0x0000700007c97000)]
  0x00007fb7a40c8000 JavaThread "Filter (2/8)" [_thread_blocked, id=35587, stack(0x0000700007a94000,0x0000700007b94000)]
  0x00007fb7a1d83000 JavaThread "Filter (1/8)" [_thread_blocked, id=35075, stack(0x0000700007991000,0x0000700007a91000)]
  0x00007fb7a1d82000 JavaThread "CloseableReaperThread" daemon [_thread_blocked, id=34563, stack(0x000070000788e000,0x000070000798e000)]
  0x00007fb7a2637000 JavaThread "Source: Custom Source (1/1)" [_thread_in_vm, id=34051, stack(0x000070000778b000,0x000070000788b000)]
  0x00007fb7a5040000 JavaThread "Flink-MetricRegistry-thread-1" daemon [_thread_blocked, id=33539, stack(0x0000700007688000,0x0000700007788000)]
  0x00007fb7a25c4800 JavaThread "flink-akka.actor.default-dispatcher-5" [_thread_in_Java, id=33027, stack(0x0000700007585000,0x0000700007685000)]
  0x00007fb7a34ad800 JavaThread "Checkpoint Timer" daemon [_thread_blocked, id=32515, stack(0x0000700007482000,0x0000700007582000)]
  0x00007fb7a21f7000 JavaThread "Timer-2" daemon [_thread_blocked, id=32003, stack(0x000070000737f000,0x000070000747f000)]
  0x00007fb7a34aa000 JavaThread "Timer-1" daemon [_thread_blocked, id=31491, stack(0x000070000727c000,0x000070000737c000)]
  0x00007fb7a21f3000 JavaThread "mini-cluster-future-thread-8" daemon [_thread_blocked, id=30979, stack(0x0000700007179000,0x0000700007279000)]
  0x00007fb7a21f2800 JavaThread "mini-cluster-future-thread-7" daemon [_thread_blocked, id=30467, stack(0x0000700007076000,0x0000700007176000)]
  0x00007fb7a1d81800 JavaThread "mini-cluster-future-thread-6" daemon [_thread_blocked, id=29955, stack(0x0000700006f73000,0x0000700007073000)]
  0x00007fb7a1d80800 JavaThread "mini-cluster-future-thread-5" daemon [_thread_blocked, id=29443, stack(0x0000700006e70000,0x0000700006f70000)]
  0x00007fb7a1c61000 JavaThread "mini-cluster-future-thread-4" daemon [_thread_blocked, id=28931, stack(0x0000700006d6d000,0x0000700006e6d000)]
  0x00007fb7a1e28000 JavaThread "mini-cluster-future-thread-3" daemon [_thread_blocked, id=28419, stack(0x0000700006c6a000,0x0000700006d6a000)]
  0x00007fb7a34a4800 JavaThread "mini-cluster-future-thread-2" daemon [_thread_blocked, id=27907, stack(0x0000700006b67000,0x0000700006c67000)]
  0x00007fb7a34a3800 JavaThread "mini-cluster-future-thread-1" daemon [_thread_blocked, id=27395, stack(0x0000700006a64000,0x0000700006b64000)]
  0x00007fb7a21f6800 JavaThread "IOManager reader thread #1" daemon [_thread_blocked, id=26883, stack(0x0000700006961000,0x0000700006a61000)]
  0x00007fb7a349d000 JavaThread "IOManager writer thread #1" daemon [_thread_blocked, id=26371, stack(0x000070000685e000,0x000070000695e000)]
  0x00007fb7a31ed000 JavaThread "ForkJoinPool-1-worker-9" daemon [_thread_blocked, id=25859, stack(0x000070000675b000,0x000070000685b000)]
  0x00007fb7a1c60800 JavaThread "ForkJoinPool-1-worker-11" daemon [_thread_blocked, id=25347, stack(0x0000700006658000,0x0000700006758000)]
  0x00007fb7a34a1000 JavaThread "ForkJoinPool-1-worker-13" daemon [_thread_blocked, id=24835, stack(0x0000700006555000,0x0000700006655000)]
  0x00007fb7a2331800 JavaThread "BLOB Server listener at 52652" daemon [_thread_in_native, id=24323, stack(0x0000700006452000,0x0000700006552000)]
  0x00007fb7a3491800 JavaThread "Timer-0" daemon [_thread_blocked, id=23811, stack(0x000070000634f000,0x000070000644f000)]
  0x00007fb7a3bdf000 JavaThread "flink-akka.actor.default-dispatcher-4" [_thread_in_vm, id=23299, stack(0x000070000624c000,0x000070000634c000)]
  0x00007fb7a1c04800 JavaThread "flink-akka.actor.default-dispatcher-3" [_thread_blocked, id=22787, stack(0x0000700006149000,0x0000700006249000)]
  0x00007fb7a347a800 JavaThread "flink-scheduler-1" [_thread_blocked, id=3847, stack(0x0000700005f43000,0x0000700006043000)]
  0x00007fb7a20cc800 JavaThread "Service Thread" daemon [_thread_blocked, id=21251, stack(0x0000700005d3d000,0x0000700005e3d000)]
  0x00007fb7a387b000 JavaThread "C1 CompilerThread3" daemon [_thread_in_vm, id=20739, stack(0x0000700005c3a000,0x0000700005d3a000)]
  0x00007fb7a3872800 JavaThread "C2 CompilerThread2" daemon [_thread_in_native, id=20227, stack(0x0000700005b37000,0x0000700005c37000)]
  0x00007fb7a383d800 JavaThread "C2 CompilerThread1" daemon [_thread_in_native, id=19715, stack(0x0000700005a34000,0x0000700005b34000)]
  0x00007fb7a31e8000 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=19203, stack(0x0000700005931000,0x0000700005a31000)]
  0x00007fb7a31e6800 JavaThread "Monitor Ctrl-Break" daemon [_thread_in_native, id=18691, stack(0x000070000582e000,0x000070000592e000)]
  0x00007fb7a181c800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=18439, stack(0x000070000572b000,0x000070000582b000)]
  0x00007fb7a181b800 JavaThread "Finalizer" daemon [_thread_blocked, id=14851, stack(0x0000700005628000,0x0000700005728000)]
  0x00007fb7a3822800 JavaThread "Reference Handler" daemon [_thread_blocked, id=14339, stack(0x0000700005525000,0x0000700005625000)]
  0x00007fb7a3005000 JavaThread "main" [_thread_blocked, id=6659, stack(0x0000700004b07000,0x0000700004c07000)]

Other Threads:
  0x00007fb7a3004000 VMThread [stack: 0x0000700005422000,0x0000700005522000] [id=13827]
  0x00007fb7a1b44000 WatcherThread [stack: 0x0000700005e40000,0x0000700005f40000] [id=21763]

VM state:synchronizing (normal execution)

VM Mutex/Monitor currently owned by a thread:  ([mutex/lock_event])
[0x00007fb7a2901be0] Safepoint_lock - owner thread: 0x00007fb7a3004000
[0x00007fb7a2901c60] Threads_lock - owner thread: 0x00007fb7a3004000

Heap:
 PSYoungGen      total 273408K, used 233548K [0x000000076ab00000, 0x0000000787900000, 0x00000007c0000000)
  eden space 151040K, 95% used [0x000000076ab00000,0x00000007737a68a8,0x0000000773e80000)
  from space 122368K, 73% used [0x000000077bf80000,0x00000007816ec8b0,0x0000000783700000)
  to   space 132096K, 0% used [0x0000000773e80000,0x0000000773e80000,0x000000077bf80000)
 ParOldGen       total 533504K, used 293669K [0x00000006c0000000, 0x00000006e0900000, 0x000000076ab00000)
  object space 533504K, 55% used [0x00000006c0000000,0x00000006d1ec96f0,0x00000006e0900000)
 Metaspace       used 32606K, capacity 33314K, committed 33536K, reserved 1079296K
  class space    used 4405K, capacity 4585K, committed 4608K, reserved 1048576K

Card table byte_map: [0x000000010bd89000,0x000000010c58a000] byte_map_base: 0x0000000108789000

Marking Bits: (ParMarkBitMap*) 0x000000010b2dee20
 Begin Bits: [0x000000011be8a000, 0x000000011fe8a000)
 End Bits:   [0x000000011fe8a000, 0x0000000123e8a000)

Polling page: 0x0000000109985000

CodeCache: size=245760Kb used=7425Kb max_used=7425Kb free=238334Kb
 bounds [0x000000010c934000, 0x000000010d084000, 0x000000011b934000]
 total_blobs=3013 nmethods=2460 adapters=464
 compilation: enabled

Compilation events (10 events):
Event: 12.626 Thread 0x00007fb7a387b000 2781       1       java.io.ObjectStreamClass$Caches::access$200 (4 bytes)
Event: 12.626 Thread 0x00007fb7a387b000 nmethod 2781 0x000000010d077bd0 code [0x000000010d077d20, 0x000000010d077e10]
Event: 12.626 Thread 0x00007fb7a387b000 2786   !   2       java.lang.StringCoding$StringEncoder::encode (179 bytes)
Event: 12.633 Thread 0x00007fb7a387b000 nmethod 2786 0x000000010d077e50 code [0x000000010d0780a0, 0x000000010d078bd8]
Event: 12.633 Thread 0x00007fb7a387b000 2783       2       org.apache.flink.core.memory.ByteArrayOutputStreamWithPos::write (66 bytes)
Event: 12.633 Thread 0x00007fb7a387b000 nmethod 2783 0x000000010d079590 code [0x000000010d079720, 0x000000010d079a68]
Event: 12.633 Thread 0x00007fb7a387b000 2779       2       org.apache.flink.runtime.state.NonClosingCheckpointOutputStream::write (9 bytes)
Event: 12.634 Thread 0x00007fb7a387b000 nmethod 2779 0x000000010d079c10 code [0x000000010d079d80, 0x000000010d079f08]
Event: 12.634 Thread 0x00007fb7a387b000 2776       2       org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory$FsCheckpointStateOutputStream::write (35 bytes)
Event: 12.644 Thread 0x00007fb7a387b000 nmethod 2776 0x000000010d07a550 code [0x000000010d07a6c0, 0x000000010d07a888]

GC Heap History (10 events):
Event: 6.454 GC heap before
{Heap before GC invocations=8 (full 3):
 PSYoungGen      total 76288K, used 10738K [0x000000076ab00000, 0x0000000774000000, 0x00000007c0000000)
  eden space 65536K, 0% used [0x000000076ab00000,0x000000076ab00000,0x000000076eb00000)
  from space 10752K, 99% used [0x000000076eb00000,0x000000076f57ca08,0x000000076f580000)
  to   space 10752K, 0% used [0x0000000773580000,0x0000000773580000,0x0000000774000000)
 ParOldGen       total 175104K, used 125033K [0x00000006c0000000, 0x00000006cab00000, 0x000000076ab00000)
  object space 175104K, 71% used [0x00000006c0000000,0x00000006c7a1a578,0x00000006cab00000)
 Metaspace       used 22104K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3055K, capacity 3163K, committed 3200K, reserved 1048576K
Event: 6.492 GC heap after
Heap after GC invocations=8 (full 3):
 PSYoungGen      total 76288K, used 0K [0x000000076ab00000, 0x0000000774000000, 0x00000007c0000000)
  eden space 65536K, 0% used [0x000000076ab00000,0x000000076ab00000,0x000000076eb00000)
  from space 10752K, 0% used [0x000000076eb00000,0x000000076eb00000,0x000000076f580000)
  to   space 10752K, 0% used [0x0000000773580000,0x0000000773580000,0x0000000774000000)
 ParOldGen       total 297984K, used 130700K [0x00000006c0000000, 0x00000006d2300000, 0x000000076ab00000)
  object space 297984K, 43% used [0x00000006c0000000,0x00000006c7fa3340,0x00000006d2300000)
 Metaspace       used 22104K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3055K, capacity 3163K, committed 3200K, reserved 1048576K
}
Event: 6.501 GC heap before
{Heap before GC invocations=9 (full 3):
 PSYoungGen      total 76288K, used 65536K [0x000000076ab00000, 0x0000000774000000, 0x00000007c0000000)
  eden space 65536K, 100% used [0x000000076ab00000,0x000000076eb00000,0x000000076eb00000)
  from space 10752K, 0% used [0x000000076eb00000,0x000000076eb00000,0x000000076f580000)
  to   space 10752K, 0% used [0x0000000773580000,0x0000000773580000,0x0000000774000000)
 ParOldGen       total 297984K, used 130700K [0x00000006c0000000, 0x00000006d2300000, 0x000000076ab00000)
  object space 297984K, 43% used [0x00000006c0000000,0x00000006c7fa3340,0x00000006d2300000)
 Metaspace       used 22115K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3057K, capacity 3163K, committed 3200K, reserved 1048576K
Event: 6.528 GC heap after
Heap after GC invocations=9 (full 3):
 PSYoungGen      total 111104K, used 10725K [0x000000076ab00000, 0x0000000774000000, 0x00000007c0000000)
  eden space 100352K, 0% used [0x000000076ab00000,0x000000076ab00000,0x0000000770d00000)
  from space 10752K, 99% used [0x0000000773580000,0x0000000773ff9470,0x0000000774000000)
  to   space 10752K, 0% used [0x0000000772b00000,0x0000000772b00000,0x0000000773580000)
 ParOldGen       total 297984K, used 184399K [0x00000006c0000000, 0x00000006d2300000, 0x000000076ab00000)
  object space 297984K, 61% used [0x00000006c0000000,0x00000006cb413c10,0x00000006d2300000)
 Metaspace       used 22115K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3057K, capacity 3163K, committed 3200K, reserved 1048576K
}
Event: 6.543 GC heap before
{Heap before GC invocations=10 (full 3):
 PSYoungGen      total 111104K, used 111077K [0x000000076ab00000, 0x0000000774000000, 0x00000007c0000000)
  eden space 100352K, 100% used [0x000000076ab00000,0x0000000770d00000,0x0000000770d00000)
  from space 10752K, 99% used [0x0000000773580000,0x0000000773ff9470,0x0000000774000000)
  to   space 10752K, 0% used [0x0000000772b00000,0x0000000772b00000,0x0000000773580000)
 ParOldGen       total 297984K, used 184399K [0x00000006c0000000, 0x00000006d2300000, 0x000000076ab00000)
  object space 297984K, 61% used [0x00000006c0000000,0x00000006cb413c10,0x00000006d2300000)
 Metaspace       used 22115K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3057K, capacity 3163K, committed 3200K, reserved 1048576K
Event: 6.649 GC heap after
Heap after GC invocations=10 (full 3):
 PSYoungGen      total 141824K, used 10725K [0x000000076ab00000, 0x0000000783700000, 0x00000007c0000000)
  eden space 131072K, 0% used [0x000000076ab00000,0x000000076ab00000,0x0000000772b00000)
  from space 10752K, 99% used [0x0000000772b00000,0x0000000773579470,0x0000000773580000)
  to   space 122368K, 0% used [0x000000077bf80000,0x000000077bf80000,0x0000000783700000)
 ParOldGen       total 297984K, used 283063K [0x00000006c0000000, 0x00000006d2300000, 0x000000076ab00000)
  object space 297984K, 94% used [0x00000006c0000000,0x00000006d146dca0,0x00000006d2300000)
 Metaspace       used 22115K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3057K, capacity 3163K, committed 3200K, reserved 1048576K
}
Event: 6.649 GC heap before
{Heap before GC invocations=11 (full 4):
 PSYoungGen      total 141824K, used 10725K [0x000000076ab00000, 0x0000000783700000, 0x00000007c0000000)
  eden space 131072K, 0% used [0x000000076ab00000,0x000000076ab00000,0x0000000772b00000)
  from space 10752K, 99% used [0x0000000772b00000,0x0000000773579470,0x0000000773580000)
  to   space 122368K, 0% used [0x000000077bf80000,0x000000077bf80000,0x0000000783700000)
 ParOldGen       total 297984K, used 283063K [0x00000006c0000000, 0x00000006d2300000, 0x000000076ab00000)
  object space 297984K, 94% used [0x00000006c0000000,0x00000006d146dca0,0x00000006d2300000)
 Metaspace       used 22115K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3057K, capacity 3163K, committed 3200K, reserved 1048576K
Event: 6.696 GC heap after
Heap after GC invocations=11 (full 4):
 PSYoungGen      total 141824K, used 0K [0x000000076ab00000, 0x0000000783700000, 0x00000007c0000000)
  eden space 131072K, 0% used [0x000000076ab00000,0x000000076ab00000,0x0000000772b00000)
  from space 10752K, 0% used [0x0000000772b00000,0x0000000772b00000,0x0000000773580000)
  to   space 122368K, 0% used [0x000000077bf80000,0x000000077bf80000,0x0000000783700000)
 ParOldGen       total 533504K, used 293661K [0x00000006c0000000, 0x00000006e0900000, 0x000000076ab00000)
  object space 533504K, 55% used [0x00000006c0000000,0x00000006d1ec76f0,0x00000006e0900000)
 Metaspace       used 22115K, capacity 22418K, committed 22656K, reserved 1069056K
  class space    used 3057K, capacity 3163K, committed 3200K, reserved 1048576K
}
Event: 6.966 GC heap before
{Heap before GC invocations=12 (full 4):
 PSYoungGen      total 141824K, used 131072K [0x000000076ab00000, 0x0000000783700000, 0x00000007c0000000)
  eden space 131072K, 100% used [0x000000076ab00000,0x0000000772b00000,0x0000000772b00000)
  from space 10752K, 0% used [0x0000000772b00000,0x0000000772b00000,0x0000000773580000)
  to   space 122368K, 0% used [0x000000077bf80000,0x000000077bf80000,0x0000000783700000)
 ParOldGen       total 533504K, used 293661K [0x00000006c0000000, 0x00000006e0900000, 0x000000076ab00000)
  object space 533504K, 55% used [0x00000006c0000000,0x00000006d1ec76f0,0x00000006e0900000)
 Metaspace       used 25756K, capacity 26140K, committed 26240K, reserved 1071104K
  class space    used 3538K, capacity 3656K, committed 3712K, reserved 1048576K
Event: 7.009 GC heap after
Heap after GC invocations=12 (full 4):
 PSYoungGen      total 273408K, used 89522K [0x000000076ab00000, 0x0000000787900000, 0x00000007c0000000)
  eden space 151040K, 0% used [0x000000076ab00000,0x000000076ab00000,0x0000000773e80000)
  from space 122368K, 73% used [0x000000077bf80000,0x00000007816ec8b0,0x0000000783700000)
  to   space 132096K, 0% used [0x0000000773e80000,0x0000000773e80000,0x000000077bf80000)
 ParOldGen       total 533504K, used 293669K [0x00000006c0000000, 0x00000006e0900000, 0x000000076ab00000)
  object space 533504K, 55% used [0x00000006c0000000,0x00000006d1ec96f0,0x00000006e0900000)
 Metaspace       used 25756K, capacity 26140K, committed 26240K, reserved 1071104K
  class space    used 3538K, capacity 3656K, committed 3712K, reserved 1048576K
}

Deoptimization events (10 events):
Event: 12.365 Thread 0x00007fb7a3c1d000 Uncommon trap: reason=unstable_if action=reinterpret pc=0x000000010ce83030 method=java.net.URI.match(CJJ)Z @ 19
Event: 12.365 Thread 0x00007fb7a58ad800 Uncommon trap: reason=unstable_if action=reinterpret pc=0x000000010ce83030 method=java.net.URI.match(CJJ)Z @ 19
Event: 12.575 Thread 0x00007fb7a2637000 Uncommon trap: reason=unstable_if action=reinterpret pc=0x000000010d04eeb4 method=org.apache.flink.runtime.io.network.api.serialization.SpanningRecordSerializer.getSerializationResult()Lorg/apache/flink/runtime/io/network/api/serialization/RecordSerialize
Event: 12.618 Thread 0x00007fb7a3c1d000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151
Event: 12.618 Thread 0x00007fb7a34b6000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151
Event: 12.618 Thread 0x00007fb7a5026800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151
Event: 12.618 Thread 0x00007fb7a48b9000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151
Event: 12.618 Thread 0x00007fb7a48ba000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151
Event: 12.618 Thread 0x00007fb7a34ae000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151
Event: 12.618 Thread 0x00007fb7a58ad800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000010ce86ec0 method=java.io.ObjectStreamClass.lookup(Ljava/lang/Class;Z)Ljava/io/ObjectStreamClass; @ 151

Internal exceptions (10 events):
Event: 5.504 Thread 0x00007fb7a3005000 Exception > (0x000000076d47b4c8) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp, line 1591]
Event: 5.511 Thread 0x00007fb7a3005000 Exception > (0x000000076d51f560) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp, line 1591]
Event: 5.524 Thread 0x00007fb7a3005000 Exception > (0x000000076d650750) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp, line 1591]
Event: 5.583 Thread 0x00007fb7a3005000 Exception (0x000000076db94e30) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/methodHandles.cpp, line 1146]
Event: 5.587 Thread 0x00007fb7a3005000 Exception (0x000000076dba29c0) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/methodHandles.cpp, line 1146]
Event: 5.618 Thread 0x00007fb7a3005000 Exception > (0x000000076de56a48) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp, line 1591]
Event: 5.636 Thread 0x00007fb7a3005000 Exception > (0x000000076df9ce50) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp, line 1591]
Event: 5.997 Thread 0x00007fb7a3005000 Implicit null exception at 0x000000010cb30c75 to 0x000000010cb30fe1
Event: 5.997 Thread 0x00007fb7a3005000 Implicit null exception at 0x000000010cb216b5 to 0x000000010cb21a15
Event: 11.780 Thread 0x00007fb7a1c04800 Exception > (0x000000076b876898) thrown at [/Users/java_re/workspace/8-2-build-macosx-x86_64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp, line 1591]

Events (10 events):
Event: 12.646 loading class org/joda/time/chrono/ISOChronologyConstructorAccess
Event: 12.646 loading class org/joda/time/chrono/ISOChronologyConstructorAccess done
Event: 12.646 loading class org/joda/time/chrono/ISOChronologyConstructorAccess
Event: 12.646 loading class org/joda/time/chrono/ISOChronologyConstructorAccess done
Event: 12.646 loading class org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend$RocksDBMergeIterator$1
Event: 12.646 loading class org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend$RocksDBMergeIterator$1 done
Event: 12.646 loading class org/joda/time/chrono/ISOChronologyConstructorAccess
Event: 12.646 loading class org/joda/time/chrono/ISOChronologyConstructorAccess done
Event: 12.646 loading class org/joda/time/chrono/GregorianChronologyConstructorAccess
Event: 12.646 loading class org/joda/time/chrono/GregorianChronologyConstructorAccess done


Dynamic libraries:
0x000000002a235000 /System/Library/Frameworks/Cocoa.framework/Versions/A/Cocoa
0x000000002a235000 /System/Library/Frameworks/Security.framework/Versions/A/Security
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/ApplicationServices
0x000000002a235000 /usr/lib/libz.1.dylib
0x000000002a235000 /usr/lib/libSystem.B.dylib
0x000000002a235000 /usr/lib/libobjc.A.dylib
0x000000002a235000 /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
0x000000002a235000 /System/Library/Frameworks/Foundation.framework/Versions/C/Foundation
0x000000002a235000 /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
0x000000002a235000 /System/Library/Frameworks/CoreData.framework/Versions/A/CoreData
0x000000002a235000 /System/Library/PrivateFrameworks/RemoteViewServices.framework/Versions/A/RemoteViewServices
0x000000002a235000 /System/Library/PrivateFrameworks/UIFoundation.framework/Versions/A/UIFoundation
0x000000002a235000 /System/Library/PrivateFrameworks/DFRFoundation.framework/Versions/A/DFRFoundation
0x000000002a235000 /System/Library/Frameworks/Metal.framework/Versions/A/Metal
0x000000002a235000 /System/Library/PrivateFrameworks/DesktopServicesPriv.framework/Versions/A/DesktopServicesPriv
0x000000002a235000 /usr/lib/libenergytrace.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/SkyLight.framework/Versions/A/SkyLight
0x000000002a235000 /System/Library/Frameworks/CoreGraphics.framework/Versions/A/CoreGraphics
0x000000002a235000 /usr/lib/libScreenReader.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Accelerate
0x000000002a235000 /System/Library/Frameworks/IOSurface.framework/Versions/A/IOSurface
0x000000002a235000 /System/Library/Frameworks/AudioToolbox.framework/Versions/A/AudioToolbox
0x000000002a235000 /System/Library/Frameworks/AudioUnit.framework/Versions/A/AudioUnit
0x000000002a235000 /System/Library/PrivateFrameworks/DataDetectorsCore.framework/Versions/A/DataDetectorsCore
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HIToolbox.framework/Versions/A/HIToolbox
0x000000002a235000 /usr/lib/libicucore.A.dylib
0x000000002a235000 /System/Library/Frameworks/QuartzCore.framework/Versions/A/QuartzCore
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/SpeechRecognition.framework/Versions/A/SpeechRecognition
0x000000002a235000 /usr/lib/libauto.dylib
0x000000002a235000 /usr/lib/libxml2.2.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/CoreUI.framework/Versions/A/CoreUI
0x000000002a235000 /System/Library/Frameworks/CoreAudio.framework/Versions/A/CoreAudio
0x000000002a235000 /System/Library/Frameworks/DiskArbitration.framework/Versions/A/DiskArbitration
0x000000002a235000 /usr/lib/liblangid.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/MultitouchSupport.framework/Versions/A/MultitouchSupport
0x000000002a235000 /System/Library/Frameworks/IOKit.framework/Versions/A/IOKit
0x000000002a235000 /usr/lib/libDiagnosticMessagesClient.dylib
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/CoreServices
0x000000002a235000 /System/Library/PrivateFrameworks/PerformanceAnalysis.framework/Versions/A/PerformanceAnalysis
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/OpenGL
0x000000002a235000 /System/Library/Frameworks/ColorSync.framework/Versions/A/ColorSync
0x000000002a235000 /System/Library/Frameworks/CoreImage.framework/Versions/A/CoreImage
0x000000002a235000 /System/Library/Frameworks/CoreText.framework/Versions/A/CoreText
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/ImageIO
0x000000002a235000 /System/Library/PrivateFrameworks/Backup.framework/Versions/A/Backup
0x000000002a235000 /usr/lib/libarchive.2.dylib
0x000000002a235000 /System/Library/Frameworks/CFNetwork.framework/Versions/A/CFNetwork
0x000000002a235000 /System/Library/Frameworks/SystemConfiguration.framework/Versions/A/SystemConfiguration
0x000000002a235000 /usr/lib/libCRFSuite.dylib
0x000000002a235000 /usr/lib/libc++.1.dylib
0x000000002a235000 /usr/lib/libc++abi.dylib
0x000000002a235000 /usr/lib/system/libcache.dylib
0x000000002a235000 /usr/lib/system/libcommonCrypto.dylib
0x000000002a235000 /usr/lib/system/libcompiler_rt.dylib
0x000000002a235000 /usr/lib/system/libcopyfile.dylib
0x000000002a235000 /usr/lib/system/libcorecrypto.dylib
0x000000002a235000 /usr/lib/system/libdispatch.dylib
0x000000002a235000 /usr/lib/system/libdyld.dylib
0x000000002a235000 /usr/lib/system/libkeymgr.dylib
0x000000002a235000 /usr/lib/system/liblaunch.dylib
0x000000002a235000 /usr/lib/system/libmacho.dylib
0x000000002a235000 /usr/lib/system/libquarantine.dylib
0x000000002a235000 /usr/lib/system/libremovefile.dylib
0x000000002a235000 /usr/lib/system/libsystem_asl.dylib
0x000000002a235000 /usr/lib/system/libsystem_blocks.dylib
0x000000002a235000 /usr/lib/system/libsystem_c.dylib
0x000000002a235000 /usr/lib/system/libsystem_configuration.dylib
0x000000002a235000 /usr/lib/system/libsystem_coreservices.dylib
0x000000002a235000 /usr/lib/system/libsystem_darwin.dylib
0x000000002a235000 /usr/lib/system/libsystem_dnssd.dylib
0x000000002a235000 /usr/lib/system/libsystem_info.dylib
0x000000002a235000 /usr/lib/system/libsystem_m.dylib
0x000000002a235000 /usr/lib/system/libsystem_malloc.dylib
0x000000002a235000 /usr/lib/system/libsystem_network.dylib
0x000000002a235000 /usr/lib/system/libsystem_networkextension.dylib
0x000000002a235000 /usr/lib/system/libsystem_notify.dylib
0x000000002a235000 /usr/lib/system/libsystem_sandbox.dylib
0x000000002a235000 /usr/lib/system/libsystem_secinit.dylib
0x000000002a235000 /usr/lib/system/libsystem_kernel.dylib
0x000000002a235000 /usr/lib/system/libsystem_platform.dylib
0x000000002a235000 /usr/lib/system/libsystem_pthread.dylib
0x000000002a235000 /usr/lib/system/libsystem_symptoms.dylib
0x000000002a235000 /usr/lib/system/libsystem_trace.dylib
0x000000002a235000 /usr/lib/system/libunwind.dylib
0x000000002a235000 /usr/lib/system/libxpc.dylib
0x000000002a235000 /usr/lib/closure/libclosured.dylib
0x000000002a235000 /usr/lib/libbsm.0.dylib
0x000000002a235000 /usr/lib/system/libkxld.dylib
0x000000002a235000 /usr/lib/libOpenScriptingUtil.dylib
0x000000002a235000 /usr/lib/libcoretls.dylib
0x000000002a235000 /usr/lib/libcoretls_cfhelpers.dylib
0x000000002a235000 /usr/lib/libpam.2.dylib
0x000000002a235000 /usr/lib/libsqlite3.dylib
0x000000002a235000 /usr/lib/libxar.1.dylib
0x000000002a235000 /usr/lib/libbz2.1.0.dylib
0x000000002a235000 /usr/lib/liblzma.5.dylib
0x000000002a235000 /usr/lib/libnetwork.dylib
0x000000002a235000 /usr/lib/libapple_nghttp2.dylib
0x000000002a235000 /usr/lib/libpcap.A.dylib
0x000000002a235000 /usr/lib/libboringssl.dylib
0x000000002a235000 /usr/lib/libusrtcp.dylib
0x000000002a235000 /usr/lib/libapple_crypto.dylib
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/FSEvents.framework/Versions/A/FSEvents
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CarbonCore.framework/Versions/A/CarbonCore
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Metadata.framework/Versions/A/Metadata
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/OSServices.framework/Versions/A/OSServices
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/SearchKit.framework/Versions/A/SearchKit
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/AE.framework/Versions/A/AE
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/LaunchServices.framework/Versions/A/LaunchServices
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/DictionaryServices.framework/Versions/A/DictionaryServices
0x000000002a235000 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/SharedFileList.framework/Versions/A/SharedFileList
0x000000002a235000 /System/Library/Frameworks/NetFS.framework/Versions/A/NetFS
0x000000002a235000 /System/Library/PrivateFrameworks/NetAuth.framework/Versions/A/NetAuth
0x000000002a235000 /System/Library/PrivateFrameworks/login.framework/Versions/A/Frameworks/loginsupport.framework/Versions/A/loginsupport
0x000000002a235000 /System/Library/PrivateFrameworks/TCC.framework/Versions/A/TCC
0x000000002a235000 /usr/lib/libmecabra.dylib
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ATS.framework/Versions/A/ATS
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ColorSyncLegacy.framework/Versions/A/ColorSyncLegacy
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/HIServices.framework/Versions/A/HIServices
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/LangAnalysis.framework/Versions/A/LangAnalysis
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/PrintCore.framework/Versions/A/PrintCore
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/QD.framework/Versions/A/QD
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/SpeechSynthesis.framework/Versions/A/SpeechSynthesis
0x000000002a235000 /System/Library/Frameworks/CoreDisplay.framework/Versions/A/CoreDisplay
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vImage.framework/Versions/A/vImage
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/vecLib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libvDSP.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBNNS.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libQuadrature.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libvMisc.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libLAPACK.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libLinearAlgebra.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libSparse.dylib
0x000000002a235000 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libSparseBLAS.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/IOAccelerator.framework/Versions/A/IOAccelerator
0x000000002a235000 /System/Library/PrivateFrameworks/IOPresentment.framework/Versions/A/IOPresentment
0x000000002a235000 /System/Library/PrivateFrameworks/DSExternalDisplay.framework/Versions/A/DSExternalDisplay
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCoreFSCache.dylib
0x000000002a235000 /System/Library/Frameworks/CoreVideo.framework/Versions/A/CoreVideo
0x000000002a235000 /System/Library/PrivateFrameworks/GraphVisualizer.framework/Versions/A/GraphVisualizer
0x000000002a235000 /System/Library/Frameworks/MetalPerformanceShaders.framework/Versions/A/MetalPerformanceShaders
0x000000002a235000 /usr/lib/libFosl_dynamic.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/FaceCore.framework/Versions/A/FaceCore
0x000000002a235000 /System/Library/Frameworks/OpenCL.framework/Versions/A/OpenCL
0x000000002a235000 /usr/lib/libcompression.dylib
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ATS.framework/Versions/A/Resources/libFontParser.dylib
0x000000002a235000 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ATS.framework/Versions/A/Resources/libFontRegistry.dylib
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libJPEG.dylib
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libTIFF.dylib
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libPng.dylib
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libGIF.dylib
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libJP2.dylib
0x000000002a235000 /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libRadiance.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/AppleJPEG.framework/Versions/A/AppleJPEG
0x000000002a235000 /System/Library/PrivateFrameworks/MetalTools.framework/Versions/A/MetalTools
0x000000002a235000 /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSCore.framework/Versions/A/MPSCore
0x000000002a235000 /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSImage.framework/Versions/A/MPSImage
0x000000002a235000 /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSMatrix.framework/Versions/A/MPSMatrix
0x000000002a235000 /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSNeuralNetwork.framework/Versions/A/MPSNeuralNetwork
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGLU.dylib
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGFXShared.dylib
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGL.dylib
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGLImage.dylib
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCVMSPluginSupport.dylib
0x000000002a235000 /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCoreVMClient.dylib
0x000000002a235000 /usr/lib/libcups.2.dylib
0x000000002a235000 /System/Library/Frameworks/Kerberos.framework/Versions/A/Kerberos
0x000000002a235000 /System/Library/Frameworks/GSS.framework/Versions/A/GSS
0x000000002a235000 /usr/lib/libresolv.9.dylib
0x000000002a235000 /usr/lib/libiconv.2.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/Heimdal.framework/Versions/A/Heimdal
0x000000002a235000 /usr/lib/libheimdal-asn1.dylib
0x000000002a235000 /System/Library/Frameworks/OpenDirectory.framework/Versions/A/OpenDirectory
0x000000002a235000 /System/Library/PrivateFrameworks/CommonAuth.framework/Versions/A/CommonAuth
0x000000002a235000 /System/Library/Frameworks/OpenDirectory.framework/Versions/A/Frameworks/CFOpenDirectory.framework/Versions/A/CFOpenDirectory
0x000000002a235000 /System/Library/Frameworks/SecurityFoundation.framework/Versions/A/SecurityFoundation
0x000000002a235000 /System/Library/PrivateFrameworks/APFS.framework/Versions/A/APFS
0x000000002a235000 /usr/lib/libutil.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/AppleSauce.framework/Versions/A/AppleSauce
0x000000002a235000 /System/Library/PrivateFrameworks/LinguisticData.framework/Versions/A/LinguisticData
0x000000002a235000 /usr/lib/libmarisa.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/Lexicon.framework/Versions/A/Lexicon
0x000000002a235000 /usr/lib/libChineseTokenizer.dylib
0x000000002a235000 /usr/lib/libcmph.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/LanguageModeling.framework/Versions/A/LanguageModeling
0x000000002a235000 /System/Library/PrivateFrameworks/CoreEmoji.framework/Versions/A/CoreEmoji
0x000000002a235000 /System/Library/Frameworks/ServiceManagement.framework/Versions/A/ServiceManagement
0x000000002a235000 /System/Library/PrivateFrameworks/BackgroundTaskManagement.framework/Versions/A/BackgroundTaskManagement
0x000000002a235000 /usr/lib/libxslt.1.dylib
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Ink.framework/Versions/A/Ink
0x000000002a235000 /System/Library/PrivateFrameworks/TextureIO.framework/Versions/A/TextureIO
0x000000002a235000 /usr/lib/libate.dylib
0x000000002a235000 /System/Library/PrivateFrameworks/CrashReporterSupport.framework/Versions/A/CrashReporterSupport
0x000000002a235000 /System/Library/PrivateFrameworks/Sharing.framework/Versions/A/Sharing
0x000000002a235000 /System/Library/PrivateFrameworks/IconServices.framework/Versions/A/IconServices
0x000000002a235000 /System/Library/PrivateFrameworks/ProtocolBuffer.framework/Versions/A/ProtocolBuffer
0x000000002a235000 /System/Library/PrivateFrameworks/Apple80211.framework/Versions/A/Apple80211
0x000000002a235000 /System/Library/Frameworks/CoreWLAN.framework/Versions/A/CoreWLAN
0x000000002a235000 /System/Library/PrivateFrameworks/CoreUtils.framework/Versions/A/CoreUtils
0x000000002a235000 /System/Library/Frameworks/IOBluetooth.framework/Versions/A/IOBluetooth
0x000000002a235000 /System/Library/PrivateFrameworks/CoreWiFi.framework/Versions/A/CoreWiFi
0x000000002a235000 /System/Library/Frameworks/CoreBluetooth.framework/Versions/A/CoreBluetooth
0x000000002a235000 /System/Library/PrivateFrameworks/SignpostNotification.framework/Versions/A/SignpostNotification
0x000000002a235000 /System/Library/PrivateFrameworks/DebugSymbols.framework/Versions/A/DebugSymbols
0x000000002a235000 /System/Library/PrivateFrameworks/CoreSymbolication.framework/Versions/A/CoreSymbolication
0x000000002a235000 /System/Library/PrivateFrameworks/Symbolication.framework/Versions/A/Symbolication
0x000000002a235000 /System/Library/PrivateFrameworks/AppleFSCompression.framework/Versions/A/AppleFSCompression
0x000000002a235000 /System/Library/PrivateFrameworks/SpeechRecognitionCore.framework/Versions/A/SpeechRecognitionCore
0x000000010aa00000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/server/libjvm.dylib
0x000000002a235000 /usr/lib/libstdc++.6.0.9.dylib
0x0000000109942000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libverify.dylib
0x0000000109950000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libjava.dylib
0x0000000109986000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libinstrument.dylib
0x00000001099e4000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libzip.dylib
0x000000002a235000 /System/Library/Frameworks/JavaVM.framework/Versions/A/Frameworks/JavaRuntimeSupport.framework/Versions/A/JavaRuntimeSupport
0x000000002a235000 /System/Library/Frameworks/JavaVM.framework/Versions/A/Frameworks/JavaNativeFoundation.framework/Versions/A/JavaNativeFoundation
0x000000002a235000 /System/Library/Frameworks/JavaVM.framework/Versions/A/JavaVM
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Carbon
0x000000002a235000 /System/Library/PrivateFrameworks/JavaLaunching.framework/Versions/A/JavaLaunching
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/CommonPanels.framework/Versions/A/CommonPanels
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Help.framework/Versions/A/Help
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/ImageCapture.framework/Versions/A/ImageCapture
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/OpenScripting.framework/Versions/A/OpenScripting
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Print.framework/Versions/A/Print
0x000000002a235000 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/SecurityHI.framework/Versions/A/SecurityHI
0x00000001296ce000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libnet.dylib
0x0000000129847000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libmanagement.dylib
0x0000000129855000 /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/libnio.dylib
0x000000012c90d000 /private/var/folders/c2/wvlg_dts42bgc1gm6ws8n9gr0000gn/T/rocksdb-lib-6445759b5387d9c63be049324c56e5b4/librocksdbjni-osx.jnilib

VM Arguments:
jvm_args: -javaagent:/Applications/IntelliJ IDEA CE.app/Contents/lib/idea_rt.jar=52632:/Applications/IntelliJ IDEA CE.app/Contents/bin -Dfile.encoding=UTF-8
java_command: exercise.CheckpointedLongRides --input /Users/abc/MyFiles/workspace/flink-java-project/data/nycTaxiRides.gz
java_class_path (initial): /Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_60.jdk/Contents/Home/lib/dt.jar:/Library/Ja
Launcher Type: SUN_STANDARD

Environment Variables:
PATH=/opt/local/bin:/opt/local/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/go/bin:/opt/X11/bin:/usr/local/share/dotnet:/Library/Frameworks/Mono.framework/Versions/Current/Commands:/Users/abc/Downloads/:/Applications/TextMate.app/Contents/Resources/:/Users/abc/MyFiles/apache-maven-3.3.3/bin:/Users/abc/MyFiles/apache-ant-1.8.4/bin
SHELL=/bin/bash
DISPLAY=/private/tmp/com.apple.launchd.325nrLM7WW/org.macosforge.xquartz:0

Signal Handlers:
SIGSEGV: [libjvm.dylib+0x5a6d31], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_ONSTACK|SA_RESTART|SA_SIGINFO
SIGBUS: [libjvm.dylib+0x5a6d31], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGFPE: [libjvm.dylib+0x480a4c], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGPIPE: [libjvm.dylib+0x480a4c], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGXFSZ: [libjvm.dylib+0x480a4c], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGILL: [libjvm.dylib+0x480a4c], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGUSR1: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none
SIGUSR2: [libjvm.dylib+0x48056a], sa_mask[0]=00100000000000000000000000000000, sa_flags=SA_RESTART|SA_SIGINFO
SIGHUP: [libjvm.dylib+0x47eb41], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGINT: [libjvm.dylib+0x47eb41], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGTERM: [libjvm.dylib+0x47eb41], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGQUIT: [libjvm.dylib+0x47eb41], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO


---------------  S Y S T E M  ---------------

OS:Bsduname:Darwin 17.2.0 Darwin Kernel Version 17.2.0: Fri Sep 29 18:27:05 PDT 2017; root:xnu-4570.20.62~3/RELEASE_X86_64 x86_64
rlimit: STACK 8192k, CORE 0k, NPROC 1418, NOFILE 10240, AS infinity
load average:3.48 2.38 2.25

CPU:total 8 (4 cores per cpu, 2 threads per core) family 6 model 70 stepping 1, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, lzcnt, ht, tsc, tscinvbit, bmi1, bmi2

Memory: 4k page, physical 16777216k(38744k free)

/proc/meminfo:


vm_info: Java HotSpot(TM) 64-Bit Server VM (25.60-b23) for bsd-amd64 JRE (1.8.0_60-b27), built on Aug  4 2015 10:47:24 by "java_re" with gcc 4.2.1 (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)

time: Wed Apr  4 06:52:56 2018
elapsed time: 12 seconds (0d 0h 0m 12s)

Monday, March 05, 2018

hadoop-101

雖然懶人包的標題是hadoop-101, 但並不完全只是hadoop, 而是補蹲若干年前沒好好蹲的馬步, 首先從過程中參考到眾多文獻裡節錄多次翻閱的連結:

https://www.jianshu.com/p/d862337247b1

懶人包涵蓋了zookeeper + hadoop(HA + federation) + hbase + phoenix, 首先我們先看到懶人包所需要4台機器, 每台機器的配置如下圖所示:
懶人包所需resource可以從github下載:
https://github.com/cyu021/hadoop-101

以下是懶人包的使用步驟:
>> step-01
- download hadoop-base.box and import to vagrant box
- download vagrant resources for hadoop-01, hadoop-02, hadoop-03, hadoop-04

>> step-02 [apply to hadoop-01, hadoop-02, hadoop-03, hadoop-04]
$ cd {path-hadoop-xx}
$ vagrant up && vagrant ssh -c 'sudo su -'
$ ifconfig eth1
把ip記下來並更新到各自node下的hosts-iphone (eg. .../hadoop-01/cfg/hosts/hosts-iphone)檔案中

$ exit
離開vm

$ vagrant provision && vagrant ssh -c 'sudo su -'


>> step-03 [apply to hadoop-01, hadoop-02, hadoop-03]
$ /opt/zookeeper/bin/zkServer.sh start

$ /opt/zookeeper/bin/zkCli.sh
addauth digest super:AAAaaa111
quit
第一次做就可以, 之後啟動VM時不用做

$ echo stat | nc localhost 2181

>> step-04 [apply to hadoop-01]
$ /opt/hadoop/bin/hdfs zkfc -formatZK
第一次做就可以, 之後啟動VM時不用做

>> step-05 [apply to hadoop-01, hadoop-02, hadoop-03]
$ /opt/hadoop/sbin/hadoop-daemon.sh start journalnode

>> step-06 [apply to hadoop-01]
$ /opt/hadoop/bin/hdfs namenode -format
第一次做就可以, 之後啟動VM時不用做

>> step-07 [apply to hadoop-01]
$ /opt/hadoop/sbin/hadoop-daemon.sh start namenode

>> step-08 [apply to hadoop-02]
$ /opt/hadoop/bin/hdfs namenode -bootstrapStandby && /opt/hadoop/sbin/hadoop-daemon.sh start namenode
第一次做就可以, 之後啟動VM時用下面的command
$ /opt/hadoop/sbin/hadoop-daemon.sh start namenode

>> step-09 [apply to hadoop-01, hadoop-02]
$ /opt/hadoop/sbin/hadoop-daemon.sh start zkfc

>> step-10 [apply to hadoop-01, hadoop-02, hadoop-03]
$ /opt/hadoop/sbin/hadoop-daemon.sh start datanode

>> step-11 [apply to hadoop-01, hadoop-02]
$ /opt/hadoop/sbin/yarn-daemon.sh start resourcemanager

>> step-12 [apply to hadoop-01, hadoop-02, hadoop-03]
$ jps
每個node應該看到的process (ignore PID):
-- hadoop-01
3282 QuorumPeerMain
3827 ResourceManager
3365 JournalNode
3461 NameNode
3701 DataNode
3878 Jps
3613 DFSZKFailoverController

-- hadoop-02
3360 JournalNode
3457 NameNode
3713 DataNode
3608 DFSZKFailoverController
3278 QuorumPeerMain
3839 ResourceManager
4063 Jps

-- hadoop-03
3539 Jps
3368 JournalNode
3467 DataNode
3279 QuorumPeerMain

>> step-13
open http://{hadoop-01}:9870/ in browser

open http://{hadoop-02}:9870/ in browser

>> step-14 [apply to hadoop-04]
$ cd /opt/hbase/bin && ./start-hbase.sh
$ jps
應該看到的prcoess (ignore PID):
3996 Jps
3582 HMaster
3727 HRegionServer

$ cd /opt/phoenix/bin && ./queryserver.py

>> step-14 [apply on laptop]
- copy phoenix-4.13.1-HBase-1.3-thin-client.jar from hadoop-04 (/opt/phoenix/phoenix-4.13.1-HBase-1.3-thin-client.jar) to laptop
- add jar to squirrel or any other db client
- setup jdbc driver with phoenix-4.13.1-HBase-1.3-thin-client.jar

- setup connection and connect

Friday, March 02, 2018

Unable to connect to Apache Phoenix with Squirrel

I can run sqlline.py without a problem, but I am unable to connect to Phoenix with Squirrel.

sqlline.py's screenshot:


Squirrel's screenshot:

In Squirrel's screenshot, we can see the hostname "hadoop-01" is successfully translated into IP and the connection is established. The zookeeper's log also shows the establishment:

Following is the phoenix client driver config and jdbc url setting:







Sunday, July 30, 2017

Private cloud deployment end to end walkthrough

之前已經有試過在local開發環境佈建kubernetes派的private cloud, 但光有cloud的基礎設施而沒有上層APP對開發者而言還時沒什麼用, 所以趁颱風天試著把最後一哩路走通, 雖然cloud這件事已經被講爛了, 我還是要用下面這張圖當作開頭

* 想要玩玩ICP的朋友們可以參照這裡的安裝步驟(https://github.com/cyu021/ICP_Local_Install), 安裝完畢之後我們就得到了一個可立即提供服務的private cloud.

我們自建的private cloud當然也能使用public APP store所提供的APP services, 但是會自建private cloud一定是想要跑自建的APP, 而這些自建的APP又不方便放到public APP store中, 因此今天要探討的是要如何將自建的APP deploy上我們的private cloud.

首先我們可以看到透過kubernetes所建置的cluster所運行的runtime service其實都是透過docker image所提供, 為了讓kubernetes有效率的部署這些docker images, 有人跳出來做了HELM (https://helm.sh/), 上圖所提到的Charts便是HELM裡面的一個模組, 專門封裝docker image資訊供kubernetes的部署時參考.

因此為了要能夠將自建的APP部署至kubernetes cluster中, 我們需要先建置自己的repo與相對應的image & package, 這方面的資訊其實也不少可以參照以下連結:
建置docker repo --> https://www.linuxtechi.com/setup-docker-private-registry-centos-7-rhel-7/
打包自建APP的docker image --> https://docs.docker.com/engine/userguide/eng-image/baseimages/
建置charts repo --> https://kairen.github.io/2017/03/25/kubernetes/helm-quickstart/
打包自建APP的chart package --> https://deis.com/blog/2016/getting-started-authoring-helm-charts/

建置完成之後我們需要將新建立的charts repo設定至ICP中, 這樣ICP才會知道多了一個source可安裝APP, 設定過程如下:
1. 點擊左上角的功能鍵
2. 選擇System
3. 選擇Repositories
4. 選擇Add Repository
5. 輸入所需資訊存檔後便會在清單中看到新的charts repo

新增完成Charts repo後, 我們便可以安裝我們自建的APP, 過程如下:
1. 點擊左上角的功能鍵
2. 選擇App Center
3. 從App Center裡面即可看到新增repo中的APP
4. 點擊Install Package並填寫必要資訊
5. 安裝成功後即可使用該APP提供的服務


好的, 介紹到這裡相信各位朋友已經對如何將自建APP部署至我們自建的private cloud了然於胸, 從開發者的角度來看或許這樣已經足夠, 但對於專營cloud事業的朋友們這樣算是非常淺薄, 更深入的介紹就留待未來細細探討了.

Sunday, July 23, 2017

Deploy IBM Cloud Private (ICP) In 60 Minutes

For those who try to build private cloud with k8s (aka. kubernetes), now you have another choice -- IBM Cloud Private (ICP). Follow the summarized procedures provided in github (https://github.com/cyu021/ICP_Local_Install) and your very first private cloud should be up and running in 60 minutes.

Friday, November 27, 2015

BJ4...

BJ4...

Not so long ago...

Ways of doing DevOps

Remove blocking factors on artifact

Remove blocking factors on human resource

Remove blocking factors on environment

Life-cycle for a CR used to be

New life-cycle for a CR

I am not a DevOps engineer


圖片來源:

  • http://iosallinone.blogspot.tw/2014/06/5-favorite-devops-memes.html
  • http://www.devopsdays.org/events/2013-mountainview/
  • http://frankhinek.com/wp-content/uploads/2014/10/2014-10-07_devops-tools-feat.png
  • https://developer.ibm.com/bluemix/2015/05/06/share-xcode-projects-bluemix-devops-services/
  • http://dev2ops.org/wp-content/uploads/2014/06/DevOpsEntOpsObjects.jpg
  • http://devops.com/2014/03/27/devops-lessons-learned-the-devops-engineer/
  • http://peggyriley.com/2015/09/06/the-shark-and-the-iceberg-2/