SIGSEGV on Linux with v1.0

Having a serious issue here where I’ve updated CockroachDB to the latest version on Arch Linux and now it won’t start at all. This also happens on a newly-created database as well as my pre-existing database. With a new database, it will create the database and successfully launch, but if you stop the database and later restart it, you’ll get a segmentation fault and an exit status of 2.

cockroach start --insecure --logtostderr
I170512 12:48:34.572646 1 cli/start.go:575  CockroachDB CCL v1.0-dirty (linux amd64, built 2017/05/12 16:31:12, go1.8.1)
I170512 12:48:34.674051 9 cli/start.go:338  starting cockroach node
W170512 12:48:34.674214 9 server/server.go:162  running in insecure mode, this is strongly discouraged. See --insecure.
W170512 12:48:34.679413 9 server/config_unix.go:106  soft open file descriptor limit 4096 is under the recommended limit 15000; this may decrease performance
please see https://www.cockroachlabs.com/docs/recommended-production-settings.html for more details
I170512 12:48:34.679741 9 storage/engine/rocksdb.go:380  opening rocksdb instance at "/mnt/archive/Sources/personal-website/new_database/cockroach-data"
I170512 12:48:35.212325 9 server/config.go:421  1 storage engine initialized
fatal error: unexpected signal during runtime execution
[signal SIGSEGV: segmentation violation code=0x80 addr=0x0 pc=0x16c96ba]

runtime stack:
runtime.throw(0x1a29101, 0x2a)
	/usr/lib/go/src/runtime/panic.go:596 +0x95
runtime.sigpanic()
	/usr/lib/go/src/runtime/signal_unix.go:274 +0x2db

goroutine 9 [syscall, locked to thread]:
non-Go function
	pc=0x16c96ba
non-Go function
	pc=0x16ca39a
non-Go function
	pc=0x15a505b
non-Go function
	pc=0x15a5361
non-Go function
	pc=0x15a5eeb
runtime.cgocall(0x14375e0, 0xc4205cca10, 0x17631a0)
	/usr/lib/go/src/runtime/cgocall.go:131 +0xe2 fp=0xc4205cc9b8 sp=0xc4205cc978
github.com/cockroachdb/cockroach/pkg/storage/engine._Cfunc_DBIterSeek(0x7ff220c3d438, 0xc4201d6930, 0x6, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	github.com/cockroachdb/cockroach/pkg/storage/engine/_obj/_cgo_gotypes.go:441 +0x6f fp=0xc4205cca10 sp=0xc4205cc9b8
github.com/cockroachdb/cockroach/pkg/storage/engine.(*rocksDBIterator).Seek.func2(0x7ff220c3d438, 0xc4201d6930, 0x6, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/storage/engine/rocksdb.go:1338 +0xc2 fp=0xc4205ccad8 sp=0xc4205cca10
github.com/cockroachdb/cockroach/pkg/storage/engine.(*rocksDBIterator).Seek(0xc420071800, 0xc4201d6930, 0x6, 0x6, 0x0, 0x0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/storage/engine/rocksdb.go:1338 +0x1b8 fp=0xc4205ccd48 sp=0xc4205ccad8
github.com/cockroachdb/cockroach/pkg/storage/engine.mvccGetMetadata(0x2688b00, 0xc420071800, 0xc4201d6930, 0x6, 0x6, 0x0, 0x0, 0xc42050e180, 0x20391800, 0xc420391800, ...)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/storage/engine/mvcc.go:624 +0x87 fp=0xc4205ccee0 sp=0xc4205ccd48
github.com/cockroachdb/cockroach/pkg/storage/engine.mvccGetUsingIter(0x7ff2295830e8, 0xc4201c2750, 0x2688b00, 0xc420071800, 0xc4201d6930, 0x6, 0x6, 0x0, 0x0, 0x7ff229583001, ...)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/storage/engine/mvcc.go:566 +0x229 fp=0xc4205cd080 sp=0xc4205ccee0
github.com/cockroachdb/cockroach/pkg/storage/engine.MVCCGet(0x7ff2295830e8, 0xc4201c2750, 0x2681fa0, 0xc4200bd3f0, 0xc4201d6930, 0x6, 0x6, 0x0, 0x0, 0x1, ...)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/storage/engine/mvcc.go:547 +0x164 fp=0xc4205cd128 sp=0xc4205cd080
github.com/cockroachdb/cockroach/pkg/storage/engine.MVCCGetProto(0x7ff2295830e8, 0xc4201c2750, 0x2681fa0, 0xc4200bd3f0, 0xc4201d6930, 0x6, 0x6, 0x0, 0xc400000000, 0xc420594901, ...)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/storage/engine/mvcc.go:458 +0xbf fp=0xc4205cd1d8 sp=0xc4205cd128
github.com/cockroachdb/cockroach/pkg/storage.ReadStoreIdent(0x7ff2295830e8, 0xc4201c2750, 0x2689da0, 0xc4200bd3f0, 0x0, 0x0, 0x0, 0x2af2968, 0x0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/storage/store.go:1107 +0x2aa fp=0xc4205cd2a0 sp=0xc4205cd1d8
github.com/cockroachdb/cockroach/pkg/server.(*Server).Start(0xc42068e480, 0x7ff2295830e8, 0xc4201c2750, 0xc420078a00, 0x1)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:665 +0xe52 fp=0xc4205cd890 sp=0xc4205cd2a0
github.com/cockroachdb/cockroach/pkg/cli.runStart.func1.1(0x7ff2295830e8, 0xc4201995c0, 0xc420740158, 0xc420594960, 0xc42019bef0, 0x0, 0x0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/cli/start.go:357 +0x210 fp=0xc4205cdf48 sp=0xc4205cd890
github.com/cockroachdb/cockroach/pkg/cli.runStart.func1(0x7ff2295830e8, 0xc4201995c0, 0x2687ac0, 0x2af2968, 0xc420740158, 0xc420594960, 0xc42019bef0, 0xc420683ec0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/cli/start.go:414 +0xdf fp=0xc4205cdfa0 sp=0xc4205cdf48
runtime.goexit()
	/usr/lib/go/src/runtime/asm_amd64.s:2197 +0x1 fp=0xc4205cdfa8 sp=0xc4205cdfa0
created by github.com/cockroachdb/cockroach/pkg/cli.runStart
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/cli/start.go:417 +0x3b6

goroutine 1 [select]:
github.com/cockroachdb/cockroach/pkg/cli.runStart(0x2656360, 0xc4201d8160, 0x0, 0x2, 0x0, 0x0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/cli/start.go:426 +0xe02
github.com/cockroachdb/cockroach/pkg/cli.MaybeDecorateGRPCError.func1(0x2656360, 0xc4201d8160, 0x0, 0x2, 0xc4206e3c90, 0x1429018)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/cli/error.go:35 +0x5a
github.com/cockroachdb/cockroach/pkg/cli.MaybeShoutError.func1(0x2656360, 0xc4201d8160, 0x0, 0x2, 0x0, 0x0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/cli/error.go:66 +0x51
github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra.(*Command).execute(0x2656360, 0xc4201d80e0, 0x2, 0x2, 0x2656360, 0xc4201d80e0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:644 +0x3f8
github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra.(*Command).ExecuteC(0x26528e0, 0x551f9e, 0xc42048abf0, 0xc4206e3f10)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:734 +0x339
github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra.(*Command).Execute(0x26528e0, 0xc4206e3f00, 0xc42048abc0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:693 +0x2b
github.com/cockroachdb/cockroach/pkg/cli.Run(0xc420078110, 0x3, 0x3, 0xc4200723c0, 0xc4200723c0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/cli/cli.go:136 +0x6d
github.com/cockroachdb/cockroach/pkg/cli.Main()
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/cli/cli.go:51 +0x17f
main.main()
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/main.go:28 +0x20

goroutine 17 [syscall, locked to thread]:
runtime.goexit()
	/usr/lib/go/src/runtime/asm_amd64.s:2197 +0x1

goroutine 19 [chan receive]:
github.com/cockroachdb/cockroach/pkg/util/log.(*loggingT).flushDaemon(0x2ab6140)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/log/clog.go:1024 +0x77
created by github.com/cockroachdb/cockroach/pkg/util/log.init.1
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/log/clog.go:566 +0xd9

goroutine 5 [syscall]:
os/signal.signal_recv(0x0)
	/usr/lib/go/src/runtime/sigqueue.go:116 +0x104
os/signal.loop()
	/usr/lib/go/src/os/signal/signal_unix.go:22 +0x22
created by os/signal.init.1
	/usr/lib/go/src/os/signal/signal_unix.go:28 +0x41

goroutine 24 [chan receive]:
github.com/cockroachdb/cockroach/pkg/util/netutil.MakeServer.func2(0x7ff2295830e8, 0xc420268000)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:102 +0x70
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201d6630, 0xc420594960, 0xc4201ee1a0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 7 [select, locked to thread]:
runtime.gopark(0x1ac32c0, 0x0, 0x19f0267, 0x6, 0x18, 0x2)
	/usr/lib/go/src/runtime/proc.go:271 +0x13a
runtime.selectgoImpl(0xc42003bf50, 0x0, 0x18)
	/usr/lib/go/src/runtime/select.go:423 +0x1364
runtime.selectgo(0xc42003bf50)
	/usr/lib/go/src/runtime/select.go:238 +0x1c
runtime.ensureSigM.func1()
	/usr/lib/go/src/runtime/signal_unix.go:434 +0x2dd
runtime.goexit()
	/usr/lib/go/src/runtime/asm_amd64.s:2197 +0x1

goroutine 8 [chan receive]:
github.com/cockroachdb/cockroach/pkg/util/log.(*loggingT).gcDaemon(0x2ab6140)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/log/clog.go:1058 +0x5f
created by github.com/cockroachdb/cockroach/pkg/util/log.StartGCDaemon
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/log/clog.go:579 +0x41

goroutine 10 [chan receive]:
github.com/cockroachdb/cockroach/pkg/rpc.NewContext.func1(0x7ff2295830e8, 0xc420076870)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:176 +0x76
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4200735f0, 0xc420594960, 0xc4201d8460)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 11 [select]:
github.com/cockroachdb/cockroach/pkg/kv.(*TxnCoordSender).printStatsLoop(0xc420717ba0, 0x7ff2295830e8, 0xc42038e000)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn_coord_sender.go:253 +0xb4a
github.com/cockroachdb/cockroach/pkg/kv.NewTxnCoordSender.func1(0x7ff2295830e8, 0xc42038e000)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn_coord_sender.go:237 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201b2020, 0xc420594960, 0xc4201b2010)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 12 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*LeaseManager).RefreshLeases.func1(0x7ff2295830e8, 0xc42038e030)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/sql/lease.go:1240 +0xaf5
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201b22b0, 0xc420594960, 0xc420367110)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 13 [select]:
github.com/cockroachdb/cockroach/pkg/server.(*Server).refreshSettings.func2(0x7ff2295830e8, 0xc420076f00)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/server/settingsworker.go:113 +0x38b
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201b22c0, 0xc420594960, 0xc4201d8c00)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 25 [chan receive]:
github.com/cockroachdb/cockroach/pkg/util/netutil.MakeServer.func2(0x7ff2295830e8, 0xc420268030)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:102 +0x70
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201d6670, 0xc420594960, 0xc4201ee1e0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 26 [chan receive]:
github.com/cockroachdb/cockroach/pkg/server.(*Server).Start.func2(0x7ff2295830e8, 0xc420508030)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:525 +0x5f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201d6700, 0xc420594960, 0xc4201ee560)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 27 [IO wait]:
net.runtime_pollWait(0x7ff22961bd10, 0x72, 0x0)
	/usr/lib/go/src/runtime/netpoll.go:164 +0x59
net.(*pollDesc).wait(0xc42055e538, 0x72, 0x0, 0xc4201e0000)
	/usr/lib/go/src/net/fd_poll_runtime.go:75 +0x38
net.(*pollDesc).waitRead(0xc42055e538, 0xffffffffffffffff, 0x0)
	/usr/lib/go/src/net/fd_poll_runtime.go:80 +0x34
net.(*netFD).accept(0xc42055e4d0, 0x0, 0x2669000, 0xc4201e0000)
	/usr/lib/go/src/net/fd_unix.go:430 +0x1e5
net.(*TCPListener).accept(0xc42000e050, 0xc420268180, 0x180c320, 0x263e070)
	/usr/lib/go/src/net/tcpsock_posix.go:136 +0x2e
net.(*TCPListener).Accept(0xc42000e050, 0xc420268150, 0x180c320, 0x263e070, 0x18f6ee0)
	/usr/lib/go/src/net/tcpsock.go:228 +0x49
net/http.(*Server).Serve(0xc4200bd080, 0x267aa00, 0xc42000e050, 0x0, 0x0)
	/usr/lib/go/src/net/http/server.go:2643 +0x228
github.com/cockroachdb/cockroach/pkg/server.(*Server).Start.func5(0x7ff2295830e8, 0xc420268060)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:548 +0x42
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201d6710, 0xc420594960, 0xc4201ee580)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 28 [chan receive]:
github.com/cockroachdb/cockroach/pkg/server.(*Server).Start.func6(0x7ff2295830e8, 0xc42023c000)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:552 +0x88
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201d6720, 0xc420594960, 0xc42048a200)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 29 [chan receive]:
github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux.(*muxListener).Accept(0xc4201ee440, 0x1ac2608, 0xc4204e37a0, 0x267b400, 0xc4201ee440)
	<autogenerated>:9 +0x7a
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*Server).Serve(0xc4204e37a0, 0x267b400, 0xc4201ee440, 0x0, 0x0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/server.go:396 +0x189
github.com/cockroachdb/cockroach/pkg/server.(*Server).Start.func7(0x7ff2295830e8, 0xc4202681e0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:563 +0x43
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201d6730, 0xc420594960, 0xc4201ee5c0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 30 [select]:
github.com/cockroachdb/cockroach/pkg/server.(*Server).Start.func9(0x7ff2295830e8, 0xc4202e2990)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:612 +0x2b9
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201d6750, 0xc420594960, 0xc42048a240)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 31 [chan receive]:
github.com/cockroachdb/cockroach/pkg/gossip.(*server).start.func3(0x7ff2295830e8, 0xc42023c030)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/gossip/server.go:386 +0x66
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201d67d0, 0xc420594960, 0xc4201ee680)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 32 [select]:
github.com/cockroachdb/cockroach/pkg/gossip.(*Gossip).bootstrap.func1(0x7ff2295830e8, 0xc42023c120)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/gossip/gossip.go:1048 +0x49d
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201d67f0, 0xc420594960, 0xc4201d67e0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 33 [select]:
github.com/cockroachdb/cockroach/pkg/gossip.(*Gossip).manage.func1(0x7ff2295830e8, 0xc420268210)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/gossip/gossip.go:1086 +0x325
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc4201d6810, 0xc420594960, 0xc4201d6800)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:215 +0xf7
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:216 +0xad

goroutine 50 [chan receive]:
github.com/cockroachdb/cockroach/pkg/storage/engine.(*RocksDB).open.func2(0xc4200bd3f0)
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/storage/engine/rocksdb.go:431 +0x44
created by github.com/cockroachdb/cockroach/pkg/storage/engine.(*RocksDB).open
	/home/mmstick/yaourt/cockroachdb/src/go/src/github.com/cockroachdb/cockroach/pkg/storage/engine/rocksdb.go:432 +0x4c1

This error is a symptom of you using a CockroachDB binary whose code exploits CPU features which your particular hardware processor does not support. Last time this came up this was due to us using SSE4.x where the underlying architecture didn’t, but I think our Makefile now disables SSE optimizations automatically on dev builds, and you seem to be using a dev build.

Could you detail a bit:

  • which commands did you use to build CockroachDB? did you provide particular flags? Are you using an Arch-specific build script for CockroachDB?
  • what processor are you running this on? What’s in /proc/cpuinfo?

Thanks in advance for the details!

Another idea from an internal discussion, @mmstick. Are you, by chance, building out of our Git repository? And did you just git pull && git checkout v1.0 to get the latest version? If so, it’s possible you might be able to fix the problem with a make clean. (Our build system sometimes fails to remove build artifacts from older builds that had different versions of dependencies/compiler flags, etc. It’s a known problem we’re working on.)

@benesch @knz The AUR PKGBUILD doesn’t build it. It merely grabs the precompiled binary from https://binaries.cockroachdb.com/cockroach-v1.0.linux-amd64.tgz

As for the hardware I’m running, it’s a first generation FX-8120.

The log messages you’ve pasted above indicate: CockroachDB CCL v1.0-dirty

This suggests a custom build, not the binary downloaded from our release archive. Are you sure you are running our release binary?

If you’re using https://aur.archlinux.org/packages/cockroachdb/, that package recently changed to build from source instead of just grabbing the binary.