Mongo Fatal Crash
Anonymous
PROOP

6 months ago

MongoDB ran out of volume, which is when I upgraded the volume size to 20GB, and as soon as I tried to start the database, it started crashing immediately. This is probably because of some file corruption. Any ways to fix this on the railway since there's no way to SSH?

Mounting volume on: /var/lib/containers/railwayapp/bind-mounts/5b1827b2-c9cc-4562-9c5a-9f78c15e1a3a/vol_a2po2kgue1ixv61k

Jun 16 12:12:45

Starting Container

Jun 16 12:12:54

MongoDB starting

Jun 16 12:12:54

Applied --setParameter options

Jun 16 12:12:54

Memory available to mongo process is less than total system memory

Jun 16 12:12:54

Initialized wire specification

Jun 16 12:12:54

Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'

Jun 16 12:12:54

Build Info

Jun 16 12:12:54

Operating System

Jun 16 12:12:54

Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize.

Jun 16 12:12:54

Successfully registered PrimaryOnlyService

Jun 16 12:12:54

Options set by command line

Jun 16 12:12:54

Successfully registered PrimaryOnlyService

Jun 16 12:12:54

Storage engine to use detected by data files

Jun 16 12:12:54

Multi threading initialized

Jun 16 12:12:54

Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem

Jun 16 12:12:54

Starting TenantMigrationAccessBlockerRegistry

Jun 16 12:12:54

Opening WiredTiger

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

WiredTiger error message

Jun 16 12:12:54

Fatal assertion

Jun 16 12:12:54

***aborting after fassert() failure

Jun 16 12:12:54

Writing fatal message

Jun 16 12:12:54

Writing fatal message

Jun 16 12:12:54

Frame

Jun 16 12:12:54

BACKTRACE

Jun 16 12:12:54

Frame

Jun 16 12:12:54

Frame

Jun 16 12:12:54

Frame

Jun 16 12:12:54

Frame

Jun 16 12:12:54

Frame

Jun 16 12:12:54

Frame

Jun 16 12:12:54

Frame

Jun 16 12:12:54

Frame

Jun 16 12:12:54

Frame

Jun 16 12:12:54

Frame

Jun 16 12:12:54

Frame

Jun 16 12:12:54

Frame

Solved

3 Replies

jake
EMPLOYEE

6 months ago

You should be able to:

  • Set start command sleep infinity

  • SSH into the box and run the mongo script to drop the WAL (I think it's mongod --repair --dbpath /var/lib/mongodb but you might have to poke around and check)

  • Remove the sleep infinity startup command


Status changed to Awaiting User Response Railway 6 months ago


jake
EMPLOYEE

6 months ago

You can ssh using the CLI railway ssh


Anonymous
PROOP

6 months ago

Thank you! Didn't know about railway ssh - did the trick :)


Status changed to Awaiting Railway Response Railway 6 months ago


Status changed to Solved Anonymous 6 months ago


Loading...