Odd behaviour - Shutting down due to unsafe conditions

Hi all

I’m starting to see some behaviour with the sequence aborting for no apparent reason, and the recovery mode not activating. As a secondary, the notification to GNS seems odd also…

So, last night was perfectly clear - my CloudWatcher logs confirm that, with temperature steady at 5degC. I was shooting M106, 2 minute subs in RGB, guiding at every 2 seconds (my normal).

Camera is an AtikOne6.0, Mount is an AZEQ6, guide camera is an AtikGP.

Started the sequence at just before 10pm. Here is extract from the log for the first frame:

[02/25/19 21:56:16.958][DEBUG] [Sequence Thread] Finished sending frame capture.  Entering wait mode...
[02/25/19 21:56:16.958][DEBUG] [Sequence Thread] EventMarker 11 - t:M106 (0); e:0; f:0; o:
[02/25/19 21:56:16.959][DEBUG] [Sequence Thread] EventMarker 12 - t:M106 (0); e:0; f:0; o:
[02/25/19 21:56:16.964][DEBUG] [Sequence Thread] Handling monitoring event (Good Night System, Status): (M106) Starting integration of M106; Event 1; Frame 1 for 120s...
[02/25/19 21:56:16.964][DEBUG] [Sequence Thread] GNS: Sent status message to GNS ((M106) Starting integration of M106; Event 1; Frame 1 for 120s...)...
[02/25/19 21:56:16.965][DEBUG] [Sequence Thread] Handling monitoring event (Good Night System, TimedError): (M106) Failure while integrating M106; Event 1; Frame 1 for 120s. Image has not downloaded in alloted time period.
[02/25/19 21:56:16.965][DEBUG] [Sequence Thread] GNS: Sent timed event to GNS...
[02/25/19 21:56:16.965][DEBUG] [Sequence Thread] EventMarker 13 - t:M106 (0); e:0; f:0; o:
[02/25/19 21:56:16.968][DEBUG] [Camera Thread] SGM_CAMERA_CAPTURE message received...
[02/25/19 21:56:16.970][DEBUG] [Camera Thread] SetAscomNormalSpeed... 
[02/25/19 21:56:16.970][DEBUG] [Camera Thread] Readout speed set to NORMAL...
[02/25/19 21:56:20.248][DEBUG] [PHD2 Listener Thread] PHD2: Settle done received: GOOD
[02/25/19 21:58:17.114][DEBUG] [Sequence Thread] EventMarker 15 - t:M106 (0); e:0; f:0; o:
[02/25/19 21:58:17.114][DEBUG] [Sequence Thread] Waking from exposure time sleep period...
[02/25/19 21:58:17.114][DEBUG] [Sequence Thread] Checking to see if the CCD has a temp...
[02/25/19 21:58:17.114][DEBUG] [Sequence Thread] Saving the CCD temp...
[02/25/19 21:58:17.118][DEBUG] [Sequence Thread] Entering super dangerous loop to await image completion...
[02/25/19 21:58:17.121][DEBUG] [Sequence Thread] EventMarker 16 - t:M106 (0); e:0; f:0; o:
[02/25/19 21:58:25.884][DEBUG] [Camera Thread] SGM_CAMERA_CAPTURE complete...
[02/25/19 21:58:26.135][DEBUG] [Sequence Thread] EventMarker 17 - t:M106 (0); e:0; f:0; o:
[02/25/19 21:58:26.135][DEBUG] [Sequence Thread] Image reported as complete.  Continuing...
[02/25/19 21:58:26.148][DEBUG] [Sequence Thread] Collecting FITs headers...
[02/25/19 21:58:26.151][DEBUG] [Sequence Thread] ASCOM Camera: Could not get last exposure start time.  Reported as (unknown)
[02/25/19 21:58:26.151][DEBUG] [Sequence Thread] DATE-LOC time provided by SGPro (failed to retrieve valid entry from camera)...
[02/25/19 21:58:26.170][DEBUG] [Sequence Thread] GatherFitsHeaders: Writing header info for last solve...
[02/25/19 21:58:26.170][DEBUG] [Sequence Thread] GatherFitsHeaders: Writing header info from UI...
[02/25/19 21:58:26.172][DEBUG] [Sequence Thread] Clearing timed monitoring events...
[02/25/19 21:58:26.175][DEBUG] [Sequence Thread] Created full file name (file does not exist): D:\Capture\M106\M106_Light_Red_2019-02-25_0001.fit
[02/25/19 21:58:26.175][DEBUG] [Sequence Thread] SaveFileAscom: Start...
[02/25/19 21:58:26.175][DEBUG] [Sequence Thread] SaveFileAscom: Checking image data...
[02/25/19 21:58:26.175][DEBUG] [Sequence Thread] SaveFileAscom: Create normal preview bitmap...
[02/25/19 21:58:26.179][DEBUG] [Sequence Thread] SaveFileAscom: Locking preview bits...
[02/25/19 21:58:26.179][DEBUG] [Sequence Thread] SaveFileAscom: Validating file name...
[02/25/19 21:58:26.179][DEBUG] [Sequence Thread] SaveFileAscom: Starting byte traversal...
[02/25/19 21:58:27.052][DEBUG] [Sequence Thread] SaveFileAscom: Unlocking preview bits...
[02/25/19 21:58:27.052][DEBUG] [Sequence Thread] SaveFileAscom: Saving preview bitmap to disk...
[02/25/19 21:58:27.052][DEBUG] [Sequence Thread] SaveFileBmp16: Locking bitmap for disk write...
[02/25/19 21:58:27.052][DEBUG] [Sequence Thread] SaveFileBmp16: Opening file stream...
[02/25/19 21:58:27.052][DEBUG] [Sequence Thread] SaveFileBmp16: Writing FITS headers...
[02/25/19 21:58:27.053][DEBUG] [Sequence Thread] SaveFileBmp16: Traversing and persisting bitmap data...
[02/25/19 21:58:27.161][DEBUG] [Sequence Thread] SaveFileBmp16: FITS block fill...
[02/25/19 21:58:27.161][DEBUG] [Sequence Thread] SaveFileBmp16: Unlocking bitmap...
[02/25/19 21:58:27.161][DEBUG] [Sequence Thread] SaveFileBmp16: Closing file stream
[02/25/19 21:58:27.171][DEBUG] [Sequence Thread] SaveFileAscom: Displaying image preview in UI...
[02/25/19 21:58:27.171][DEBUG] [Sequence Thread] Internal Interface: Set Preview...
[02/25/19 21:58:27.171][DEBUG] [Sequence Thread] Display image preview using asynch task...
[02/25/19 21:58:27.302][DEBUG] [Main Thread] --> Find stars (normal)
[02/25/19 21:58:27.342][DEBUG] [Main Thread] AF frame was too large... downsample = 0.75...
[02/25/19 21:58:29.503][DEBUG] [Main Thread] Star detection using min star size of 4px...
[02/25/19 21:58:29.503][DEBUG] [Main Thread] Star detection using max star size of 80px...
[02/25/19 21:58:29.658][DEBUG] [Main Thread] Find stars took: 2355 ms...
[02/25/19 21:58:29.658][DEBUG] [Main Thread] Star list contains 196 stars...
[02/25/19 21:58:29.658][DEBUG] [Main Thread] Calculating HFR with sample size: 6
[02/25/19 21:58:29.964][DEBUG] [Sequence Thread] SaveFileAscom: Done
[02/25/19 21:58:29.964][DEBUG] [Sequence Thread] =========== Save file took 3790 ms

Here is the extract for when the sequence aborted at just after 11:13pm

[02/25/19 23:13:27.754][DEBUG] [Sequence Thread] Distance stayed below 2 for 0 seconds, done settling...
[02/25/19 23:13:27.754][DEBUG] [Sequence Thread] Auto guider has settled...
[02/25/19 23:13:27.758][DEBUG] [Sequence Thread] EventMarker 8 - t:M106 (0); e:0; f:23; o:
[02/25/19 23:13:27.758][DEBUG] [Sequence Thread] EventMarker 9 - t:M106 (0); e:0; f:23; o:
[02/25/19 23:13:27.758][DEBUG] [Sequence Thread] EventMarker 10 - t:M106 (0); e:0; f:23; o:
[02/25/19 23:13:27.758][DEBUG] [Sequence Thread] Finished sending frame capture.  Entering wait mode...
[02/25/19 23:13:27.758][DEBUG] [Sequence Thread] EventMarker 11 - t:M106 (0); e:0; f:23; o:
[02/25/19 23:13:27.758][DEBUG] [Sequence Thread] EventMarker 12 - t:M106 (0); e:0; f:23; o:
[02/25/19 23:13:27.759][DEBUG] [Sequence Thread] Handling monitoring event (Good Night System, Status): (M106) Starting integration of M106; Event 1; Frame 24 for 120s...
[02/25/19 23:13:27.759][DEBUG] [Sequence Thread] GNS: Sent status message to GNS ((M106) Starting integration of M106; Event 1; Frame 24 for 120s...)...
[02/25/19 23:13:27.767][DEBUG] [Camera Thread] SGM_CAMERA_CAPTURE message received...
[02/25/19 23:13:27.769][DEBUG] [Camera Thread] SetAscomNormalSpeed... 
[02/25/19 23:13:27.769][DEBUG] [Camera Thread] Readout speed set to NORMAL...
[02/25/19 23:13:27.859][DEBUG] [Sequence Thread] Handling monitoring event (Good Night System, TimedError): (M106) Failure while integrating M106; Event 1; Frame 24 for 120s. Image has not downloaded in alloted time period.
[02/25/19 23:13:27.859][DEBUG] [Sequence Thread] GNS: Sent timed event to GNS...
[02/25/19 23:13:27.859][DEBUG] [Sequence Thread] EventMarker 13 - t:M106 (0); e:0; f:23; o:
[02/25/19 23:14:04.419][DEBUG] [Safety Thread] Adding sequence level notification: Shutting down due to Unsafe Conditions.
[02/25/19 23:14:04.420][DEBUG] [Safety Thread] Sending Notification: Error - Shutting down due to Unsafe Conditions.
[02/25/19 23:14:04.420][DEBUG] [Safety Thread] Handling monitoring event (Good Night System, Error): (M106) Shutting down due to Unsafe Conditions.
[02/25/19 23:14:04.420][DEBUG] [Safety Thread] GNS: Sent error message to GNS ((M106) Shutting down due to Unsafe Conditions.)...
[02/25/19 23:14:04.420][DEBUG] [Safety Thread] Shutting down due to Unsafe Conditions...
[02/25/19 23:14:04.570][DEBUG] [Camera Thread] ASCOM Camera: abort message received...
[02/25/19 23:14:04.570][DEBUG] [Camera Thread] ASCOM Camera: Attempting to abort exposure...
[02/25/19 23:14:04.570][DEBUG] [Camera Thread] ASCOM Camera: Asking camera to abort...
[02/25/19 23:14:04.573][DEBUG] [Camera Thread] ASCOM Camera: Camera has acknowledged abort request...
[02/25/19 23:14:04.573][DEBUG] [Camera Thread] ASCOM Camera: Blocking until image is aborted...
[02/25/19 23:14:04.573][DEBUG] [Camera Thread] ASCOM Camera: Image is aborted...
[02/25/19 23:14:04.573][DEBUG] [Camera Thread] SGM_CAMERA_CAPTURE complete...
[02/25/19 23:14:04.667][DEBUG] [Sequence Thread] ASCOM Camera: Attempting to abort exposure...
[02/25/19 23:14:04.668][DEBUG] [Sequence Thread] ASCOM Camera: Asking camera to abort...
[02/25/19 23:14:04.670][DEBUG] [Sequence Thread] ASCOM Camera: Camera has acknowledged abort request...
[02/25/19 23:14:04.670][DEBUG] [Sequence Thread] ASCOM Camera: Blocking until image is aborted...
[02/25/19 23:14:04.670][DEBUG] [Sequence Thread] ASCOM Camera: Image is aborted...
[02/25/19 23:14:04.670][DEBUG] [Sequence Thread] Run event requested sequence abort...
[02/25/19 23:14:04.670][DEBUG] [Sequence Thread] ********* Run post sequence *********
[02/25/19 23:14:04.670][DEBUG] [Sequence Thread] SGPro capture cal frame mode is OFF...
[02/25/19 23:14:04.670][DEBUG] [Sequence Thread] Clearing timed monitoring events...
[02/25/19 23:14:04.670][DEBUG] [Sequence Thread] Checking RunEndOfSequenceEquipmentOptions, force = True
[02/25/19 23:14:04.670][DEBUG] [Sequence Thread] In RunEndOfSequenceEquipmentOptions
[02/25/19 23:14:36.129][DEBUG] [Sequence Thread] Stopping auto guiding...
[02/25/19 23:14:36.130][DEBUG] [Sequence Thread] Attempting to stop PHD2 guiding...
[02/25/19 23:14:36.130][DEBUG] [Sequence Thread] Checking PHD2 state...

The line at [02/25/19 23:14:04.419] is where it shuts down to unsafe conditions. There is nothing in the PHD logs to suggest an issue, and the AAG reports Clear/Dry/Dark at this time.

How can I find out what the unsafe condition is?
At [02/25/19 23:13:27.859] there is a GNS Error, image has not downloaded in time - this happens on every frame. Is this an actual error and if so, what is causing it?

Any help to solve this, greatly appreciated!

Thanks
Daz

What are you using for your safety device? If you’re using the boltwood one line file or if SGP gets a very brief “Unsafe” indication it will cause a shutdown.

You would need to look at the log from your safety device. SGP only receives a single status from this “Safe” or “Unsafe”, so the Safety Device should have the information about what caused the unsafe event.

Thanks,
Jared