David's Astronomy Pages Notes - Session 1325 (2025-05-14)

Notes (S1325A)

Notes Main

Home Page

Notes (S1326)

	Session Aims & Highlights
	- Observing Result  - Night Summary Plot  - Session Event Log
	Operational Issues
	- Critical Issues (0),  Major Issues (1),  Minor Issues (1),  Small Defects (1),  Continuous Improvement (3)
	- Figures (1)
	Images from 2025-05-14  >>
	Review - Image Timed-Out Failures & CCD Camera Freezes
	Geomagnetic Station - Operation (2025-05-14 to 2025-06-11)

Session Aims & Highlights (2025-05-14)

Main aims

1. Targets.  Acquire images of a selection of variable stars, nearby stars, comets & deep sky targets as allowed by sky conditions.

 Equipment & Software

• 12" LX200 and ST-10XME
• 80mm APO and ZWO ASI 178MC
• TheSky6, CCDSoft5, DeviceHub 7.0.3 RC3.4694, MeadeGeneric 1.3.12.522 , UPB 1.5,  Pulsar Dome Firmware 1.51 & Driver 6.3.10
• Pegasus UPB & Motor Focus, TCF-S 6.0.6
• SharpCap 3.2, PHD2  2.6.13, Siril 1.0.6, deCONZ 1.18.2, ASCOM 7.0.3 RC3
• [ DomeLink 1.0 / 1.1 - not used ]
   
• AstroMain 3.74.13,  AstroPlan 1.43.7,  AstroShCap 1.3.15, AstroGuard 1.10.6   (any new items or versions in bold)
  AstroMag 1.4.9, AstroVOE 1.15.1,  AstroSN 1.14,  AstroProtect 1.10.6,  AstroMove 1.16
  AstroWeather 1.27.9, AstroAllSky 3.23.5,  AstroObsCam 1.11.4 (not 1.11.5), AstroNorthCam 1.3, AstroLaunch 1.13.1

Highlights

• Targets.  9/12 planned target observations were fully completed.  The other targets failed due to missed start (software bug whilst centering Near Zenith Focus Field )n.
• CCD Camera. There was 2 issues with the CCDCamera freezing but were automatically resolved.
•   Dome. There was no issues opening/closing the shutter during the session. Dome closed and parked at end of session ok.

Notes

Summary Plots & Logs

Observing Plan

Observing Result

Dome & Scope Slewing Performance

Slew/Centering Performance

Guiding Performance

Sky Conditions (Locate Frames)

Night Sky Summary Plot Top axis: Sky Brightness at Zenith (in ADU/s) Lefthand axis: Local Time (hh LT). Righthand axis: Sun Altitude (degs)

Actual Weather vs Pre-Session Weather Forecast

Session Event Log

Time     Event Detail 22:09:55 Session Monitoring AutoStart monitoring for Live Session opportunity between 22:53 & 02:03 22:10:00   AutoStart Waiting AutoStart waiting till earliest start time at 22:53 22:53:55   AutoStart Delayed Session delayed due to too few stars 23:14:58 Session AutoStarting Session autostarting (23:14) 23:15:11   CCDSoft Restarting CCDSoft being restarted (to set AutoSave No.) 23:15:38   Camera1 Connected SBIG Camera connected (Set point -15°C) 23:15:40 Session Created Session Created (Live, 2025-05-14 S01325, ImageSaveNum: 1325001) 23:15:45   Scope Switched On Telescope Power has been switched on via UPB Powerbox. 23:17:33   Services Started Observatory Services started 23:17:41 Observatory (Auto) Observatory placed in Fully-Automated Mode 23:17:43   AutoStart Delayed Session delayed due to too few stars 23:17:46 Session Pending Session pending (2025-05-14) 23:17:48 Session Initiating Session initiating (2025-05-14) 23:17:55   Camera1 Connected SBIG Camera connected (Set point -15°C) 23:18:02   Plan Requested Observing Plan requested from AstroPlan (1.43.7) 23:19:12   Plan Loaded Observing Plan loaded to queue (Plan ID: 1110) 23:19:54   Telescope Connected Telescope connected (TheSky6) 23:20:18 Session Equilibration Session ready to Open Dome 23:21:04   Dome Opened Dome opened (Opening time 46s, Zigbee 40s) 23:21:06 Session Running Session running 23:21:09   Queue Started Observing Queue started (12 targets selected) 23:21:11     Target Started (NrZen) Target started (Focus Field 14, HIP 69068) 23:21:24       Dome Unparked Dome unparked 23:58:08 User Intervention User Intervention to abort job queue & switch back to Manual Mode 23:58:10   Queue Aborted Job Queue aborted 23:58:12 Observatory (Manual) Observatory placed in Manual Mode 00:13:18   Services Stopped Observatory Services stopped 00:13:21 Session Closed Session closed by User 00:13:24 Program Closed Program closed by User 00:14:36 Program Opened Program Opened (AstroMain 3.74.14) 00:14:38   CCDSoft Restarting CCDSoft being restarted (to set AutoSave No.) 00:14:52 Session Resumed Session Resumed (Live, 2025-05-14 S01325, ImageSaveNum: 1325075) 00:14:58   Obs.Overseer Started Obs.Overseer started 00:15:19   Obs.Manager Started Obs.Manager started 00:15:28   Services Started Observatory Services started 00:15:47 Session Monitoring AutoStart monitoring for Live Session opportunity between 00:15 & 02:03 00:15:49 Observatory (AutoStart) Observatory placed in Auto-Start Mode 00:16:05 Session AutoStarting Session autostarting (00:16) 00:17:02   Services Started Observatory Services started 00:17:10 Observatory (Auto) Observatory placed in Fully-Automated Mode 00:17:12 Session Pending Session pending (2025-05-14) 00:17:14 Session Initiating Session initiating (2025-05-14) 00:17:22   Camera1 Connected SBIG Camera connected (Set point -15°C) 00:17:27   Plan Loaded Observing Plan loaded to queue (Plan ID: 1110) 00:17:39   Telescope Connected Telescope connected (TheSky6) 00:18:02 Session Running Session running 00:18:05   Queue Started Observing Queue started (10 targets selected) 00:18:08     Target Started (NrZen) Target started (Focus Field 15, HIP 73454) 00:23:01       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S) 00:23:56   SBIG Camera Take Image failed (Command timed-out) 00:24:16   CcdCamera Frozen CcdCamera appears to be frozen at around 00:24 in section 'SetCameraProperties / BinX/BinY' 00:24:51   CCDSoft Restarting CCDSoft being restarted (attempt to fix frozen CcdCamera) 00:24:58   SBIG Camera Reset SBIG Camera being power-cycled 00:25:51   Camera1 Connected SBIG Camera connected (Set point -15°C) 00:26:02   SBIG Camera Take Image successfully completed (earlier flags are reset) 00:27:38   SBIG Camera Take Image failed (Command timed-out) 00:27:39   CcdCamera Frozen CcdCamera appears to be frozen at around 00:27 in section 'SetCameraProperties / AutoSaveOn' 00:28:11   CCDSoft Restarting CCDSoft being restarted (attempt to fix frozen CcdCamera) 00:28:18   SBIG Camera Reset SBIG Camera being power-cycled 00:29:12   Camera1 Connected SBIG Camera connected (Set point -15°C) 00:29:30   CcdCamera Frozen CcdCamera appears to be frozen at around 00:29 in section 'GetCameraProperties / State' 00:30:06   CCDSoft Restarting CCDSoft being restarted (attempt to fix frozen CcdCamera) 00:30:13   SBIG Camera Reset SBIG Camera being power-cycled 00:31:07   Camera1 Connected SBIG Camera connected (Set point -15°C) 00:31:12   SBIG Camera Take Image successfully completed (earlier flags are reset) 00:31:54       Focusing Completed Foc1 AutoFocus Completed (Profile No 1, wide) 00:34:14       Focusing Completed Foc1 AutoFocus Completed (Profile No 1) 00:34:16       Focusing Started-Foc2 Foc2 Focusing Started (Secondary Scope, using ShCap) 00:36:09       Focusing Completed Foc2 AutoFocus Completed (Profile No 2, wide) 00:38:00       Focusing Completed Foc2 AutoFocus Completed (Profile No 2) 00:38:21     Target Completed (NrZen) Target completed (Focus Field 15, HIP 73454) 00:38:26     Target Started (3/12) Target started (3/12, AT2024xpy) 00:38:30     Target Failed (3/12) Target failed due to missed start time (3/12, AT2024xpy) 00:41:31     Target Started (4/12) Target started (4/12, AT2024aeey) 00:45:40       Focusing Skipped Foc1 focusing skipped - star is too dim (TCF-S) 01:01:54     Target Completed Target completed (4/12, AT2024aeey) 01:03:50     Target Started (5/12) Target started (5/12, GCVS BL Lac) 01:07:25       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S) 01:10:01       Focusing Completed Foc1 AutoFocus Completed (Profile No 3) 01:14:02     Target Completed Target completed (5/12, GCVS BL Lac) 01:14:06     Target Started (6/12) Target started (6/12, UGC 12131 w/SN2025jyl) 01:18:19       Focusing Skipped Foc1 focusing skipped - star is too dim (TCF-S) 01:34:49     Target Completed Target completed (6/12, UGC 12131 w/SN2025jyl) 01:36:28     Target Started (7/12) Target started (7/12, T CrB) 01:40:41       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S) 01:43:12       Focusing Completed Foc1 AutoFocus Completed (Profile No 4) 01:48:08     Target Completed Target completed (7/12, T CrB) 01:48:12     Target Started (8/12) Target started (8/12, NGC 5957 w/SN2025fvw) 01:52:20       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S) 01:55:12       Focusing Completed Foc1 AutoFocus Completed (Profile No 5) 02:11:40     Target Completed Target completed (8/12, NGC 5957 w/SN2025fvw) 02:11:44     Target Started (9/12) Target started (9/12, AT2025kej (CV)) 02:27:02     Target Completed Target completed (9/12, AT2025kej (CV)) 02:27:06     Target Started (10/12) Target started (10/12, GCVS CY Lyr) 02:30:29       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S) 02:32:58       Focusing Completed Foc1 AutoFocus Completed (Profile No 6) 02:36:57     Target Completed Target completed (10/12, GCVS CY Lyr) 02:37:01     Target Started (11/12) Target started (11/12, 61 Cyg) 02:39:23       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S) 02:41:54       Focusing Completed Foc1 AutoFocus Completed (Profile No 7) 02:43:56     Target Completed Target completed (11/12, 61 Cyg) 02:44:00     Target Started (12/12) Target started (12/12, IC 4408 w/SN2025kfm) 03:08:02     Target Completed Target completed (12/12, IC 4408 w/SN2025kfm) 03:08:04   Queue Completed Job Queue completed 03:08:06 Session Closing Session closing 03:09:02   Dome Closed Dome closed (Closing time 50s, Zigbee 43s) 03:10:22   Dome Parked Dome parked (parking time 73s), Az: 90.0 deg 03:11:02   Telescope Parked Telescope parked (parking time 38s total) 03:11:26   Telescope State Handbox reads 'Scope parked Turn scope off.' 03:11:48   Telescope Switched Off Telescope Power has been switched off via UPB Switch. 03:13:14   Services Stopped Night Services stopped 03:13:17 Session Finishing Session Finishing started (Create Fits Summary, Transfer Files) 03:13:34     Dome (Find Park) Find Park started (Search Az 88.0 to 92.0°, Step 0.2°, Narrow) 03:14:19     Dome Find Park found (Best Park Az 90.6°) 03:14:25     Dome Dome has been synced at park position (Az 90.0°, Adjustment: -0.6°) 03:14:27   Dome Parked Dome parked 03:14:47   Dome Charging Dome is parked and re-charging Ok (5mA) 03:14:49 Session Finished Session Finished

Session Alerts & Alarms

Time     Type       Name Detail 00:23:56 Red Alert SBIG Camera Alert Take Image failed (Command timed-out) 00:24:49 Red Alert CcdCamera CcdCamera appears to be frozen (last cycle at 00:24:16) in section 'SetCameraProperties / BinX/BinY' 00:26:02 Green Clear SBIG Camera Take Image successfully completed (earlier flags are reset) 00:27:38 Red Alert SBIG Camera Alert Take Image failed (Command timed-out) 00:28:09 Red Alert CcdCamera CcdCamera appears to be frozen (last cycle at 00:27:38) in section 'SetCameraProperties / AutoSaveOn' 00:30:04 Red Alert CcdCamera CcdCamera appears to be frozen (last cycle at 00:29:30) in section 'GetCameraProperties / State' 00:31:12 Green Clear SBIG Camera Take Image successfully completed (earlier flags are reset) 03:14:47 Green Clear Dome Charging Dome is parked and re-charging Ok (5mA)

Back to Top

Operational Issues (2025-05-14, S1325)

• Critical Issues (0)
• Major Issues (1)
• Minor Issues (1)
• Small Defects (1)
• Continuous Improvement (3)
• Figures (1)
  

[ Prev | Next ]

Critical Issues

• None

Major Issues

• Job Executor in new version of AstroMain stuck in an infinite loop taking Locate Frame 1 (23:22). Between 23:22 and 23:57 the job executor took around 74 locate frames for Near Zenith Focus Field, until the issue was spotted and a manual interventation made to abort the job queue. This happened whilst running the recently installed AstroMain 3.74.13.   Locate Frames where acquired and image linked, but things didn't progress to 'Review Pointing Error' and 'Adjust Position stages, and the Locate Frame 1 was exited only to repeat again, in a continuous cycle.  Issue was investigated as a priority and the bug (a couple of logic errors associated bCcdImageAcquired and ilocate variables in CentreTarget() routine that were introduced by recent program modification to improve handling of situations where an image fails to be acquired)  was quickly identified and fixed.  A new version 3.74.14 was installed onto the Observatory Computer and the session restarted at 00:14.  The issue is ranked as 'Major' as without user intervention the program would have continued taking Locate Frame 1 for Near Zenith Focus Field Target until the end of session and none of the planned targets would have been acquired.
   Fixed in-session 2025-05-14 (AstroMain 3.74.14, User Awareness)

Minor Issues

• Several Image Failures with frozen CCDCamera during Near Zenith Foc1 Focusing (00:24 - 00:30). There were two 'SBIG Camera' red alerts at 00:23:56 &  00:27:38 with the message "Take Image failed (Command timed-out)". Associated with these there were three 'CCDCamera' red alerts at 00:24:49,  00:28:09 & 00:30:04 with messages like red  "CcdCamera appears to be frozen (last cycle at 00:24:16) in section 'SetCameraProperties / BinX/BinY'". Upon each frozen CCDCamera condition ( triggered when the CCDCamera has been pending for 30s) a RestartCCDSoft operation was commanded, which temporarily resolved the Camera issue, but the issue can in some cases appear again just minutes later. A separate Continuous Improvement ticket has been raised to make some specific improvements to image acquistion and error handling during Foc1 Focusing.
   Automatically resolved in-session 2025-05-15 (Session, CCDCamera, AstroMain)

Small Defects

• Job Executor still reporting  'Camera.TakeImageTask is taking a long time?' when RestartCCDSoft() is running (00:28 ).  Although there was a modification to disable the reporting of 'Camera.TakeImageTask ... taking a long time?' warning message if RestartCCDSoft() routine is executing the message still occured in AstroMain 3.74.14.   Bug found and fixed (there was a second code section where reporting needed to be disabled.  Fixed in AstroMain 3.74.15.
   Fixed 2025-05-15 (AstroMain 3.74.15)

Continuous Improvement

• Make improvements to image acquistion & error handling during Foc1 Focusing. In recent sessions including the S1325 session there have been a lot of Image Time-Out Failures and associated frozen CCDCamera conditions during Foc1 Focusing (most usually during Near Zenith Foc1 Focusing)  Whilst the failures are seemingly fairly random and image failures can also occur whilst collecting locate frames / main frames it seem to be an issue that is predominantly asssociated with Foc1 Focus Profiling. This might provide a lead in finding the source of the problem or conditions most prone to triggering . In the meantime a number of improvements should be made to minimise the disruption caused by the occurance of the issue.  Improvements fall into improving the sequencing of report and log messages, acting immediately to resolve the problem, minimizing the loss of data and risk that a focus run fails as a consequence of the issue. Improvements added to AstroMain 3.74.15.   Needs a live test to check that improvements work and that there are no side effects.
   Done 2025-05-15 (AstroMain 3.74.15)
   
• Present Crooktree Magnetometer Chart with the same time scale as AstroMag's magnetometer charts. The SAMNET Crooktree Station at Torphins (44 km away) is the closest magnetometer station to the Clair Observatory's Geomagnetic Station and is therefore the most relevant station for validating the Clair magnetometer readings and for understanding how local magnetic fields in NE Scotland compares with stations in Shetlands and in Scandinavia.  Implemented using AstroMag 1.4.10 & AstroPlan 1.43.8 , plus changes/additions to website 'allsky_aurora_watch.htm' & 'observatory_status.htm'  (see comparison plots )
   Done 2025-05-15 (AstroMag 1.4.10, AstroPlan 1.43.8, Website)
   
• Create a process whereby cropped image of birds and unidentified objects in Tapo NorthCam Images can be recorded. Daytime images taken with NorthCam Camera,  frequently contain birds. possible birds/insects and possibly unidentified flying objects.  However there are too many images to review individually and with the object captured in just a single frame, they are difficult to review in a video and almost impossible to freeze the video on the relevant frame.  It is proposed to create a process which creates difference images and identify objects of interest and to then saved a cropped image for user review.  An initial implementation has been made in AstroNorthCam 1.3.2 that processes images from a session and outputs images containing birds and/or other objects of interest to folder like TapoCam\Objects\2025-05-21 with birds and/or other object highlighted by a white rectangle (see Fig 1).  The routine produced false-positive around dusk time and during night.   This is because the process is designed to look for dark pixels/objects that are not presented in the previous image.  Night time frames should probably be looking for light pixels/objects that are not present in the previous image.  Next step is to fix this issues and to incorporate into live processing, and to consider cropped image extraction. Added  live processing to AstroNorthCam 1.3.2.  Routine is only used in daytime image (sunalt > -2°).  A separate Continuous Improvement ticket has been added (S1329A) to detect meteor, satellite flashes and unidentified objects in night time images.
   Done 2025-05-22 (AstroNorthCam 1.3.2 / 1.4 )

[ Prev | Next ]

Back to Top Issue,  Back to Top

[ Prev | Next ]

Back to Top Issue,  Back to Top

Review  - Image Timed-Out Failures & CCD Camera Freezes

In recent sessions including the S1325 session there have been a lot of Image Time-Out Failures & associated freezing of the CCDCamera process.  Some improvements have already been made or attempted, but there are several areas of improvement still needed.

• If possible,  prevent the occurence of  Image Time-Out Failures & the freezing of the CCDCamera process, or significantly reduce the incidence of these issues
• Reduce the impact of Image Failures / CCD Camera freezes.

Improvement

• In event of' Image Failed (Timed-Out)' during Foc1 Focus Profiling the Job Executor should test the state of CCDCamera.IsPending()  and if it is pending to command an immediate RestartCCDSoft() operation, and allow it to proceed / finish before moving on to the next focus frame.
   
• Hide the reporting of "Camera.TakeImageTask ..  is taking a long time" whilst RestartCCDSoft operation is running.

Update 2025-07-04

Underlying issue has likely been fixed in AstroMain 3.75.11 (2025-07-03) after protracted investigations/testing and eventual discovery that the issue was associated with calls to CCDCamera.State and CCDCamera.Status from the DrawObservatoryPicture() routine whilst an image was being taken.  AstroMain program modified so that DrawObservatoryPicture() accesses two new properties CCDCamera.LastState and CCDCamera.LastStatus when an image is being taken which return the values of otherwise private (saved) variables _State and _Status, without accessing CCDSoft.Camera.

Back to Top

Geomagnetic Station -  Operation (2025-05-14 to 2025-06-07)

Back to Top